source of literature review

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Dissertation
• What is a Literature Review? | Guide, Template, & Examples

What is a Literature Review? | Guide, Template, & Examples

Published on 22 February 2022 by Shona McCombes . Revised on 7 June 2022.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research.

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarise sources – it analyses, synthesises, and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

Table of contents

Why write a literature review, examples of literature reviews, step 1: search for relevant literature, step 2: evaluate and select sources, step 3: identify themes, debates and gaps, step 4: outline your literature review’s structure, step 5: write your literature review, frequently asked questions about literature reviews, introduction.

• Quick Run-through
• Step 1 & 2

When you write a dissertation or thesis, you will have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and scholarly context
• Develop a theoretical framework and methodology for your research
• Position yourself in relation to other researchers and theorists
• Show how your dissertation addresses a gap or contributes to a debate

You might also have to write a literature review as a stand-alone assignment. In this case, the purpose is to evaluate the current state of research and demonstrate your knowledge of scholarly debates around a topic.

The content will look slightly different in each case, but the process of conducting a literature review follows the same steps. We’ve written a step-by-step guide that you can follow below.

The only proofreading tool specialized in correcting academic writing

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Correct my document today

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research objectives and questions .

If you are writing a literature review as a stand-alone assignment, you will have to choose a focus and develop a central question to direct your search. Unlike a dissertation research question, this question has to be answerable without collecting original data. You should be able to answer it based only on a review of existing publications.

Make a list of keywords

Start by creating a list of keywords related to your research topic. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list if you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can use boolean operators to help narrow down your search:

Read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

To identify the most important publications on your topic, take note of recurring citations. If the same authors, books or articles keep appearing in your reading, make sure to seek them out.

You probably won’t be able to read absolutely everything that has been written on the topic – you’ll have to evaluate which sources are most relevant to your questions.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models and methods? Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• How does the publication contribute to your understanding of the topic? What are its key insights and arguments?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible, and make sure you read any landmark studies and major theories in your field of research.

You can find out how many times an article has been cited on Google Scholar – a high citation count means the article has been influential in the field, and should certainly be included in your literature review.

The scope of your review will depend on your topic and discipline: in the sciences you usually only review recent literature, but in the humanities you might take a long historical perspective (for example, to trace how a concept has changed in meaning over time).

Remember that you can use our template to summarise and evaluate sources you’re thinking about using!

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It’s important to keep track of your sources with references to avoid plagiarism . It can be helpful to make an annotated bibliography, where you compile full reference information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

You can use our free APA Reference Generator for quick, correct, consistent citations.

To begin organising your literature review’s argument and structure, you need to understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly-visual platforms like Instagram and Snapchat – this is a gap that you could address in your own research.

There are various approaches to organising the body of a literature review. You should have a rough idea of your strategy before you start writing.

Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarising sources in order.

Try to analyse patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organise your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text, your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

If you are writing the literature review as part of your dissertation or thesis, reiterate your central problem or research question and give a brief summary of the scholarly context. You can emphasise the timeliness of the topic (“many recent studies have focused on the problem of x”) or highlight a gap in the literature (“while there has been much research on x, few researchers have taken y into consideration”).

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, make sure to follow these tips:

• Summarise and synthesise: give an overview of the main points of each source and combine them into a coherent whole.
• Analyse and interpret: don’t just paraphrase other researchers – add your own interpretations, discussing the significance of findings in relation to the literature as a whole.
• Critically evaluate: mention the strengths and weaknesses of your sources.
• Write in well-structured paragraphs: use transitions and topic sentences to draw connections, comparisons and contrasts.

In the conclusion, you should summarise the key findings you have taken from the literature and emphasise their significance.

If the literature review is part of your dissertation or thesis, reiterate how your research addresses gaps and contributes new knowledge, or discuss how you have drawn on existing theories and methods to build a framework for your research. This can lead directly into your methodology section.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarise yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2022, June 07). What is a Literature Review? | Guide, Template, & Examples. Scribbr. Retrieved 6 May 2024, from https://www.scribbr.co.uk/thesis-dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, how to write a dissertation proposal | a step-by-step guide, what is a theoretical framework | a step-by-step guide, what is a research methodology | steps & tips.

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 5. The Literature Review
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

• Give a new interpretation of old material or combine new with old interpretations,
• Trace the intellectual progression of the field, including major debates,
• Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
• Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

• Place each work in the context of its contribution to understanding the research problem being studied.
• Describe the relationship of each work to the others under consideration.
• Identify new ways to interpret prior research.
• Reveal any gaps that exist in the literature.
• Resolve conflicts amongst seemingly contradictory previous studies.
• Identify areas of prior scholarship to prevent duplication of effort.
• Point the way in fulfilling a need for additional research.
• Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE : Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

• An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
• Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
• An explanation of how each work is similar to and how it varies from the others,
• Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

• Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
• Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
• Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
• Persuasiveness -- which of the author's theses are most convincing or least convincing?
• Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

• Current Situation : Information necessary to understand the current topic or focus of the literature review.
• Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
• History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
• Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
• Standards : Description of the way in which you present your information.
• Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

• Sources in your literature review do not clearly relate to the research problem;
• You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
• Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
• Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
• Does not describe the search procedures that were used in identifying the literature to review;
• Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
• Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

• How are they organizing their ideas?
• What methods have they used to study the problem?
• What theories have been used to explain, predict, or understand their research problem?
• What sources have they cited to support their conclusions?
• How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

• Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
• Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
• Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

• << Previous: Theoretical Framework
• Next: Citation Tracking >>
• Last Updated: May 9, 2024 11:05 AM
• URL: https://libguides.usc.edu/writingguide

Literature review sources

Sources for literature review can be divided into three categories as illustrated in table below. In your dissertation you will need to use all three categories of literature review sources:

Sources for literature review and examples

Generally, your literature review should integrate a wide range of sources such as:

• Books . Textbooks remain as the most important source to find models and theories related to the research area. Research the most respected authorities in your selected research area and find the latest editions of books authored by them. For example, in the area of marketing the most notable authors include Philip Kotler, Seth Godin, Malcolm Gladwell, Emanuel Rosen and others.
• Magazines . Industry-specific magazines are usually rich in scholarly articles and they can be effective source to learn about the latest trends and developments in the research area. Reading industry magazines can be the most enjoyable part of the literature review, assuming that your selected research area represents an area of your personal and professional interests, which should be the case anyways.
• Newspapers can be referred to as the main source of up-to-date news about the latest events related to the research area. However, the proportion of the use of newspapers in literature review is recommended to be less compared to alternative sources of secondary data such as books and magazines. This is due to the fact that newspaper articles mainly lack depth of analyses and discussions.
• Online articles . You can find online versions of all of the above sources. However, note that the levels of reliability of online articles can be highly compromised depending on the source due to the high levels of ease with which articles can be published online. Opinions offered in a wide range of online discussion blogs cannot be usually used in literature review. Similarly, dissertation assessors are not keen to appreciate references to a wide range of blogs, unless articles in these blogs are authored by respected authorities in the research area.

Your secondary data sources may comprise certain amount of grey literature as well. The term grey literature refers to type of literature produced by government, academics, business and industry in print and electronic formats, which is not controlled by commercial publishers. It is called ‘grey’ because the status of the information in grey literature is not certain. In other words, any publication that has not been peer reviewed for publication is grey literature.

The necessity to use grey literature arises when there is no enough peer reviewed publications are available for the subject of your study.

John Dudovskiy

Literature Reviews

What this handout is about.

This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.

Introduction

OK. You’ve got to write a literature review. You dust off a novel and a book of poetry, settle down in your chair, and get ready to issue a “thumbs up” or “thumbs down” as you leaf through the pages. “Literature review” done. Right?

Wrong! The “literature” of a literature review refers to any collection of materials on a topic, not necessarily the great literary texts of the world. “Literature” could be anything from a set of government pamphlets on British colonial methods in Africa to scholarly articles on the treatment of a torn ACL. And a review does not necessarily mean that your reader wants you to give your personal opinion on whether or not you liked these sources.

What is a literature review, then?

A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.

A literature review can be just a simple summary of the sources, but it usually has an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. And depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.

But how is a literature review different from an academic research paper?

The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts. In a research paper, you use the literature as a foundation and as support for a new insight that you contribute. The focus of a literature review, however, is to summarize and synthesize the arguments and ideas of others without adding new contributions.

Why do we write literature reviews?

Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field. For scholars, the depth and breadth of the literature review emphasizes the credibility of the writer in his or her field. Literature reviews also provide a solid background for a research paper’s investigation. Comprehensive knowledge of the literature of the field is essential to most research papers.

Who writes these things, anyway?

Literature reviews are written occasionally in the humanities, but mostly in the sciences and social sciences; in experiment and lab reports, they constitute a section of the paper. Sometimes a literature review is written as a paper in itself.

Let’s get to it! What should I do before writing the literature review?

If your assignment is not very specific, seek clarification from your instructor:

• Roughly how many sources should you include?
• What types of sources (books, journal articles, websites)?
• Should you summarize, synthesize, or critique your sources by discussing a common theme or issue?
• Should you evaluate your sources?
• Should you provide subheadings and other background information, such as definitions and/or a history?

Find models

Look for other literature reviews in your area of interest or in the discipline and read them to get a sense of the types of themes you might want to look for in your own research or ways to organize your final review. You can simply put the word “review” in your search engine along with your other topic terms to find articles of this type on the Internet or in an electronic database. The bibliography or reference section of sources you’ve already read are also excellent entry points into your own research.

Narrow your topic

There are hundreds or even thousands of articles and books on most areas of study. The narrower your topic, the easier it will be to limit the number of sources you need to read in order to get a good survey of the material. Your instructor will probably not expect you to read everything that’s out there on the topic, but you’ll make your job easier if you first limit your scope.

Keep in mind that UNC Libraries have research guides and to databases relevant to many fields of study. You can reach out to the subject librarian for a consultation: https://library.unc.edu/support/consultations/ .

And don’t forget to tap into your professor’s (or other professors’) knowledge in the field. Ask your professor questions such as: “If you had to read only one book from the 90’s on topic X, what would it be?” Questions such as this help you to find and determine quickly the most seminal pieces in the field.

Consider whether your sources are current

Some disciplines require that you use information that is as current as possible. In the sciences, for instance, treatments for medical problems are constantly changing according to the latest studies. Information even two years old could be obsolete. However, if you are writing a review in the humanities, history, or social sciences, a survey of the history of the literature may be what is needed, because what is important is how perspectives have changed through the years or within a certain time period. Try sorting through some other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to consider what is currently of interest to scholars in this field and what is not.

Strategies for writing the literature review

Find a focus.

A literature review, like a term paper, is usually organized around ideas, not the sources themselves as an annotated bibliography would be organized. This means that you will not just simply list your sources and go into detail about each one of them, one at a time. No. As you read widely but selectively in your topic area, consider instead what themes or issues connect your sources together. Do they present one or different solutions? Is there an aspect of the field that is missing? How well do they present the material and do they portray it according to an appropriate theory? Do they reveal a trend in the field? A raging debate? Pick one of these themes to focus the organization of your review.

Convey it to your reader

A literature review may not have a traditional thesis statement (one that makes an argument), but you do need to tell readers what to expect. Try writing a simple statement that lets the reader know what is your main organizing principle. Here are a couple of examples:

The current trend in treatment for congestive heart failure combines surgery and medicine. More and more cultural studies scholars are accepting popular media as a subject worthy of academic consideration.

Consider organization

You’ve got a focus, and you’ve stated it clearly and directly. Now what is the most effective way of presenting the information? What are the most important topics, subtopics, etc., that your review needs to include? And in what order should you present them? Develop an organization for your review at both a global and local level:

First, cover the basic categories

Just like most academic papers, literature reviews also must contain at least three basic elements: an introduction or background information section; the body of the review containing the discussion of sources; and, finally, a conclusion and/or recommendations section to end the paper. The following provides a brief description of the content of each:

• Introduction: Gives a quick idea of the topic of the literature review, such as the central theme or organizational pattern.
• Body: Contains your discussion of sources and is organized either chronologically, thematically, or methodologically (see below for more information on each).
• Conclusions/Recommendations: Discuss what you have drawn from reviewing literature so far. Where might the discussion proceed?

Organizing the body

Once you have the basic categories in place, then you must consider how you will present the sources themselves within the body of your paper. Create an organizational method to focus this section even further.

To help you come up with an overall organizational framework for your review, consider the following scenario:

You’ve decided to focus your literature review on materials dealing with sperm whales. This is because you’ve just finished reading Moby Dick, and you wonder if that whale’s portrayal is really real. You start with some articles about the physiology of sperm whales in biology journals written in the 1980’s. But these articles refer to some British biological studies performed on whales in the early 18th century. So you check those out. Then you look up a book written in 1968 with information on how sperm whales have been portrayed in other forms of art, such as in Alaskan poetry, in French painting, or on whale bone, as the whale hunters in the late 19th century used to do. This makes you wonder about American whaling methods during the time portrayed in Moby Dick, so you find some academic articles published in the last five years on how accurately Herman Melville portrayed the whaling scene in his novel.

Now consider some typical ways of organizing the sources into a review:

• Chronological: If your review follows the chronological method, you could write about the materials above according to when they were published. For instance, first you would talk about the British biological studies of the 18th century, then about Moby Dick, published in 1851, then the book on sperm whales in other art (1968), and finally the biology articles (1980s) and the recent articles on American whaling of the 19th century. But there is relatively no continuity among subjects here. And notice that even though the sources on sperm whales in other art and on American whaling are written recently, they are about other subjects/objects that were created much earlier. Thus, the review loses its chronological focus.
• By publication: Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on biological studies of sperm whales if the progression revealed a change in dissection practices of the researchers who wrote and/or conducted the studies.
• By trend: A better way to organize the above sources chronologically is to examine the sources under another trend, such as the history of whaling. Then your review would have subsections according to eras within this period. For instance, the review might examine whaling from pre-1600-1699, 1700-1799, and 1800-1899. Under this method, you would combine the recent studies on American whaling in the 19th century with Moby Dick itself in the 1800-1899 category, even though the authors wrote a century apart.
• Thematic: Thematic reviews of literature are organized around a topic or issue, rather than the progression of time. However, progression of time may still be an important factor in a thematic review. For instance, the sperm whale review could focus on the development of the harpoon for whale hunting. While the study focuses on one topic, harpoon technology, it will still be organized chronologically. The only difference here between a “chronological” and a “thematic” approach is what is emphasized the most: the development of the harpoon or the harpoon technology.But more authentic thematic reviews tend to break away from chronological order. For instance, a thematic review of material on sperm whales might examine how they are portrayed as “evil” in cultural documents. The subsections might include how they are personified, how their proportions are exaggerated, and their behaviors misunderstood. A review organized in this manner would shift between time periods within each section according to the point made.
• Methodological: A methodological approach differs from the two above in that the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the “methods” of the researcher or writer. For the sperm whale project, one methodological approach would be to look at cultural differences between the portrayal of whales in American, British, and French art work. Or the review might focus on the economic impact of whaling on a community. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed. Once you’ve decided on the organizational method for the body of the review, the sections you need to include in the paper should be easy to figure out. They should arise out of your organizational strategy. In other words, a chronological review would have subsections for each vital time period. A thematic review would have subtopics based upon factors that relate to the theme or issue.

Sometimes, though, you might need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. Put in only what is necessary. Here are a few other sections you might want to consider:

• Current Situation: Information necessary to understand the topic or focus of the literature review.
• History: The chronological progression of the field, the literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
• Methods and/or Standards: The criteria you used to select the sources in your literature review or the way in which you present your information. For instance, you might explain that your review includes only peer-reviewed articles and journals.

Questions for Further Research: What questions about the field has the review sparked? How will you further your research as a result of the review?

Begin composing

Once you’ve settled on a general pattern of organization, you’re ready to write each section. There are a few guidelines you should follow during the writing stage as well. Here is a sample paragraph from a literature review about sexism and language to illuminate the following discussion:

However, other studies have shown that even gender-neutral antecedents are more likely to produce masculine images than feminine ones (Gastil, 1990). Hamilton (1988) asked students to complete sentences that required them to fill in pronouns that agreed with gender-neutral antecedents such as “writer,” “pedestrian,” and “persons.” The students were asked to describe any image they had when writing the sentence. Hamilton found that people imagined 3.3 men to each woman in the masculine “generic” condition and 1.5 men per woman in the unbiased condition. Thus, while ambient sexism accounted for some of the masculine bias, sexist language amplified the effect. (Source: Erika Falk and Jordan Mills, “Why Sexist Language Affects Persuasion: The Role of Homophily, Intended Audience, and Offense,” Women and Language19:2).

Use evidence

In the example above, the writers refer to several other sources when making their point. A literature review in this sense is just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence to show that what you are saying is valid.

Be selective

Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the review’s focus, whether it is thematic, methodological, or chronological.

Use quotes sparingly

Falk and Mills do not use any direct quotes. That is because the survey nature of the literature review does not allow for in-depth discussion or detailed quotes from the text. Some short quotes here and there are okay, though, if you want to emphasize a point, or if what the author said just cannot be rewritten in your own words. Notice that Falk and Mills do quote certain terms that were coined by the author, not common knowledge, or taken directly from the study. But if you find yourself wanting to put in more quotes, check with your instructor.

Summarize and synthesize

Remember to summarize and synthesize your sources within each paragraph as well as throughout the review. The authors here recapitulate important features of Hamilton’s study, but then synthesize it by rephrasing the study’s significance and relating it to their own work.

Keep your own voice

While the literature review presents others’ ideas, your voice (the writer’s) should remain front and center. Notice that Falk and Mills weave references to other sources into their own text, but they still maintain their own voice by starting and ending the paragraph with their own ideas and their own words. The sources support what Falk and Mills are saying.

Use caution when paraphrasing

When paraphrasing a source that is not your own, be sure to represent the author’s information or opinions accurately and in your own words. In the preceding example, Falk and Mills either directly refer in the text to the author of their source, such as Hamilton, or they provide ample notation in the text when the ideas they are mentioning are not their own, for example, Gastil’s. For more information, please see our handout on plagiarism .

Revise, revise, revise

Draft in hand? Now you’re ready to revise. Spending a lot of time revising is a wise idea, because your main objective is to present the material, not the argument. So check over your review again to make sure it follows the assignment and/or your outline. Then, just as you would for most other academic forms of writing, rewrite or rework the language of your review so that you’ve presented your information in the most concise manner possible. Be sure to use terminology familiar to your audience; get rid of unnecessary jargon or slang. Finally, double check that you’ve documented your sources and formatted the review appropriately for your discipline. For tips on the revising and editing process, see our handout on revising drafts .

Works consulted

We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.

Anson, Chris M., and Robert A. Schwegler. 2010. The Longman Handbook for Writers and Readers , 6th ed. New York: Longman.

Jones, Robert, Patrick Bizzaro, and Cynthia Selfe. 1997. The Harcourt Brace Guide to Writing in the Disciplines . New York: Harcourt Brace.

Lamb, Sandra E. 1998. How to Write It: A Complete Guide to Everything You’ll Ever Write . Berkeley: Ten Speed Press.

Rosen, Leonard J., and Laurence Behrens. 2003. The Allyn & Bacon Handbook , 5th ed. New York: Longman.

Troyka, Lynn Quittman, and Doug Hesse. 2016. Simon and Schuster Handbook for Writers , 11th ed. London: Pearson.

You may reproduce it for non-commercial use if you use the entire handout and attribute the source: The Writing Center, University of North Carolina at Chapel Hill

Make a Gift

Harvey Cushing/John Hay Whitney Medical Library

• Collections
• Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

• Biomedical Databases
• Global (Public Health) Databases
• Soc. Sci., History, and Law Databases
• Grey Literature
• Trials Registers
• Data and Statistics
• Public Policy
• Google Tips
• Recommended Books
• Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

• Explains the background of research on a topic.
• Demonstrates why a topic is significant to a subject area.
• Discovers relationships between research studies/ideas.
• Identifies major themes, concepts, and researchers on a topic.
• Identifies critical gaps and points of disagreement.
• Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

• Make sure your research question is not too broad or too narrow.  Is it manageable?
• Begin writing down terms that are related to your question. These will be useful for searches later.
• If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

• This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

• use the tabs on this guide
• Find other databases in the Nursing Information Resources web page
• More on the Medical Library web page
• ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

• Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
• Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
• Review the abstracts of research studies carefully. This will save you time.
• Use the bibliographies and references of research studies you find to locate others.
• Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
• Ask your librarian for help at any time.
• Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

• What was the research question of the study you are reviewing? What were the authors trying to discover?
• Was the research funded by a source that could influence the findings?
• What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
• Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
• If there are conflicting studies, why do you think that is?
• How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

• Review the abstracts carefully.  
• Keep careful notes so that you may track your thought processes during the research process.
• Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
• << Previous: Recommended Books
• Last Updated: Jan 4, 2024 10:52 AM
• URL: https://guides.library.yale.edu/YSNDoctoral

• Library Guides

The Literature Review

Primary and secondary sources, the literature review: primary and secondary sources.

• Searching the literature
• Grey literature
• Organising and analysing
• Systematic Reviews
• The Literature Review Toolbox

On this page

• Primary vs secondary sources: The differences explained 

Can something be both a primary and secondary source?

Research for your literature review can be categorised as either primary or secondary in nature. The simplest definition of primary sources is either original information (such as survey data) or a first person account of an event (such as an interview transcript). Whereas secondary sources are any publshed or unpublished works that describe, summarise, analyse, evaluate, interpret or review primary source materials. Secondary sources can incorporate primary sources to support their arguments.

Ideally, good research should use a combination of both primary and secondary sources. For example, if a researcher were to investigate the introduction of a law and the impacts it had on a community, he/she might look at the transcripts of the parliamentary debates as well as the parliamentary commentary and news reporting surrounding the laws at the time. 

Examples of primary and secondary sources

Primary vs secondary sources: The differences explained

Finding primary sources

• VU Special Collections  - The Special Collections at Victoria University Library are a valuable research resource. The Collections have strong threads of radical literature, particularly Australian Communist literature, much of which is rare or unique. Women and urban planning also feature across the Collections. There are collections that give you a picture of the people who donated them like Ray Verrills, John McLaren, Sir Zelman Cowen, and Ruth & Maurie Crow. Other collections focus on Australia's neighbours – PNG and Timor-Leste.
• POLICY - Sharing the latest in policy knowledge and evidence, this database supports enhanced learning, collaboration and contribution.
• Indigenous Australia  -  The Indigenous Australia database represents the collections of the Aboriginal and Torres Strait Islander Commission Library.
• Australian Heritage Bibliography - Aboriginal and Torres Strait Islander Subset (AHB-ATSIS)  - AHB is a bibliographic database that indexes and abstracts articles from published and unpublished material on Australia's natural and cultural environment. The AHB-ATSIS subset contains records that specifically relate to the Aboriginal and Torres Strait Islander peoples.include journal articles, unpublished reports, books, videos and conference proceedings from many different sources around Australia. Emphasis is placed on reports written or commissioned by government and non-government heritage agencies throughout the country.
• ATSIhealth  - The Aboriginal and Torres Strait Islander Health Bibliography (ATSIhealth), compiled by Neil Thomson and Natalie Weissofner at the School of Indigenous Australian Studies, Kurongkurl Katitjin, Edith Cowan University, is a bibliographic database that indexes published and unpublished material on Australian Indigenous health. Source documents include theses, unpublished articles, government reports, conference papers, abstracts, book chapters, books, discussion and working papers, and statistical documents. 
• National Archive of Australia  - The National Archives of Australia holds the memory of our nation and keeps vital Australian Government records safe. 
• National Library of Australia: Manuscripts  - Manuscripts collection that is wide ranging and provides rich evidence of the lives and activities of Australians who have shaped our society.
• National Library of Australia: Printed ephemera  - The National Library has been selectively collecting Australian printed ephemera since the early 1960s as a record of Australian life and social customs, popular culture, national events, and issues of national concern.
• National Library of Australia: Oral history and folklore - The Library’s Oral History and Folklore Collection dates back to the 1950’s and includes a rich and diverse collection of interviews and recordings with Australians from all walks of life.
• Historic Hansard - Commonwealth of Australia parliamentary debates presented in an easy-to-read format for historians and other lovers of political speech.
• The Old Bailey Online - A fully searchable edition of the largest body of texts detailing the lives of non-elite people ever published, containing 197,745 criminal trials held at London's central criminal court.

Whether or not a source can be considered both primary and  secondary, depends on the context. In some instances, material may act as a secondary source for one research area, and as a primary source for another. For example, Niccolò Machiavelli’s The Prince , published in 1513, is an important secondary source for any study of the various Renaissance princes in the Medici family; but the same book is also a primary source for the political thought that was characteristic of the sixteenth century because it reflects the attitudes of a person living in the 1500s.

Source: Craver, 1999, as cited in University of South Australia Library. (2021, Oct 6).  Can something be a primary and secondary source?.  University of South Australia Library. https://guides.library.unisa.edu.au/historycultural/sourcetypes

• << Previous: Overview
• Next: Searching the literature >>
• Last Updated: Mar 27, 2024 2:06 PM
• URL: https://libraryguides.vu.edu.au/the-literature-review

• University of Texas Libraries

Literature Reviews

• What is a literature review?
• Steps in the Literature Review Process
• Define your research question
• Determine inclusion and exclusion criteria
• Choose databases and search
• Review Results
• Synthesize Results
• Analyze Results
• Librarian Support

What is a Literature Review?

A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field. 

A literature review should: 

• Provide a comprehensive and updated review of the literature;
• Explain why this review has taken place;
• Articulate a position or hypothesis;
• Acknowledge and account for conflicting and corroborating points of view

From  S age Research Methods

Purpose of a Literature Review

A literature review can be written as an introduction to a study to:

• Demonstrate how a study fills a gap in research
• Compare a study with other research that's been done

Or it can be a separate work (a research article on its own) which:

• Organizes or describes a topic
• Describes variables within a particular issue/problem

Limitations of a Literature Review

Some of the limitations of a literature review are:

• It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
• It may be too focused. Some niche studies may miss the bigger picture.
• It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
• It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).

Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.

Meryl Brodsky : Communication and Information Studies

Hannah Chapman Tripp : Biology, Neuroscience

Carolyn Cunningham : Human Development & Family Sciences, Psychology, Sociology

Larayne Dallas : Engineering

Janelle Hedstrom : Special Education, Curriculum & Instruction, Ed Leadership & Policy ​

Susan Macicak : Linguistics

Imelda Vetter : Dell Medical School

For help in other subject areas, please see the guide to library specialists by subject .

Periodically, UT Libraries runs a workshop covering the basics and library support for literature reviews. While we try to offer these once per academic year, we find providing the recording to be helpful to community members who have missed the session. Following is the most recent recording of the workshop, Conducting a Literature Review. To view the recording, a UT login is required.

• October 26, 2022 recording
• Last Updated: Oct 26, 2022 2:49 PM
• URL: https://guides.lib.utexas.edu/literaturereviews

• Subject guides
• Researching for your literature review
• Literature sources

Researching for your literature review: Literature sources

• Literature reviews
• Before you start
• Develop a search strategy
• Keyword search activity
• Subject search activity
• Combined keyword and subject searching
• Online tutorials
• Apply search limits
• Run a search in different databases
• Supplementary searching
• Save your searches
• Manage results

Scholarly databases

It's important to make a considered decision as to where to search for your review of the literature. It's uncommon for a disciplinary area to be covered by a single publisher, so searching a single publisher platform or database is unlikely to give you sufficient coverage of studies for a review. A good quality literature review involves searching a number of databases individually.

The most common method is to search a combination of large inter-disciplinary databases such as Scopus & Web of Science Core Collection, and some subject-specific databases (such as PsycInfo or EconLit etc.). The Library databases are an excellent place to start for sources of peer-reviewed journal articles.

Depending on disciplinary expectations, or the topic of our review, you may also need to consider sources or search methods other than database searching. There is general information below on searching grey literature. However, due to the wide varieties of grey literature available, you may need to spend some time investigating sources relevant for your specific need.

Grey literature

Grey literature is information which has been published informally or non-commercially (where the main purpose of the producing body is not commercial publishing) or remains unpublished. One example may be Government publications.

Grey literature may be included in a literature review to minimise publication bias . The quality of grey literature can vary greatly - some may be peer reviewed whereas some may not have been through a traditional editorial process.

See the Grey Literature guide for further information on finding and evaluating grey sources.

See the Moodle book MNHS: Systematically searching the grey literature for a comprehensive module on grey literature for systematic reviews.

In certain disciplines (such as physics) there can be a culture of preprints being made available prior to submissions to journals. There has also been a noticeable rise in preprints in medical and health areas in the wake of Covid-19.

If preprints are relevant for you, you can search preprint servers directly. A workaround might be to utilise a search engine such as Google Scholar to search specifically for preprints, as Google Scholar has timely coverage of most preprint servers including ArXiv, RePec, SSRN, BioRxiv, and MedRxiv.

Articles in Press are not preprints, but are accepted manuscripts that are not yet formally published. Articles in Press have been made available as an early access online version of a paper that may not yet have received its final formatting or an allocation of a volume/issue number. As well as being available on a journal's website, Articles in Press are available in databases such as Scopus and Web of Science, and so (unlike preprints) don't necessarily require a separate search.

Conference papers

Conference papers are typically published in conference proceedings (the collection of papers presented at a conference), and may be found on an organisation or Society's website, as a journal, or as a special issue of journal.

In certain disciplines (such as computer science), conference papers may be highly regarded as a form of scholarly communication; the conferences are highly selective, the papers are generally peer reviewed, and papers are published in proceedings affiliated with high-quality publishing houses.

Conference papers may be indexed in a range of scholarly databases. If you only want to see conference papers, database limits can be used to filter results, or try a specific index such as the examples below:

• Conference proceedings citation index. Social science & humanities (CPCI-SSH)
• Conference proceedings citation index. Science (CPCI-S)
• ASME digital library conference proceedings

Honours students and postgraduates may request conference papers through Interlibrary Loans . However, conference paper requests may take longer than traditional article requests as they can be difficult to locate; they may have been only supplied to attendees or not formally published. Sometimes only the abstract is available.

If you are specifically looking for statistical data, try searching for the keyword statistics in a Google Advanced Search and limiting by a relevant site or domain. Below are some examples of sites, or you can try a domain such as .gov for government websites.

Statistical data can be found in the following selected sources:

• Australian Bureau of Statistics
• World Health Organization: Health Data and statistics
• Higher Education Statistics
• UNESCO Institute for Statistics
• Tourism Australia Statistics

For a list of databases that include statistics see: Databases by Subject: Statistics .

If you are specifically looking for information found in newspapers, the library has a large collection of Australian and overseas newspapers, both current and historical.

To search the full-text of newspapers in electronic format use a database such as  Newsbank.

Alternatively, see the Newspapers subject guide for comprehensive information on newspaper sources available via Monash University library and open source databases, as well as searching tips, online videos and more.

Dissertations and theses

The Monash University Library Theses subject guide provides resources and guidelines for locating and accessing theses (dissertations) produced by Monash University as well as other universities in Australia and internationally.  

International theses:

There are a number of theses databases and repositories.

A popular source is:

• ProQuest Dissertations & Theses Global  which predominantly, covers North American masters and doctoral theses. Full text is available for theses added since 1997. 

Australia and New Zealand theses:

Theses that are available in the library can be found using the  Search catalogue.

These include:

• Monash doctoral, masters and a small number of honours theses 
• other Australian and overseas theses that have been purchased for the collection.

Formats include print (not available for loan), microfiche and online (some may have access restrictions).

Trove includes doctoral, masters and some honours theses from all Australian and New Zealand universities, as well as theses awarded elsewhere but held by Australian institutions.

Tips:  

• Type in the title, author surname and/or keywords. Then on the results page refine your search to 'thesis'.
• Alternatively, use the Advanced search and include 'thesis' as a keyword or limi t your result to format = thesis
• << Previous: Literature reviews
• Next: Before you start >>

Literature Review: Lit Review Sources

• Lit Review Types
• GRADE System
• Do a Lit Review
• Citation Justice
• Lit Review Sources

Where do I find information for a literature review?

Research is done by...

...by way of...

...communicated through...

...and organized in...

Types of sources for a review...

• Primary source: Usually a report by the original researchers of a study (unfiltered sources)
• Secondary source: Description or summary by somebody other than the original researcher, e.g. a review article (filtered sources)
• Conceptual/theoretical: Papers concerned with description or analysis of theories or concepts associated with the topic
• Anecdotal/opinion/clinical: Views or opinions about the subject that are not research, review or theoretical (case studies or reports from clinical settings)

A Heirarchy of research information:

Source: SUNY Downstate Medical Center. Medical Research Library of Brooklyn. Evidence Based Medicine Course. A Guide to Research Methods: The Evidence Pyramid: http://library.downstate.edu/EBM2/2100.htm

Life Cycle of Publication

Click image to enlarge

Scientific information has a ‘life cycle’ of its own… it is born as an idea, and then matures and becomes more available to the public. First it appears within the so-called ‘invisible college’ of experts in the field, discussed at conferences and symposia or posted as pre-prints for comments and corrections. Then it appears in the published literature (the primary literature), often as a journal article in a peer-reviewed journal.

Researchers can use the indexing and alerting services of the secondary literature to find out what has been published in a field. Depending on how much information is added by the indexer or abstracter, this may take a few months (though electronic publication has sped up this process). Finally, the information may appear in more popular or reference sources, sometimes called the tertiary literature.

The person beginning a literature search may take this process in reverse: using tertiary sources for general background, then going to the secondary literature to survey what has been published, following up by finding the original (primary) sources, and generating their own research Idea.

(Original content by Wade Lee-Smith)

• << Previous: Citation Justice
• Next: Readings >>
• Last Updated: Feb 16, 2024 8:43 AM
• URL: https://libguides.utoledo.edu/litreview

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• CAREER FEATURE
• 04 December 2020
• Correction 09 December 2020

How to write a superb literature review

Andy Tay is a freelance writer based in Singapore.

You can also search for this author in PubMed   Google Scholar

Literature reviews are important resources for scientists. They provide historical context for a field while offering opinions on its future trajectory. Creating them can provide inspiration for one’s own research, as well as some practice in writing. But few scientists are trained in how to write a review — or in what constitutes an excellent one. Even picking the appropriate software to use can be an involved decision (see ‘Tools and techniques’). So Nature asked editors and working scientists with well-cited reviews for their tips.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

doi: https://doi.org/10.1038/d41586-020-03422-x

Interviews have been edited for length and clarity.

Updates & Corrections

Correction 09 December 2020 : An earlier version of the tables in this article included some incorrect details about the programs Zotero, Endnote and Manubot. These have now been corrected.

Hsing, I.-M., Xu, Y. & Zhao, W. Electroanalysis 19 , 755–768 (2007).

Article   Google Scholar  

Ledesma, H. A. et al. Nature Nanotechnol. 14 , 645–657 (2019).

Article   PubMed   Google Scholar  

Brahlek, M., Koirala, N., Bansal, N. & Oh, S. Solid State Commun. 215–216 , 54–62 (2015).

Choi, Y. & Lee, S. Y. Nature Rev. Chem . https://doi.org/10.1038/s41570-020-00221-w (2020).

Download references

Related Articles

• Research management

How I fled bombed Aleppo to continue my career in science

Career Feature 08 MAY 24

Illuminating ‘the ugly side of science’: fresh incentives for reporting negative results

Hunger on campus: why US PhD students are fighting over food

Career Feature 03 MAY 24

Japan can embrace open science — but flexible approaches are key

Correspondence 07 MAY 24

US funders to tighten oversight of controversial ‘gain of function’ research

News 07 MAY 24

France’s research mega-campus faces leadership crisis

News 03 MAY 24

Mount Etna’s spectacular smoke rings and more — April’s best science images

Plagiarism in peer-review reports could be the ‘tip of the iceberg’

Nature Index 01 MAY 24

Clinician Researcher/Group Leader in Cancer Cell Therapies

An excellent opportunity is available for a Group Leader with expertise in cellular therapies to join the Cancer Research program at QIMR Berghofer.

Herston, Brisbane (AU)

QIMR Berghofer

Faculty Positions at the Center for Machine Learning Research (CMLR), Peking University

CMLR's goal is to advance machine learning-related research across a wide range of disciplines.

Beijing, China

Center for Machine Learning Research (CMLR), Peking University

Faculty Positions at SUSTech Department of Biomedical Engineering

We seek outstanding applicants for full-time tenure-track/tenured faculty positions. Positions are available for both junior and senior-level.

Shenzhen, Guangdong, China

Southern University of Science and Technology (Biomedical Engineering)

Southeast University Future Technology Institute Recruitment Notice

Professor openings in mechanical engineering, control science and engineering, and integrating emerging interdisciplinary majors

Nanjing, Jiangsu (CN)

Southeast University

Staff Scientist

A Staff Scientist position is available in the laboratory of Drs. Elliot and Glassberg to study translational aspects of lung injury, repair and fibro

Maywood, Illinois

Loyola University Chicago - Department of Medicine

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

• Library Homepage

Literature Review: The What, Why and How-to Guide: Evaluating Sources & Literature Reviews

• Literature Reviews?
• Strategies to Finding Sources
• Keeping up with Research!
• Evaluating Sources & Literature Reviews
• Organizing for Writing
• Writing Literature Review
• Other Academic Writings

Evaluating Literature Reviews and Sources

• Tips for Evaluating Sources (Print vs. Internet Sources) Excellent page that will guide you on what to ask to determine if your source is a reliable one. Check the other topics in the guide: Evaluating Bibliographic Citations and Evaluation During Reading on the left side menu.

Criteria to evaluate sources:

• Authority : Who is the author? What are the author's credentials and areas of expertise? Is he or she affiliated with a university?
• Usefulness : How this source related to your topic? How current or relevant it is to your topic?
• Reliability : Does the information comes from a reliable, trusted source such as an academic journal?
• Critically Analyzing Information Sources: Critical Appraisal and Analysis (Cornell University Library) Ten things to look for when you evaluate an information source.

Reading Critically

Reading critically (summary from how to read academic texts critically).

• Who is the author? What is his/her standing in the field?
• What is the author’s purpose? To offer advice, make practical suggestions, solve a specific problem, critique or clarify?
• Note the experts in the field: are there specific names/labs that are frequently cited?
• Pay attention to methodology: is it sound? what testing procedures, subjects, materials were used?
• Note conflicting theories, methodologies, and results. Are there any assumptions being made by most/some researchers?
• Theories: have they evolved over time?
• Evaluate and synthesize the findings and conclusions. How does this study contribute to your project?
• How to Read Academic Texts Critically Excellent document about how best to read critically academic articles and other texts.
• How to Read an Academic Article This is an excellent paper that teach you how to read an academic paper, how to determine if it is something to set aside, or something to read deeply. Good advice to organize your literature for the Literature Review or just reading for classes.
• << Previous: Keeping up with Research!
• Next: Organizing for Writing >>
• Last Updated: Mar 5, 2024 11:44 AM
• URL: https://guides.library.ucsb.edu/litreview

• UConn Library
• Literature Review: The What, Why and How-to Guide
• Evaluating Sources & Lit. Reviews

Literature Review: The What, Why and How-to Guide — Evaluating Sources & Lit. Reviews

• Getting Started
• Introduction
• How to Pick a Topic
• Strategies to Find Sources
• Tips for Writing Literature Reviews
• Writing Literature Review: Useful Sites
• Citation Resources
• Other Academic Writings

Reading Critically

To be able to write a good literature review, you need to be able to read critically. Below are some tips that will help you evaluate the sources for your paper.

Reading critically (summary from How to Read Academic Texts Critically)

• Who is the author? What is his/her standing in the field?
• What is the author’s purpose? To offer advice, make practical suggestions, solve a specific problem, to critique, or clarify?
• Note the experts in the field. Are there specific names/labs that are frequently cited?
• Pay attention to methodology. Is it sound? What testing procedures, subjects, and materials were used?
• Note conflicting theories, methodologies and results. Are there any assumptions being made by most/some researchers?
• Theories: Have they evolved overtime?
• Evaluate and synthesize the findings and conclusions. How does this study contribute to your project?

Useful links:

Tips to Evaluate Sources

Criteria to evaluate sources:

Authority : Who is the author? what is his/her credentials--what university he/she is affliliated? Is his/her area of expertise?

Usefulness : How this source related to your topic? How current or relevant it is to your topic?

Reliability : Does the information comes from a reliable, trusted source such as an academic journal?

Useful sites

• Critically Analyzing Information Sources (Cornell University Library)

Evaluating Literature Reviews and Sources

A good literature review evaluates a wide variety of sources (academic articles, scholarly books, government/NGO reports). It also evaluates literature reviews that study similar topics. This page offers you a list of resources and tips on how to evaluate the sources that you may use to write your review.

• A Closer Look at Evaluating Literature Reviews Excerpt from the book chapter, “Evaluating Introductions and Literature Reviews” in Fred Pyrczak’s Evaluating Research in Academic Journals: A Practical Guide to Realistic Evaluation , (Chapter 4 and 5). This PDF discusses and offers great advice on how to evaluate "Introductions" and "Literature Reviews" by listing questions and tips.

• Tips for Evaluating Sources (Print vs. Internet Sources) Excellent page that will guide you on what to ask to determine if your source is a reliable one. Check the other topics in the guide: Evaluating Bibliographic Citations and Evaluation During Reading on the left side menu.
• << Previous: Strategies to Find Sources
• Next: Tips for Writing Literature Reviews >>
• Last Updated: Sep 21, 2022 2:16 PM
• URL: https://guides.lib.uconn.edu/literaturereview

Literature Review - what is a Literature Review, why it is important and how it is done

• Strategies to Find Sources

Evaluating Literature Reviews and Sources

Reading critically, tips to evaluate sources.

• Tips for Writing Literature Reviews
• Writing Literature Review: Useful Sites
• Citation Resources
• Other Academic Writings
• Useful Resources

A good literature review evaluates a wide variety of sources (academic articles, scholarly books, government/NGO reports). It also evaluates literature reviews that study similar topics. This page offers you a list of resources and tips on how to evaluate the sources that you may use to write your review.

• A Closer Look at Evaluating Literature Reviews Excerpt from the book chapter, “Evaluating Introductions and Literature Reviews” in Fred Pyrczak’s Evaluating Research in Academic Journals: A Practical Guide to Realistic Evaluation , (Chapter 4 and 5). This PDF discusses and offers great advice on how to evaluate "Introductions" and "Literature Reviews" by listing questions and tips. First part focus on Introductions and in page 10 in the PDF, 37 in the text, it focus on "literature reviews".
• Tips for Evaluating Sources (Print vs. Internet Sources) Excellent page that will guide you on what to ask to determine if your source is a reliable one. Check the other topics in the guide: Evaluating Bibliographic Citations and Evaluation During Reading on the left side menu.

To be able to write a good Literature Review, you need to be able to read critically. Below are some tips that will help you evaluate the sources for your paper.

Reading critically (summary from How to Read Academic Texts Critically)

• Who is the author? What is his/her standing in the field.
• What is the author’s purpose? To offer advice, make practical suggestions, solve a specific problem, to critique or clarify?
• Note the experts in the field: are there specific names/labs that are frequently cited?
• Pay attention to methodology: is it sound? what testing procedures, subjects, materials were used?
• Note conflicting theories, methodologies and results. Are there any assumptions being made by most/some researchers?
• Theories: have they evolved overtime?
• Evaluate and synthesize the findings and conclusions. How does this study contribute to your project?

Useful links:

• How to Read a Paper (University of Waterloo, Canada) This is an excellent paper that teach you how to read an academic paper, how to determine if it is something to set aside, or something to read deeply. Good advice to organize your literature for the Literature Review or just reading for classes.

Criteria to evaluate sources:

• Authority : Who is the author? what is his/her credentials--what university he/she is affliliated? Is his/her area of expertise?
• Usefulness : How this source related to your topic? How current or relevant it is to your topic?
• Reliability : Does the information comes from a reliable, trusted source such as an academic journal?

Useful site - Critically Analyzing Information Sources (Cornell University Library)

• << Previous: Strategies to Find Sources
• Next: Tips for Writing Literature Reviews >>
• Last Updated: Apr 10, 2024 3:27 PM
• URL: https://lit.libguides.com/Literature-Review

The Library, Technological University of the Shannon: Midwest

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Welcome to the Purdue Online Writing Lab

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

The Online Writing Lab at Purdue University houses writing resources and instructional material, and we provide these as a free service of the Writing Lab at Purdue. Students, members of the community, and users worldwide will find information to assist with many writing projects. Teachers and trainers may use this material for in-class and out-of-class instruction.

The Purdue On-Campus Writing Lab and Purdue Online Writing Lab assist clients in their development as writers—no matter what their skill level—with on-campus consultations, online participation, and community engagement. The Purdue Writing Lab serves the Purdue, West Lafayette, campus and coordinates with local literacy initiatives. The Purdue OWL offers global support through online reference materials and services.

A Message From the Assistant Director of Content Development 

The Purdue OWL® is committed to supporting  students, instructors, and writers by offering a wide range of resources that are developed and revised with them in mind. To do this, the OWL team is always exploring possibilties for a better design, allowing accessibility and user experience to guide our process. As the OWL undergoes some changes, we welcome your feedback and suggestions by email at any time.

Please don't hesitate to contact us via our contact page  if you have any questions or comments.

All the best,

Social Media

Facebook twitter.

• Open access
• Published: 09 May 2024

Machine learning models for abstract screening task - A systematic literature review application for health economics and outcome research

• Jingcheng Du 1 ,
• Ekin Soysal 1 , 3 ,
• Dong Wang 2 ,
• Long He 1 ,
• Bin Lin 1 ,
• Jingqi Wang 1 ,
• Frank J. Manion 1 ,
• Yeran Li 2 ,
• Elise Wu 2 &
• Lixia Yao 2  

BMC Medical Research Methodology volume  24 , Article number:  108 ( 2024 ) Cite this article

121 Accesses

2 Altmetric

Metrics details

Systematic literature reviews (SLRs) are critical for life-science research. However, the manual selection and retrieval of relevant publications can be a time-consuming process. This study aims to (1) develop two disease-specific annotated corpora, one for human papillomavirus (HPV) associated diseases and the other for pneumococcal-associated pediatric diseases (PAPD), and (2) optimize machine- and deep-learning models to facilitate automation of the SLR abstract screening.

This study constructed two disease-specific SLR screening corpora for HPV and PAPD, which contained citation metadata and corresponding abstracts. Performance was evaluated using precision, recall, accuracy, and F1-score of multiple combinations of machine- and deep-learning algorithms and features such as keywords and MeSH terms.

Results and conclusions

The HPV corpus contained 1697 entries, with 538 relevant and 1159 irrelevant articles. The PAPD corpus included 2865 entries, with 711 relevant and 2154 irrelevant articles. Adding additional features beyond title and abstract improved the performance (measured in Accuracy) of machine learning models by 3% for HPV corpus and 2% for PAPD corpus. Transformer-based deep learning models that consistently outperformed conventional machine learning algorithms, highlighting the strength of domain-specific pre-trained language models for SLR abstract screening. This study provides a foundation for the development of more intelligent SLR systems.

Peer Review reports

Introduction

Systematic literature reviews (SLRs) are an essential tool in many areas of health sciences, enabling researchers to understand the current knowledge around a topic and identify future research and development directions. In the field of health economics and outcomes research (HEOR), SLRs play a crucial role in synthesizing evidence around unmet medical needs, comparing treatment options, and preparing the design and execution of future real-world evidence studies. SLRs provide a comprehensive and transparent analysis of available evidence, allowing researchers to make informed decisions and improve patient outcomes.

Conducting a SLR involves synthesizing high-quality evidence from biomedical literature in a transparent and reproducible manner, and seeks to include all available evidence on a given research question, and provides some assessment regarding quality of the evidence [ 1 , 2 ]. To conduct an SLR one or more bibliographic databases are queried based on a given research question and a corresponding set of inclusion and exclusion criteria, resulting in the selection of a relevant set of abstracts. The abstracts are reviewed, further refining the set of articles that are used to address the research question. Finally, appropriate data is systematically extracted from the articles and summarized [ 1 , 3 ].

The current approach to conducting a SLR is through manual review, with data collection, and summary done by domain experts against pre-specified eligibility criteria. This is time-consuming, labor-intensive, expensive, and non-scalable given the current more-than linear growth of the biomedical literature [ 4 ]. Michelson and Reuter estimate that each SLR costs approximately $141,194.80 and that on average major pharmaceutical companies conduct 23.36 SLRs, and major academic centers 177.32 SLRs per year, though the cost may vary based on the scope of different reviews [ 4 ]. Clearly automated methods are needed, both from a cost/time savings perspective, and for the ability to effectively scan and identify increasing amounts of literature, thereby allowing the domain experts to spend more time analyzing the data and gleaning the insights.

One major task of SLR project that involves large amounts of manual effort, is the abstract screening task. For this task, selection criteria are developed and the citation metadata and abstract for articles tentatively meeting these criteria are retrieved from one or more bibliographic databases (e.g., PubMed). The abstracts are then examined in more detail to determine if they are relevant to the research question(s) and should be included or excluded from further consideration. Consequently, the task of determining whether articles are relevant or not based on their titles, abstracts and metadata can be treated as a binary classification task, which can be addressed by natural language processing (NLP). NLP involves recognizing entities and relationships expressed in text and leverages machine-learning (ML) and deep-learning (DL) algorithms together with computational semantics to extract information. The past decade has witnessed significant advances in these areas for biomedical literature mining. A comprehensive review on how NLP techniques in particular are being applied for automatic mining and knowledge extraction from biomedical literature can be found in Zhao et al. [ 5 ].

Materials and methods

The aims of this study were to: (1) identify and develop two disease-specific corpora, one for human papillomavirus (HPV) associated diseases and the other for pneumococcal-associated pediatric diseases suitable for training the ML and DL models underlying the necessary NLP functions; (2) investigate and optimize the performance of the ML and DL models using different sets of features (e.g., keywords, Medical Subject Heading (MeSH) terms [ 6 ]) to facilitate automation of the abstract screening tasks necessary to construct a SLR. Note that these screening corpora can be used as training data to build different NLP models. We intend to freely share these two corpora with the entire scientific community so they can serve as benchmark corpora for future NLP model development in this area.

SLR corpora preparation

Two completed disease-specific SLR studies by Merck & Co., Inc., Rahway, NJ, USA were used as the basis to construct corpora for abstract-level screening. The two SLR studies were both relevant to health economics and outcome research, including one for human papillomavirus (HPV) associated diseases (referred to as the HPV corpus), and one for pneumococcal-associated pediatric diseases (which we refer to as the PAPD corpus). Both of the original SLR studies contained literature from PubMed/MEDLINE and EMBASE. Since we intended for the screening corpora to be released to the community, we only kept citations found from PubMed/MEDLINE in the finalized corpora. Because the original SLR studies did not contain the PubMed ID (PMID) for each article, we matched each article’s citation information (if available) against PubMed and then collected meta-data such as authors, journals, keywords, MeSH terms, publication types, etc., using PubMed Entrez Programming Utilities (E-utilities) Application Programming Interface (API). The detailed description of the two corpora can be seen in Table  1 . Both of the resulting corpora are publicly available at [ https://github.com/Merck/NLP-SLR-corpora ].

Machine learning algorithms

Although deep learning algorithms have demonstrated superior performance on many NLP tasks, conventional machine learning algorithms have certain advantages, such as low computation costs and faster training and prediction speed.

We evaluated four traditional ML-based document classification algorithms, XGBoost [ 7 ], Support Vector Machines (SVM) [ 8 ], Logistic regression (LR) [ 9 ], and Random Forest [ 10 ] on the binary inclusion/exclusion classification task for abstract screening. Salient characteristics of these models are as follows:

XGBoost: Short for “eXtreme Gradient Boosting”, XGBoost is a boosting-based ensemble of algorithms that turn weak learners into strong learners by focusing on where the individual models went wrong. In Gradient Boosting, individual weak models train upon the difference between the prediction and the actual results [ 7 ]. We set max_depth at 3, n_estimators at 150 and learning rate at 0.7.

Support vector machine (SVM): SVM is one of the most robust prediction methods based on statistical learning frameworks. It aims to find a hyperplane in an N-dimensional space (where N = the number of features) that distinctly classifies the data points [ 8 ]. We set C at 100, gamma at 0.005 and kernel as radial basis function.

Logistic regression (LR): LR is a classic statistical model that in its basic form uses a logistic function to model a binary dependent variable [ 9 ]. We set C at 5 and penalty as l2.

Random forest (RF): RF is a machine learning technique that utilizes ensemble learning to combine many decision trees classifiers through bagging or bootstrap aggregating [ 10 ]. We set n_estimators at 100 and max_depth at 14.

These four algorithms were trained for both the HPV screening task and the PAPD screening task using the corresponding training corpus.

For each of the four algorithms, we examined performance using (1) only the baseline feature criteria (title and abstract of each article), and (2) with five additional meta-data features (MeSH, Authors, Keywords, Journal, Publication types.) retrieved from each article using the PubMed E-utilities API. Conventionally, title and abstract are the first information a human reviewer would depend on when making a judgment for inclusion or exclusion of an article. Consequently, we used title and abstract as the baseline features to classify whether an abstract should be included at the abstract screening stage. We further evaluated the performance with additional features that can be retrieved by PubMed E-utilities API, including MeSH terms, authors, journal, keywords and publication type. For baseline evaluation, we concatenated the titles and abstracts and extracted the TF-IDF (term frequency-inverse document frequency) vector for the corpus. TF-IDF evaluates how relevant a word is to a document in a collection of documents. For additional features, we extracted TF-IDF vector using each feature respectively and then concatenated the extracted vectors with title and abstract vector. XGBoost was selected for the feature evaluation process, due to its relatively quick computational running time and robust performance.

Deep learning algorithms

Conventional ML methods rely heavily on manually designed features and suffer from the challenges of data sparsity and poor transportability when applied to new use cases. Deep learning (DL) is a set of machine learning algorithms based on deep neural networks that has advanced performance of text classification along with many other NLP tasks. Transformer-based deep learning models, such as BERT (Bidirectional encoder representations from transformers), have achieved state-of-the-art performance in many NLP tasks [ 11 ]. A Transformer is an emerging architecture of deep learning models designed to handle sequential input data such as natural language by adopting the mechanisms of attention to differentially weigh the significance of each part of the input data [ 12 ]. The BERT model and its variants (which use Transformer as a basic unit) leverage the power of transfer learning by first pre-training the models over 100’s of millions of parameters using large volumes of unlabeled textual data. The resulting model is then fine-tuned for a particular downstream NLP application, such as text classification, named entity recognition, relation extraction, etc. The following three BERT models were evaluated against both the HPV and Pediatric pneumococcal corpus using two sets of features (title and abstract versus adding all additional features into the text). For all BERT models, we used Adam optimizer with weight decay. We set learning rate at 1e-5, batch size at 8 and number of epochs at 20.

BERT base: this is the original BERT model released by Google. The BERT base model was pre-trained on textual data in the general domain, i.e., BooksCorpus (800 M words) and English Wikipedia (2500 M words) [ 11 ].

BioBERT base: as the biomedical language is different from general language, the BERT models trained on general textual data may not work well on biomedical NLP tasks. BioBERT was further pre-trained (based on original BERT models) in the large-scale biomedical corpora, including PubMed abstracts (4.5B words) and PubMed Central Full-text articles (13.5B words) [ 13 ].

PubMedBERT: PubMedBERT was pre-trained from scratch using abstracts from PubMed. This model has achieved state-of-the-art performance on several biomedical NLP tasks on Biomedical Language Understanding and Reasoning Benchmark [ 14 ].

Text pre-processing and libraries that were used

We have removed special characters and common English words as a part of text pre-processing. Default tokenizer from scikit-learn was adopted for tokenization. Scikit-learn was also used for TF-IDF feature extraction and machine learning algorithms implementation. Transformers libraries from Hugging Face were used for deep learning algorithms implementation.

Evaluation datasets were constructed from the HPV and Pediatric pneumococcal corpora and were split into training, validation and testing sets with a ratio of 8:1:1 for the two evaluation tasks: (1) ML algorithms performance assessment; and (2) DL algorithms performance assessment. Models were fitted on the training sets, and model hyperparameters were optimized on the validation sets and the performance were evaluated on the testing sets. The following major metrics are expressed by the noted calculations:

Where True positive is an outcome where the model correctly predicts the positive (e.g., “included” in our tasks) class. Similarly, a True negative is an outcome where the model correctly predicts the negative class (e.g., “excluded” in our tasks). False positive is an outcome where the model incorrectly predicts the positive class, and a False negative is an outcome where the model incorrectly predicts the negative class. We have repeated all experiments five times and reported the mean scores with standard deviation.

Table  2 shows the baseline comparison using different feature combinations for the SLR text classification tasks using XGBoost. As noted, adding additional features in addition to title and abstract was effective in further improving the classification accuracy. Specifically, using all available features for the HPV classification increased accuracy by ? ∼  3% and F1 score by ? ∼  3%; using all available features for Pediatric pneumococcal classification increased accuracy by ? ∼  2% and F1 score by ? ∼  4%. As observed, adding additional features provided a stronger boost in precision, which contributed to the overall performance improvement.

The comparison of the article inclusion/exclusion classification task for four machine learning algorithms with all features is shown in Table  3 . XGBoost achieved the highest accuracy and F-1 scores in both tasks. Table  4 shows the comparison between XGBoost and deep learning algorithms on the classification tasks for each disease. Both XGBoost and deep learning models consistently have achieved higher accuracy scores when using all features as input. Among all models, BioBERT has achieved the highest accuracy at 0.88, compared with XGBoost at 0.86. XGBoost has the highest F1 score at 0.8 and the highest recall score at 0.9 for inclusion prediction.

Discussions and conclusions

Abstract screening is a crucial step in conducting a systematic literature review (SLR), as it helps to identify relevant citations and reduces the effort required for full-text screening and data element extraction. However, screening thousands of abstracts can be a time-consuming and burdensome task for scientific reviewers. In this study, we systematically investigated the use of various machine learning and deep learning algorithms, using different sets of features, to automate abstract screening tasks. We evaluated these algorithms using disease-focused SLR corpora, including one for human papillomavirus (HPV) associated diseases and another for pneumococcal-associated pediatric diseases (PADA). The publicly available corpora used in this study can be used by the scientific community for advanced algorithm development and evaluation. Our findings suggest that machine learning and deep learning algorithms can effectively automate abstract screening tasks, saving valuable time and effort in the SLR process.

Although machine learning and deep learning algorithms trained on the two SLR corpora showed some variations in performance, there were also some consistencies. Firstly, adding additional citation features significantly improved the performance of conventional machine learning algorithms, although the improvement was not as strong in transformer-based deep learning models. This may be because transformer models were mostly pre-trained on abstracts, which do not include additional citation information like MeSH terms, keywords, and journal names. Secondly, when using only title and abstract as input, transformer models consistently outperformed conventional machine learning algorithms, highlighting the strength of subject domain-specific pre-trained language models. When all citation features were combined as input, conventional machine learning algorithms showed comparable performance to deep learning models. Given the much lower computation costs and faster training and prediction time, XGBoost or support vector machines with all citation features could be an excellent choice for developing an abstract screening system.

Some limitations remain for this study. Although we’ve evaluated cutting-edge machine learning and deep learning algorithms on two SLR corpora, we did not conduct much task-specific customization to the learning algorithms, including task-specific feature engineering and rule-based post-processing, which could offer additional benefits to the performance. As the focus of this study is to provide generalizable strategies for employing machine learning to abstract screening tasks, we leave the task-specific customization to future improvement. The corpora we evaluated in this study mainly focus on health economics and outcome research, the generalizability of learning algorithms to another domain will benefit from formal examination.

Extensive studies have shown the superiority of transformer-based deep learning models for many NLP tasks [ 11 , 13 , 14 , 15 , 16 ]. Based on our experiments, however, adding features to the pre-trained language models that have not seen these features before may not significantly boost their performance. It would be interesting to find a better way of encoding additional features to these pre-trained language models to maximize their performance. In addition, transfer learning has proven to be an effective technique to improve the performance on a target task by leveraging annotation data from a source task [ 17 , 18 , 19 ]. Thus, for a new SLR abstract screening task, it would be worthwhile to investigate the use of transfer learning by adapting our (publicly available) corpora to the new target task.

When labeled data is available, supervised machine learning algorithms can be very effective and efficient for article screening. However, as there is increasing need for explainability and transparency in NLP-assisted SLR workflow, supervised machine learning algorithms are facing challenges in explaining why certain papers fail to fulfill the criteria. The recent advances in large language models (LLMs), such as ChatGPT [ 20 ] and Gemini [ 21 ], show remarkable performance on NLP tasks and good potentials in explainablity. Although there are some concerns on the bias and hallucinations that LLMs could bring, it would be worthwhile to evaluate further how LLMs could be applied to SLR tasks and understand the performance of using LLMs to take free-text article screening criteria as the input and provide explainanation for article screening decisions.

Data availability

The annotated corpora underlying this article are available at https://github.com/Merck/NLP-SLR-corpora .

Bullers K, Howard AM, Hanson A, et al. It takes longer than you think: librarian time spent on systematic review tasks. J Med Libr Assoc. 2018;106:198–207. https://doi.org/10.5195/jmla.2018.323 .

Article   PubMed   PubMed Central   Google Scholar  

Carver JC, Hassler E, Hernandes E et al. Identifying Barriers to the Systematic Literature Review Process. In: 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement . 2013. 203–12. https://doi.org/10.1109/ESEM.2013.28 .

Lame G. Systematic literature reviews: an introduction. Proc Des Society: Int Conf Eng Des. 2019;1:1633–42. https://doi.org/10.1017/dsi.2019.169 .

Article   Google Scholar  

Michelson M, Reuter K. The significant cost of systematic reviews and meta-analyses: a call for greater involvement of machine learning to assess the promise of clinical trials. Contemp Clin Trials Commun. 2019;16:100443. https://doi.org/10.1016/j.conctc.2019.100443 .

Recent advances in. biomedical literature mining | Briefings in Bioinformatics | Oxford Academic. https://academic.oup.com/bib/article/22/3/bbaa057/5838460?login=true (accessed 30 May 2022).

Medical Subject Headings - Home Page. https://www.nlm.nih.gov/mesh/meshhome.html (accessed 30 May 2022).

Chen T, Guestrin C, XGBoost:. A Scalable Tree Boosting System. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . New York, NY, USA: Association for Computing Machinery 2016. 785–94. https://doi.org/10.1145/2939672.2939785 .

Noble WS. What is a support vector machine? Nat Biotechnol. 2006;24:1565–7. https://doi.org/10.1038/nbt1206-1565 .

Article   CAS   PubMed   Google Scholar  

Logistic Regression . https://doi.org/10.1007/978-1-4419-1742-3 (accessed 30 May 2022).

Random forest classifier for remote sensing classification. International Journal of Remote Sensing: Vol 26, No 1. https://www.tandfonline.com/doi/abs/10.1080/01431160412331269698 (accessed 30 May 2022).

Devlin J, Chang M-W, Lee K, et al. BERT: pre-training of Deep Bidirectional transformers for Language understanding. arXiv. 2019. https://doi.org/10.48550/arXiv.1810.04805 .

Vaswani A, Shazeer N, Parmar N et al. Attention is All you Need. In: Advances in Neural Information Processing Systems . Curran Associates, Inc. 2017. https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html (accessed 30 May 2022).

BioBERT. a pre-trained biomedical language representation model for biomedical text mining | Bioinformatics | Oxford Academic. https://academic.oup.com/bioinformatics/article/36/4/1234/5566506 (accessed 3 Jun 2020).

Gu Y, Tinn R, Cheng H, et al. Domain-specific Language Model Pretraining for Biomedical Natural Language Processing. ACM Trans Comput Healthc. 2021;3(2):1–2. https://doi.org/10.1145/3458754 .

Article   CAS   Google Scholar  

Chen Q, Du J, Allot A, et al. LitMC-BERT: transformer-based multi-label classification of biomedical literature with an application on COVID-19 literature curation. arXiv. 2022. https://doi.org/10.48550/arXiv.2204.08649 .

Chen Q, Allot A, Leaman R, et al. Multi-label classification for biomedical literature: an overview of the BioCreative VII LitCovid Track for COVID-19 literature topic annotations. arXiv. 2022. https://doi.org/10.48550/arXiv.2204.09781 .

Kermany DS, Goldbaum M, Cai W, et al. Identifying Medical diagnoses and Treatable diseases by Image-based deep learning. Cell. 2018;172:1122–e11319. https://doi.org/10.1016/j.cell.2018.02.010 .

Howard J, Ruder S. Universal Language Model fine-tuning for text classification. arXiv. 2018. https://doi.org/10.48550/arXiv.1801.06146 .

Do CB, Ng AY. Transfer learning for text classification. In: Advances in Neural Information Processing Systems . MIT Press. 2005. https://proceedings.neurips.cc/paper/2005/hash/bf2fb7d1825a1df3ca308ad0bf48591e-Abstract.html (accessed 30 May 2022).

Achiam J et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).

https:// gemini.google.com/app/a4dcd2e2d7672354 . (accessed 01 Feb 2024).

Download references

Acknowledgements

We thank Dr. Majid Rastegar-Mojarad for conducting some additional experiments during revision.

This research was supported by Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA.

Author information

Authors and affiliations.

Intelligent Medical Objects, Houston, TX, USA

Jingcheng Du, Ekin Soysal, Long He, Bin Lin, Jingqi Wang & Frank J. Manion

Merck & Co., Inc, Rahway, NJ, USA

Dong Wang, Yeran Li, Elise Wu & Lixia Yao

McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA

Ekin Soysal

You can also search for this author in PubMed   Google Scholar

Contributions

Study concept and design: JD and LY Corpus preparation: DW, YL and LY Experiments: JD and ES Draft of the manuscript: JD, DW, FJM and LY Acquisition, analysis, or interpretation of data: JD, ES, DW and LY Critical revision of the manuscript for important intellectual content: JD, ES, DW, LH, BL, JW, FJM, YL, EW, LY Study supervision: LY.

Corresponding author

Correspondence to Lixia Yao .

Ethics declarations

Disclaimers.

The content is the sole responsibility of the authors and does not necessarily represent the official views of Merck & Co., Inc., Rahway, NJ, USA or Intelligent Medical Objects.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Competing interests.

DW is an employee of Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA. EW, YL, and LY were employees of Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA for this work. JD, LH, JW, and FJM are employees of Intelligent Medical Objects. ES was an employee of Intelligent Medical Objects during his contributions, and is currently an employee of EBSCO Information Services. All the other authors declare no competing interest.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Du, J., Soysal, E., Wang, D. et al. Machine learning models for abstract screening task - A systematic literature review application for health economics and outcome research. BMC Med Res Methodol 24 , 108 (2024). https://doi.org/10.1186/s12874-024-02224-3

Download citation

Received : 19 May 2023

Accepted : 18 April 2024

Published : 09 May 2024

DOI : https://doi.org/10.1186/s12874-024-02224-3

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Machine learning
• Deep learning
• Text classification
• Article screening
• Systematic literature review

BMC Medical Research Methodology

ISSN: 1471-2288

• General enquiries: [email protected]

Advertisement

Supported by

Pulitzer Prizes 2024: A Guide to the Winning Books and Finalists

Jayne Anne Phillips won the fiction award for “Night Watch,” while Jonathan Eig and Ilyon Woo shared the biography prize.

• Share full article

By Elizabeth A. Harris and Joumana Khatib

Eighteen books were recognized as winners or finalists for the Pulitzer Prize on Monday, in the categories of history, memoir, poetry, general nonfiction, fiction and biography, which had two winners.

Night Watch , by Jayne Anne Phillips

A story about a mother and daughter set in the Trans-Allegheny Lunatic Asylum in Weston, W.Va., after the Civil War. “Night Watch,” which was also longlisted for the National Book Award, is about surviving war and its aftermath. “I consider Phillips to be among the greatest and most intuitive of American writers,” wrote our critic Dwight Garner.

Fiction finalist: Wednesday’s Child: Stories , by Yiyun Li

A short story collection written over the course of a decade that examines aging and loss. The stories touch on a woman who makes a spreadsheet of every person she’s lost, a middle-aged practitioner of Eastern medicine and an 88-year-old biologist.

Farrar, Straus & Giroux

Fiction finalist: Same Bed Different Dreams , by Ed Park

An imagined alternate history of Korea that includes assassins, slasher films and the dangers of social media. In a review in The Times, the critic Hamilton Cain called the book “wonderfully suspenseful, like watching a circus performer juggle a dozen torches; will one slip his agile hands?”

Random House

No Right to an Honest Living , by Jacqueline Jones

Jones, a historian and a two-time finalist for the Pulitzer Prize, examines the hypocrisy of Boston before the Civil War. The city was known for its antislavery rhetoric and as the center of abolitionism, but Black residents endured “casual cruelty” in the work force and were condemned to lives of poverty without the chance for equal employment.

Basic Books

History finalist: Continental Reckoning: The American West in the Age of Expansion , by Elliott West

This is an examination of the American West and its physical and cultural transformation in the 19th century. The book covers the 1840s, when the West was home to various Native cultures, and moves through the next three decades, when the area was organized into states and territories and connected by railroads and telegraph wires.

University of Nebraska Press

History finalist: American Anarchy: The Epic Struggle Between Immigrant Radicals and the U.S. Government at the Dawn of the Twentieth Century, by Michael Willrich

This book is a history of the American anarchist movement in the early 20th century. While many working class immigrants saw it as heroic, others considered it a frightening foreign ideology.

King: A Life , by Jonathan Eig

This major study of the civil rights icon draws on a landslide of recently released White House telephone transcripts, F.B.I. documents, letters, oral histories and other material. Eig shows a masterly command of his research, showing King in intimate moments, and arguing that his nonviolence has been mistaken for passivity. Put simply, our critic Dwight Garner wrote, “Eig’s book is worthy of its subject.”

Master Slave Husband Wife: An Epic Journey From Slavery to Freedom , by Ilyon Woo

In 1848, William and Ellen Craft, an enslaved couple, disguised themselves as a sick, wealthy white man traveling with his male slave and headed north. Woo tells the story of their stunning, perilous journey in novelistic detail, tracing their path through the United States and eventual passage to England, where they wrote a popular book about their escape.

Simon & Schuster

Biography finalist: “ Larry McMurtry: A Life ,” by Tracy Daugherty

This is the first comprehensive biography of McMurtry, the Pulitzer Prize-winning author of “Lonesome Dove” and “The Last Picture Show,” among other novels. Daugherty has also written biographies of Joseph Heller and Joan Didion, and his latest “reads a bit like one of McMurtry’s novels,” our critic Dwight Garner wrote in his review. “Elegy and humor bleed into each other.”

St. Martin’s Press

MEMOIR OR AUTOBIOGRAPHY

Liliana’s Invincible Summer: A Sister’s Search for Justice , by Cristina Rivera Garza

In 1990, Rivera Garza’s 20-year-old sister was killed, and the case is a jumping-off point for this searching, personal examination of femicide in Mexico. The book is “one of the most effective resurrections of a murder victim I have ever read,” our reviewer, Katherine Dykstra, wrote. “Rivera Garza draws her sister, then complicates that drawing and then complicates the complication, creating layer upon layer of nuance.”

Memoir finalist: The Country of the Blind: A Memoir at the End of Sight , by Andrew Leland

The author, a longtime editor and podcaster, details his life with retinitis pigmentosa, a disease that is gradually causing him to lose his vision. His writing is “jazzy and intelligent,” our critic Alexandra Jacobs said, “with licks of understated humor.” Yet Leland also “rigorously explores the disability’s most troubling corners,” resulting in an affecting study of vision and its limits.

Penguin Press

Memoir finalist: The Best Minds: A Story of Friendship, Madness, and the Tragedy of Good Intentions , by Jonathan Rosen

In this account of his friendship with Michael Laudor, who came to prominence as a Yale student trying to publicly destigmatize mental illness and later was convicted of stabbing his pregnant girlfriend to death, Rosen offers a look at the boundaries between brilliance and insanity. Our critic Alexandra Jacobs called it “an act of tremendous compassion and a literary triumph.”

GENERAL NONFICTION

A Day in the Life of Abed Salama: Anatomy of a Jerusalem Tragedy , by Nathan Thrall

This book tells the story of a deadly bus crash outside Jerusalem through the eyes of a Palestinian father whose 5-year-old died in the accident. The father’s agony is compounded by the physical and legal restrictions that shape the lives of Palestinians in East Jerusalem. Thrall also examines the political, bureaucratic and personal decisions that contributed to the crash, and “vignettes of individual guilt come up against stark political realities,” our reviewer Rozina Ali wrote.

Metropolitan Books

General nonfiction finalist: Fire Weather: A True Story From a Hotter World , by John Vaillant

In 2016, wildfires tore through Fort McMurray, in the Canadian province of Alberta. Vaillant details how the fire began, how it traveled and the wreckage it left behind, weaving a story of a warming climate, a massive oil reserve and the apocalyptic fallout. The heart of the story, of course, is the fire itself: “Vaillant anthropomorphizes fire,” our reviewer David Enrich wrote. “Not only does it grow and breathe and search for food; it strategizes. It hunts. It lays in wait for months, even years.”

General nonfiction finalist: Cobalt Red: How the Blood of the Congo Powers Our Lives , by Siddharth Kara

Cobalt is an essential mineral used in the lithium-ion rechargeable batteries that power devices from smartphones to electric vehicle. This book, from an academic who has studied modern slavery, examines the horrors of cobalt mining, particularly the hazardous conditions and subsistence pay that workers face.

Tripas: Poems, by Brandon Som

In this collection, Som celebrates his multicultural heritage and family memories, writing about his grandmother, who was Chicana and worked nights on an assembly line at a Motorola factory, and his Chinese American father and grandparents, who ran a corner store.

Georgia Review Books

Poetry finalist: Information Desk: An Epic , by Robyn Schiff

Schiff chronicles her five years working at the Metropolitan Museum of Art’s information desk, where she answered mostly one question. As she writes in “Information Desk,” the “catechism/commences: Where’s the bathroom? / Where’s / the bathroom? Can you direct me to a / men’s room? ” Writing about the book for The Times, Maggie Lange called it “a searing yet reverent book-length poem, containing as many jokes as it does social critiques.”

Penguin Poets

Poetry finalist: To 2040, by Jorie Graham

Graham’s 15th poetry collection is narrated by a speaker looking toward the future while reflecting on her own mortality. The collection begins with questions stated as fact: “Are we / extinct yet. Who owns / the map.”

Copper Canyon Press

  More about Elizabeth A. Harris

Explore More in Books

Want to know about the best books to read and the latest news start here..

The complicated, generous life  of Paul Auster, who died on April 30 , yielded a body of work of staggering scope and variety .

“Real Americans,” a new novel by Rachel Khong , follows three generations of Chinese Americans as they all fight for self-determination in their own way .

“The Chocolate War,” published 50 years ago, became one of the most challenged books in the United States. Its author, Robert Cormier, spent years fighting attempts to ban it .

Joan Didion’s distinctive prose and sharp eye were tuned to an outsider’s frequency, telling us about ourselves in essays that are almost reflexively skeptical. Here are her essential works .

Each week, top authors and critics join the Book Review’s podcast to talk about the latest news in the literary world. Listen here .

• Open access
• Published: 10 November 2023

A scoping review of emotion regulation and inhibition in emotional eating and binge-eating disorder: what about a continuum?

• Mahé Arexis 1 , 2 ,
• Gilles Feron 1 ,
• Marie-Claude Brindisi 1 , 3 ,
• Pierre-Édouard Billot 2 &
• Stéphanie Chambaron 1  

Journal of Eating Disorders volume  11 , Article number:  197 ( 2023 ) Cite this article

2656 Accesses

7 Citations

1 Altmetric

Metrics details

Emotional eating is defined as a nonpathological eating behavior, whereas binge-eating disorder (BED) is defined as a pathological eating behavior. While different, both share some striking similarities, such as deficits in emotion regulation and inhibition. Previous research has suggested the existence of an “eating continuum” that might reflect the increased severity of overeating behaviors, that is, from nonpathological overeating to BED. The main aims of this scoping review were to explore in the literature the idea of a continuum between emotional eating and BED and to observe whether deficits in emotion regulation and inhibition follow this continuum in terms of severity. The other aims were to hopefully clarify the ill-defined concept of overeating, to question the potential role of positive emotions and to identify potential knowledge gaps.

A systematic scoping review was conducted following the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines. Two databases (PubMed/Medline and PsycINFO) were examined in complete accordance with the beforehand sharply defined eligibility and exclusion criteria. The main criteria included adults (≥ 18) with emotional eating, BED or overeating and emotion regulation and inhibition as exposure criteria.

Thirty-two studies were included in this scoping review. If the results showed a link between emotional eating and BED, with the presence of inhibition and emotion regulation deficits in both eating behaviors, no mention of a continuum between emotional eating and BED was found.

In the absence of research directly comparing emotional eating and BED in the same studies and testing the potential increase in severity of emotion regulation and inhibition deficits along this continuum, there is currently no certainty that a continuum exists between emotional eating and BED. In the end, the idea of a continuum in terms of increased severity of overeating and in terms of emotion regulation and inhibition deficits between emotional eating and BED appears to be a gap in knowledge in the literature. This scoping review highlights the need for further research to identify knowledge gaps.

Plain English summary

Emotional eating (EE) is defined as a nonpathological eating behavior, whereas binge-eating disorder (BED) is defined as a pathological eating behavior. While different, both share some striking similarities, such as deficits in emotion regulation (ER) and inhibition. Previous research has suggested the existence of an “eating continuum” that might reflect the increased severity of overeating behaviors, that is, from nonpathological overeating to BED. The main aims of this scoping review were to explore in the literature the idea of a continuum between EE and BED and to observe whether deficits in ER and inhibition follow this continuum in terms of severity. A systematic scoping review was conducted, and thirty-two studies were included in this review. If the results showed a link between EE and BED, with the presence of inhibition and ER deficits in both eating behaviors, no mention of a continuum between EE and BED, or in relation to a continuum, was found. Thus, in the absence of research directly comparing EE and BED in the same studies and testing the potential increase in severity of ER and inhibition deficits along this continuum, there is currently no certainty about the existence or absence of such a continuum.

Introduction

Our scoping review mainly focused on emotional eating (EE) and binge-eating disorder (BED). EE is an eating behavior that can be defined as “the tendency to overeat in response to negative emotions […]” ([ 1 ], p. 106) but in a nonpathological way. It differs from BED, which was formally indexed in 2013 in the DSM-5 as a discrete eating disorder. BED symptoms include recurrent binge-eating episodes (i.e., eating a larger amount of food than most people do during a discrete period of time, with at least one episode per week for three months), “a sense of lack of control over eating during the episode” and “marked distress regarding binge eating”, but without compensatory behaviors as in anorexia nervosa or bulimia nervosa [ 2 ].

Although different, both EE and BED appear to be affected by deficits in emotion regulation (ER) and inhibition [ 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 ]. Indeed, both individuals with EE and BED present with overeating behaviors caused by emotion regulation difficulties and a lack of inhibition/greater impulsivity. For example, it has been shown that negative emotions act as a trigger for binge-eating episodes in BED [ 7 , 11 , 12 ], and some data also suggest that positive emotions may increase food consumption [ 7 ]. Binge eating can be seen as a way to regulate negative emotions (but it is yet uncertain if this strategy successfully improves mood, see Leehr et al. and Stein et al. [ 7 , 13 ]), and BED patients are more prone to use maladaptive strategies such as suppression or rumination [ 4 ].

Davis [ 14 ] suggested the existence of an “(over) eating continuum”: in some way, on one end of the continuum are nonpathological overeating behaviors and at the other end is BED, which is a pathological and extreme state of overeating. The evolution on this continuum, therefore, reflects the “increased severity and compulsiveness” of overeating behaviors. It is also important to emphasize that this idea of a continuum in severity and compulsiveness between those eating behaviors is also reported by clinicians and physicians. It is therefore reasonable to think that the severity of ER and inhibition deficits could increase along this continuum between EE and BED, as shown in Fig.  1 . Taken together, this information is a starting point to lead a systematic screening of the literature. Since our main goals are to clarify the concept of continuum and to identify knowledge gaps, we chose to conduct a scoping review following the guidelines of PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) [ 15 ].

Schematic view of increased emotion regulation and inhibition deficits along a continuum between nonpathological emotional eating and binge-eating disorder (BED)

The present scoping review aimed (1) to address the possible existence of a continuum between EE and BED; (2) to address the possibility of an increase in the severity of deficits in emotion regulation and inhibition; and (3) to address the ill-defined concept of overeating. Indeed, is overeating (OE) a symptom, an eating behavior, a synonymous concept of EE, or a synonym for binge eating? (4) The final aim was to potentially investigate whether positive emotions can, like negative emotions, trigger emotional eating episodes associated with emotion regulation and/or inhibition difficulties. Finally, this scoping review also aimed to identify gaps in knowledge.

The scoping review was conducted following the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines [ 15 ].

The review protocol can be accessed at HAL ( https://hal.science/hal-03643357v1 —HAL Id/Registration number: hal-03643357) [ 16 ].

Eligibility criteria

Studies were selected based on the following criteria:

The PICOS framework was used to highlight the main criteria. PICOS criteria: Populations : People (adult human subjects ≥ 18) with binge-eating disorder (BED) (and meeting the full DSM-IV-TR or DSM-5 criteria for BED) or subthreshold BED and people (adult human subjects, 18 +) presenting with emotional eating (EE) or emotional overeating (EO). Interventions/Exposures : Our review focused on the impact of “emotion regulation” and “inhibitory control” on BED and EE. Comparisons : Our review did not focus on studies with specific comparisons. Outcomes : Our review considered all types of outcomes related to emotion regulation and inhibitory control in BED, EE, and EO ( e.g. , deficit, level of attention, response impairment, and degree of compulsivity). Studies : All types of journal articles published in peer-reviewed scientific journals, either written in English or in French. The exclusion criteria were all types of reviews, book chapters, abstracts, preprints, theses, and articles focusing on therapies/treatments.

Only papers published between January 2009 and January 2022 were eligible for consideration. Although the MeSH (Medical Subject Headings) terms for binge-eating disorder were not introduced until 2010, the year 2009 was chosen because it was a “transition year” between the previous indexing of binge-eating disorder as bulimia nervosa and the introduction of the MeSH term BED in 2010.

Information sources and search

Two electronic bibliographic databases, PubMed/Medline and PsycINFO, were searched to identify references related to the scoping review topic. The search focused on articles published between January 2009 and January 2022. The following search equation was used in both databases: ("Binge-Eating Disorder"[Mesh] OR BED OR Binge eater OR Emotional Eating OR Emotional Overeating OR Overeater OR Emotional eater OR Overeating) AND ("Emotional Regulation"[Mesh] OR Emotion regulation OR Reappraisal OR Rumination OR Attentional deployment OR Mood regulation OR "Inhibition, Psychological"[Mesh] OR Inhibitory control).

This database search stage was conducted by one of the authors, M. A. No additional references were added from other sources at this stage.

Selection of sources of evidence

Duplicates were removed, and all references were imported into Rayyan, an online application for systematic reviews [ 17 ]. Figure  2 shows the flowchart of the literature search and screening/study selection process. During the successive screening stages, at least 2 authors (M. A., and P.-E. B. or S. C., up to 4 authors, M. A., P.-E. B., S. C. and M.-C. B.) screened each record. Disagreements regarding study selection were resolved by a third or even a fourth investigator, and discussions took place between the authors. In the first screening step, for each article, the inclusion criteria described in Sect. " Eligibility criteria " were applied to both titles and abstracts. In the second screening step (eligibility), for each article, the inclusion criteria described in Sect. " Eligibility criteria " were applied to the entire article (i.e., a complete reading of the article). Note that at this stage, we screened the bibliographic references of the included articles to identify potential new references. At the end of this screening, no new articles were included.

Flowchart of the literature search and screening/study selection process

Data charting process and data items

Three investigators (authors M. A., P.-E. B., and S. C.) developed a data charting form to extract the relevant data from each of the 32 included studies. For each study, author M. A. extracted the data according to the following variables of the chart: authors, title, year of publication, country of the study, journal of publication, type of study, method/study design, participants and sample sizes, type of interventions, comparisons, and outcomes/results. Table 1 shows the final version of the chart with the main characteristics of the studies included in the scoping review. We did not include in Table 1 the journal of publication or type of study variables of the chart, as they were deemed irrelevant for this table. Note that we added in Table 1 a new column “Outcomes/Results highlight” with a simplified overview of the results, as well as a “Limitations” column.

Critical analysis

Two authors (M. A. and P.-E. B.) listed the possible limitations of each study. The limitations identified by both authors were retained, and the others were either eliminated or retained after discussion. A third author (S. C.) checked this list, and her comments were considered. The limitations are summarized in the "Limitations" column of Table 1 and are discussed in Sect. " Critical analysis ".

Synthesis of results

Data were analyzed qualitatively. We first grouped the studies by the types of eating behaviors (emotional eating (EE), overeating (OE), and binge-eating disorder (BED)). Then, we addressed each of the topics formulated in our questions/hypotheses.

The source search in the electronic bibliographic databases retrieved 2596 records (2130 on PubMed/Medline and 466 on PsycINFO) (see Fig.  2 ). After removing 301 duplicate records, 2295 records were screened in the first screening step. During this first screening step, for each of the 2295 articles, the inclusion criteria described in the Eligibility criteria section of the Methods section were applied to both titles and abstracts, resulting in 110 records to be assessed for eligibility in the next step. Thus, in the second screening step (eligibility), for each of the 110 articles, the same inclusion criteria were applied to the entire article (i.e., a complete reading of the article). At the end of this second stage, 32 studies were selected to be included in the review. Table 1 shows the main characteristics of the 32 studies included in the scoping review, according to the variables described in Sect. " Data charting process and data items ".

Regarding the types of populations (cf. PICOS criteria), 9 studies out of 32 focused on emotional eating (EE), 21 studies out of 32 focused on binge-eating disorder (BED), and 2 out of 32 focused on overeating (OE). Regarding the types of intervention/exposure (cf. PICOS criteria), namely, ER and inhibition/impulsivity, 19 studies out of 32 focused on emotion regulation (ER), 18 studies out of 32 focused on inhibition/impulsivity, and 5 out of 32 focused on both ER and inhibition/impulsivity. More than a third of the included studies (11 studies out of 32, ≈ 34%) were conducted in Germany. Moreover, more than half of the studies (17 studies out of 32, ≈ 53%) were conducted in Germany or in countries bordering Germany (i.e., France, Switzerland, Belgium and Poland).

Summary of findings

Emotional eating and emotion regulation.

Studies confirm the existence of a link between ER and EE, including the fact that ER difficulties predict EE. For example, Stapleton and Whitehead [ 18 ] highlighted that “Emotion regulation difficulties was the greatest predictor of emotional eating, suggesting that individuals who have difficulty regulating their emotions are more likely to engage in emotional eating behavior”. Similarly, Crockett et al. [ 3 ] concluded that “In every model we tested, difficulties in emotion regulation predicted emotional eating”. Sultson and Akkermann [ 19 ] concluded that "Higher level of ER difficulties among obese and normal weight individuals with EE also lend further support for the assumption that emotion dysregulation might underlie EE". Kornacka et al. [ 20 ] highlighted the “[…] crucial role of ruminative thinking in the occurrence of emotional eating […]”. Regarding avoidance, Deroost and Cserjési [ 21 ] showed “[…] that people with a high degree of EM use avoidance as a primary coping strategy" and added that "avoidance coping also significantly predicted the level of EM” (EM = emotional eating).

Future studies focusing on EE and ER should separately test other specific types of emotional eating (e.g., EE in response to depression, to anxiety…). Indeed, Braden et al. [ 22 ] explained that “exploratory analyses suggest possible unique relationships between types of emotional eating and specific facets of emotion regulation”. The authors added that “[…] findings suggest that certain emotion regulation strategies may be more closely linked to various types of emotional eating”.

Emotional eating and inhibition

The studies included in this scoping review dealing with EE and inhibition/impulsivity confirmed the existence of an association between EE and some inhibition difficulties and impulsivity. For example, Wolz et al. [ 23 ] showed that “[…] emotional eating was not related to general inhibitory control deficits, but was associated with higher behavioral inhibitory control difficulties only while suppressing negative emotions. They added that “[…] the difficulty to inhibit behavioral responses while regulating negative emotions may contribute to disinhibited food intake while experiencing negative emotions”. Stapleton and Whitehead [ 18 ] revealed that emotional eating was related to high impulsivity and that impulsivity was the second greatest predictor of EE after emotion regulation difficulties. Regarding self-control, Wood et al. [ 24 ] showed “[…] an increase in activation across brain regions related to self-control and urges in response to high-calorie food associated with both emotional eating and routine restraint". Taken together, these findings confirm that emotional eaters are prone to inhibition impairments. Moreover, Wolz et al. [ 23 ] suggest that deficits in inhibition only appear when participants are regulating their emotions, highlighting an interesting link between ER and inhibition in EE.

BED and emotion regulation

Concerning BED and emotion regulation, most of the studies confirm the ER difficulties in BED. Leehr et al. [ 25 ] showed that individuals with BED have lower ER capacities. Limited access to ER strategies is also one of the ER difficulties met in BED [ 26 , 27 ], as well as nonacceptance of emotional responses [ 27 ] and lack of emotional clarity [ 26 , 27 ].

BED and inhibition

Overall, studies focusing on BED indicated a deficit in inhibition and increased impulsivity. Leehr et al. [ 25 ] concluded that “Overall, results support the assumption of inhibitory control deficiencies in BED on a behavioral level”. Grant and Chamberlain [ 28 ] underlined that “Binge-eating disorder was associated with impaired response inhibition and executive planning”. Schag et al. [ 29 ] said that “[…] BED represents a neurobehavioural phenotype of obesity that is characterized by increased impulsivity”, and Leehr et al. [ 30 ] showed that “the BED + sample showed higher trait and behavioural impulsivity”. Moreover, according to Aloi et al. [ 31 ], “[…] impaired self-monitoring metacognition and difficulties in impulse control are the central nodes in the psychopathological network of BED […]”.

Overeating and emotion regulation

One of the objectives of this scoping review was to clarify the ill-defined concept of overeating . In the eating disorders literature, overeating sometimes refers to a symptom of an eating disorder or as an eating behavior or is sometimes used as a synonym for emotional eating or binge eating.

Unfortunately, only two of the studies included in this scoping review focused on overeating [ 32 , 33 ], so we could not address this specific question. Nevertheless, similar to EE and BED, those studies highlighted the links between overeating and emotion regulation.

Positive emotions and emotional eating

We questioned the possibility of positive emotions causing emotional eating episodes associated with emotion regulation and/or inhibition difficulties (in the same way as negative emotions). Based on the studies included in our review, opinions differ regarding this point. Indeed, while an article highlights that “[…] positive EE was associated with elevated levels of ER difficulties, suggesting that overeating in response to positive emotions might also include some features of emotion dysregulation” [ 19 ], another article concludes, on the contrary, that “[…] eating in response to positive emotions was not significantly related to poorer psychological well-being, greater eating disorder symptoms, or emotion dysregulation” [ 22 ]. Since there is yet no consensus on the subject, further research on emotional eating needs to be conducted to separately test and dissociate positive and negative emotions.

Positive emotions and BED

We wondered about positive emotions as a possible cause of emotional eating episodes associated with emotion regulation and/or inhibition difficulties. We checked whether the BED studies included in this scoping review addressed the question of positive emotions/affect/mood. Loeber et al. [ 34 ] showed that “[…] restrained eating and mood are factors that moderate response inhibition to food-associated stimuli in obese patients with BED” and that “[…] apart from negative mood, positive mood might as well be a trigger for loss of control over eating behaviour”.

Finally, it is worth mentioning that one study showed that negative and positive mood levels are different during binge days, with an increasing negative mood and a decreasing positive mood at the first binge-eating episode (see Munsch et al. [ 35 ]).

Emotional eating and weight profiles

Studies included in this scoping review tended to show that the relationships between EE and emotion dysregulation (and anxiety, depression, and rumination) might be different according to the weight profile (i.e., normal weight, overweight, and with moderate or severe obesity) (see, for example, Willem et al. [ 36 ] or Kornacka et al. [ 20 ]). Willem et al. [ 36 ] highlighted that “emotion dysregulation, anxiety and depression have different impacts on emotional eating (EE) depending on obesity severity", while Kornacka et al. [ 20 ] underlined that “the role of emotional eating in the link between rumination and uncontrolled eating is different in overweight vs. healthy individuals”.

Emotional eating, BED and rumination

According to three of the studies included in this scoping review, rumination, a maladaptive emotion regulation strategy, is encountered in both EE and BED. Indeed, in EE, Kornacka et al. [ 20 ] highlight that rumination is a predictor of EE (“[…] the results of the two studies confirm the crucial role of ruminative thinking in the occurrence of emotional eating […]”. Similarly, people with BED are more inclined than healthy people to use rumination as a negative emotion regulation strategy [ 27 ]. Wang et al. [ 37 ] also highlighted that “[…] rumination is an important cognitive process associated with severity of eating-disorder psychopathology”.

The idea of a possible continuum

We hypothesized that there would be a continuum between EE (nonpathological eating behavior) and BED (pathological eating behavior). Three studies focusing on BED mentioned this idea of a continuum in the severity of eating disorders. Leehr et al. [ 25 ] stated that “From a clinical perspective eating behavior of the three groups can be seen on a continuum from normal eating behavior, to overeating, to binge eating”. Mobbs et al. [ 38 ] highlighted that “[…] these cognitive deficits are more severe in obese patients with binge eating disorder, which indicates that there is a continuum of increasing inhibition and cognitive problems with increasingly disordered eating”. Moreover, Svaldi et al. [ 39 ] underlined that “[…] the magnitude of the inhibitory deficit was found to be related to the reported severity of eating pathology”, which is compatible with the idea of a continuum.

However, none of the reviewed studies directly compared EE to BED regarding ER or inhibition performances, neither in a longitudinal nor cross-sectional design. Thus, a gap can clearly be identified in this specific field since there is a complete lack of experimental data about an increased severity in ER and inhibition deficit between EE and BED.

We identified some limitations between studies, and some of them were quite redundant in our corpus. First, half of the included studies recorded only self-reported data using scales, questionnaires, or interviews. These declarative measures often suffer from memory bias or social desirability concerns [ 40 ]. Moreover, these measures are often carried out for a particular purpose, and this purpose may differ from study to study, depending on the research question being asked [ 40 ]. Strikingly, 88.9% of papers addressing ER gathered only self-report measures (but only 11.8% for inhibition). Thus, there is a lack of experimental data to address the issue of ER in BED and EE.

Second, 43.8% of the articles with self-report measures only appeared to have rather small sample sizes and/or unbalanced groups and were therefore underpowered. Sample size is a critical issue for quantitative analysis. This sample size must be large enough to achieve the appropriate level of measurement precision. [ 41 ].

Third, most of the participants enrolled in these studies were women, compromising the generalizability to the global population (81.3% of studies had only women participants or an unbalanced sex ratio toward women). Eating disorders are more frequent among women, and for BED, the ratio varies between 1:2 and 1:6 [ 42 ]. Thus, while the lack of men in BED studies is understandable, future studies should consider recruiting more men to properly balance the experimental groups.

Finally, a recurring limitation emphasized by many authors of the included studies is that their research was cross-sectional. Indeed, given the short duration of these types of studies, it was impossible to reveal some causal links between different phenomena (e.g., between BED and impulsivity). However, in our opinion, this is not a limitation per se, as cross-sectional and longitudinal studies are two very different types of research. Therefore, we did not report this limitation in Table 1 .

The main objectives of this scoping review were to explore the idea of a continuum between EE and BED as well as explore the idea of a gradation in emotion regulation and inhibition deficits along this continuum. This hypothesis is supported by some authors and is widely discussed in Davis [ 14 ]. He developed the concept of an “eating continuum”, ranging from homeostatic eating (energy balance) to food addiction, with different levels of “overeating”, including BED-like symptoms and diagnosed BED. It should also be noted that this idea of a continuum is shared by many physicians in their daily clinical practice and that this idea needs to be verified.

The most striking result of our scoping review is that there are strong similarities between EE and BED, with emotional eaters and BED patients sharing the same difficulties in emotion regulation and inhibition. Some of the included studies seem to be compatible with the idea of a gradation of ER and inhibition deficits following this continuum. For instance, Mobbs et al.’s [ 38 ] conclusions strengthened the idea of a continuum of inhibition impairment, with BED patients living with obesity having more difficulties inhibiting their responses compared to controls living with obesity. Indeed, the authors concluded that “[…] these cognitive deficits are more severe in obese patients with binge eating disorder, which indicates that there is a continuum of increasing inhibition and cognitive problems with increasingly disordered eating”. Concerning EE, the results of Sultson and Akkermann [ 19 ] showed that participants with EE have more binge eating behaviors than participants without EE but do not meet all the DSM-5 criteria to be diagnosed with BED. These results suggest that EE could lead to BED and thus support the idea of a continuum. It is, however, crucial to remember that none of the articles included in this review directly compared EE and BED in the same study, neither in a longitudinal nor cross-sectional design. To ascertain the existence of a continuum between EE and BED, the increased severity of ER and inhibition deficits between EE and BED still need to be proven. One of the main goals of this scoping review was also to identify knowledge gaps, and indeed, we found a gap in the literature regarding the increased severity in ER and inhibition impairments from EE to BED. Such a lack of experimental work is truly surprising given the feelings shared by many caregivers in the field of eating disorders as well as the thoughts shared by some authors [ 14 , 25 , 38 , 39 ].

Among the thirty-two articles reviewed, only one focused on the relationship between ER and inhibition in EE. Indeed, Wolz et al. [ 23 ] showed that EE was associated with higher behavioral inhibitory control difficulties only while participants were suppressing negative emotions. This outcome should be taken into account in further studies, since ER and inhibition deficits are often studied separately [ 7 , 43 , 44 ]. Indeed, the direct relationship between ER and inhibition remains poorly studied in BED, as well as in EE, but is an important question to explore the idea of a continuum.

The third objective of this scoping review was to address the ill-defined concept of overeating. Unfortunately, only two studies focused on overeating [ 32 , 33 ], and it is thus difficult to clearly define this concept. For both authors, overeating is not an eating disorder per se since participants were healthy volunteers with no prior diagnosis of an eating disorder. However, in both studies, overeating is measured with questionnaires widely used in medical contexts to assess eating disorders, such as the Eating Disorder Examination-Questionnaire (EDE-Q) or the Binge Eating Scale (BES). Thus, overeating may be seen as pathological eating. Moreover, Racine and Horvath [ 33 ] used the Eating Disorder Diagnostic Scale and the Questionnaire on Eating and Weight Patterns-5 (QEWP-5) to determine experimental groups. Women included in the “overeating” group reported consuming an “unusually large amount of food unaccompanied by loss of control over the past 3 months” on both questionnaires. Thus, this inclusion criterion could be a suitable definition of the concept of overeating, but it must be emphasized that there is too little information to properly define this concept.

The fourth aim of this review was to determine whether positive emotions could trigger emotional eating or binge eating episodes associated with emotion regulation and/or inhibition difficulties. Most of the studies only measured EE and binge eating episodes in response to negative emotions. However, few articles specifically focused on positive mood or emotions. Due to a lack of consensus among studies, it was impossible to strongly conclude that positive emotions can affect eating behaviors. Indeed, some data support this idea [ 19 , 34 ], and others are less affirmative [ 22 , 35 ].

Last, concerning the weight profile, it was not one of the aims of this scoping review, but our results showed that emotion regulation deficits were more severe in obese participants than in normal weight or overweight volunteers. Thus, the weight profile seems to be an important parameter when addressing the question of an increased severity in ER deficits between EE and BED.

Limitations

This scoping review presents some limitations. First, regarding the selection phase, not all relevant studies may have been indexed in the two searched databases (PsycINFO and PubMed/Medline). Second, the examination was based on a list of terms describing emotional eating, binge-eating disorder, emotion regulation and inhibition. The possibility that additional articles would have been identified by adding other terms cannot be completely excluded, although the search was intended to be as extensive as possible. Third, a possible limitation of our scoping review is that we did not mention explicitly in our search equation the terms “positive emotions”. Indeed, given that one of our questions was about the possibility that positive emotions can, like negative emotions, trigger emotional eating episodes, we could have perhaps included it in our search equation. Nevertheless, given that we used the inclusive terms “Emotional Regulation”[Mesh]” and “Emotion regulation”, it is likely that we did not miss some interesting records focusing on positive emotions. Finally, in this review, only studies in French or English were included, which did not allow us to be exhaustive in our conclusions.

Conclusion and further directions

In conclusion, this scoping review fully confirmed the presence of inhibition and emotion regulation deficits in both EE and BED, showing strong similarities between these two eating behaviors. However, the lack of experimental data coming from direct comparisons between EE and BED did not make it possible either to confirm the existence or the absence of a possible continuum between EE and BED or an increased severity in ER and inhibition deficits between EE and BED. Thus, this scoping review helped to identify a knowledge gap, and the question of the existence of a continuum still needs to be addressed in further research.

If such a continuum exists, we think it could greatly impact the clinical care of eating disorders. Indeed, if EE can become BED, early care of emotional eaters becomes essential, and early diagnoses could be made. Additionally, prevention could be improved in emotional eaters and even in the general population to avoid progression to an eating disorder (i.e., subthreshold BED and BED) and could also reduce the risk of developing obesity and its comorbidities often associated with BED. Given the variety of symptoms (psychological and physical), monitoring of emotional eaters could be performed by a multidisciplinary medical team, especially for children and adolescents.

The existence of a continuum between EE and BED could also have implications for eating disorder research. In our view, this could lead to further research to develop more specific screening instruments, such as scales and questionnaires. Such instruments might indeed be helpful to classify emotional eater participants into more relevant experimental groups that take into account the severity of EE. To go even further, one could imagine a new scale that would assess the level of eating behaviors across the entire continuum. Moreover, regarding data analysis, data could be analyzed in a discrete way in addition to group comparisons between EE and BED. Last, if such a continuum was verified, it could guide the focus on future research, especially studies on the etiology of BED, and help to better define the concept of “emotional overeating”.

Moreover, to test the idea of a continuum from a different angle, it could be interesting to see if there is an evolution of some other markers between EE and BED, such as biomarkers. Some of them are well known in BED but remain rather poorly studied in EE. Several fMRI studies have shown that brain activation patterns are different in BED patients, especially in the reward system, which explains why this eating disorder is often associated with food addiction [ 14 ]. For example, the ventral striatum and the medial prefrontal cortex seem to be underactivated during a rewarding task. Moreover, the ventral putamen, orbitofrontal cortex, amygdala, and insula respond less in BED patients than in controls [ 8 ]. EEG studies have also provided a valuable understanding of neurophysiological markers. In their narrative review, Berchio et al. [ 45 ] found that behavioral traits of BED and bulimia nervosa, such as loss of control over eating and emotional eating, are associated with an increased attentional reactivity (P300 wave) to visual food stimuli. Finally, animal studies allow us to better understand the functioning of some molecules. For example, the role of dopamine, oxytocin, and opiate in eating disorders is well understood [ 46 ], and this could be an interesting focus to measure the gradation between EE and BED.

Availability of data and materials

Two electronic bibliographic databases, PubMed/Medline and PsycINFO, were searched to identify references related to the scoping review topic. The search focused on articles published between January 2009 and January 2022. Original records (before screening) can be found using the search equation that was used in both databases: ("Binge-Eating Disorder"[Mesh] OR BED OR Binge eater OR Emotional Eating OR Emotional Overeating OR Overeater OR Emotional eater OR Overeating) AND ("Emotional Regulation"[Mesh] OR Emotion regulation OR Reappraisal OR Rumination OR Attentional deployment OR Mood regulation OR "Inhibition, Psychological"[Mesh] OR Inhibitory control). The 32 articles included after the screening steps are listed in the References section.

Abbreviations

• Emotional eating
• Binge-eating disorder
• Emotion regulation

Preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews

Populations, interventions, comparisons, outcomes, studies

Diagnostic and statistical manual of mental disorders Text Revision, or 5th edition

Electroencephalography

Magnetoencephalography

Normal weight controls

Food stroop task

Body mass index

Barratt impulsiveness scale

Ecological momentary assessment

Bulimia nervosa

Healthy controls

Eating disorders

Difficulties in emotion regulation scale

People living with BED (or subthreshold BED, depending on the studies)

People living without BED (or subthreshold BED, depending on the studies)

Loss of control

Objective binge episode

Late positive potential

Stop signal task

Stop signal reaction time

Functional magnetic resonance imaging

Healthy volunteers

Go-trial reaction time

Normal-weight people living with BED

Overweight people living with BED

Executive functioning

Non-BED obese individuals

Lean comparison

Ventromedial prefrontal cortex

Inferior frontal gyrus

Anorexia nervosa-restricting type

Anorexia nervosa–binge/purge type

Eating disorder, not otherwise specified

Emotional eating/eaters (depending on the studies)

Exogenous cueing task

Network analysis

Emotional overeating

Medical subject headings

Emotional eating (used in some of the included articles)

Eating disorder examination-questionnaire (EDE-Q)

Binge eating scale

Eating disorder diagnostic scale and the questionnaire on eating and weight patterns-5

van Strien T, van de Laar FA, van Leeuwe JFJ, Lucassen PLBJ, van den Hoogen HJM, Rutten GEHM, et al. The dieting dilemma in patients with newly diagnosed type 2 diabetes: does dietary restraint predict weight gain 4 years after diagnosis? Health Psychol. 2007;26(1):105–12.

Article   PubMed   Google Scholar  

American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Washington: American psychiatric association; 2013.

Book   Google Scholar  

Crockett AC, Myhre SK, Rokke PD. Boredom proneness and emotion regulation predict emotional eating. J Health Psychol. 2015;20(5):670–80.

Dingemans A, Danner U, Parks M. Emotion regulation in binge eating disorder: a review. Nutrients. 2017;9(11):1274.

Article   PubMed   PubMed Central   Google Scholar  

Ferrell EL, Watford TS, Braden A. Emotion regulation difficulties and impaired working memory interact to predict boredom emotional eating. Appetite. 2020;144:104450.

Giel KE, Teufel M, Junne F, Zipfel S, Schag K. Food-related impulsivity in obesity and binge eating disorder-a systematic update of the evidence. Nutrients. 2017;9(11):1170.

Leehr EJ, Krohmer K, Schag K, Dresler T, Zipfel S, Giel KE. Emotion regulation model in binge eating disorder and obesity–a systematic review. Neurosci Biobehav Rev. 2015;49:125–34.

Steward T, Menchon JM, Jiménez-Murcia S, Soriano-Mas C, Fernandez-Aranda F. Neural network alterations across eating disorders: a narrative review of fMRI studies. Curr Neuropharmacol. 2018;16(8):1150–63.

Waltmann M, Herzog N, Horstmann A, Deserno L. Loss of control over eating: a systematic review of task based research into impulsive and compulsive processes in binge eating. Neurosci Biobehav Rev. 2021;129:330–50.

Zhang P, Wu GW, Yu FX, Liu Y, Li MY, Wang Z, et al. Abnormal regional neural activity and reorganized neural network in obesity: evidence from resting-state fMRI. Obes Silver Spring Md. 2020;28(7):1283–91.

Article   Google Scholar  

Greeno CG, Wing RR, Shiffman S. Binge antecedents in obese women with and without binge eating disorder. J Consult Clin Psychol. 2000;68(1):95–102.

Nicholls W, Devonport TJ, Blake M. The association between emotions and eating behaviour in an obese population with binge eating disorder: emotions and binge eating disorder. Obes Rev. 2016;17(1):30–42.

Stein RI, Kenardy J, Wiseman CV, Dounchis JZ, Arnow BA, Wilfley DE. What’s driving the binge in binge eating disorder?: a prospective examination of precursors and consequences. Int J Eat Disord. 2007;40(3):195–203.

Davis C. From passive overeating to « food addiction »: a spectrum of compulsion and severity. ISRN Obes. 2013;2013:435027.

PubMed   PubMed Central   Google Scholar  

Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.

Arexis M, Feron G, Brindisi MC, Billot PE, Chambaron S. Impacts of emotional regulation and inhibition on Emotional Eating (EE) and Binge Eating Disorder (BED): Protocol for a scoping review. Hal-03643357. 2022.

Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.

Stapleton P, Whitehead M. Dysfunctional eating in an Australian community sample: the role of emotion regulation, impulsivity, and reward and punishment sensitivity. Aust Psychol. 2014;49(6):358–68.

Sultson H, Akkermann K. Investigating phenotypes of emotional eating based on weight categories: a latent profile analysis. Int J Eat Disord. 2019;52(9):1024–34.

Kornacka M, Czepczor-Bernat K, Napieralski P, Brytek-Matera A. Rumination, mood, and maladaptive eating behaviors in overweight and healthy populations. Eat Weight Disord EWD. 2021;26(1):273–85.

Deroost N, Cserjési R. Attentional avoidance of emotional information in emotional eating. Psychiatry Res. 2018;269:172–7.

Braden A, Musher-Eizenman D, Watford T, Emley E. Eating when depressed, anxious, bored, or happy: are emotional eating types associated with unique psychological and physical health correlates? Appetite. 2018;125:410–7.

Wolz I, Biehl S, Svaldi J. Emotional reactivity, suppression of emotions and response inhibition in emotional eaters: a multi-method pilot study. Appetite. 2021;161:105142.

Wood SMW, Schembre SM, He Q, Engelmann JM, Ames SL, Bechara A. Emotional eating and routine restraint scores are associated with activity in brain regions involved in urge and self-control. Physiol Behav. 2016;165:405–12.

Leehr EJ, Schag K, Dresler T, Grosse-Wentrup M, Hautzinger M, Fallgatter AJ, et al. Food specific inhibitory control under negative mood in binge-eating disorder: evidence from a multimethod approach. Int J Eat Disord. 2018;51(2):112–23.

Gianini LM, White MA, Masheb RM. Eating pathology, emotion regulation, and emotional overeating in obese adults with Binge Eating Disorder. Eat Behav. 2013;14(3):309–13.

Walenda A, Kostecka B, Santangelo PS, Kucharska K. Examining emotion regulation in binge-eating disorder. Borderline Personal Disord Emot Dysregulation. 2021;8(1):25.

Grant JE, Chamberlain SR. Neurocognitive findings in young adults with binge eating disorder. Int J Psychiatry Clin Pract. 2020;24(1):71–6.

Schag K, Teufel M, Junne F, Preissl H, Hautzinger M, Zipfel S, et al. Impulsivity in binge eating disorder: food cues elicit increased reward responses and disinhibition. PLoS ONE. 2013;8(10):e76542.

Leehr EJ, Schag K, Brückmann C, Plewnia C, Zipfel S, Nieratschker V, et al. A putative association of COMT Val(108/158)met with impulsivity in binge eating disorder. Eur Eat Disord Rev J Eat Disord Assoc. 2016;24(2):169–73.

Aloi M, Rania M, Carbone EA, Caroleo M, Calabrò G, Zaffino P, et al. Metacognition and emotion regulation as treatment targets in binge eating disorder: a network analysis study. J Eat Disord. 2021;9(1):22.

Görlach MG, Kohlmann S, Shedden-Mora M, Rief W, Westermann S. Expressive suppression of emotions and overeating in individuals with overweight and obesity. Eur Eat Disord Rev J Eat Disord Assoc. 2016;24(5):377–82.

Racine SE, Horvath SA. Emotion dysregulation across the spectrum of pathological eating: comparisons among women with binge eating, overeating, and loss of control eating. Eat Disord. 2018;26(1):13–25.

Loeber S, Rustemeier M, Paslakis G, Pietrowsky R, Müller A, Herpertz S. Mood and restrained eating moderate food-associated response inhibition in obese individuals with binge eating disorder. Psychiatry Res. 2018;264:346–53.

Munsch S, Meyer AH, Quartier V, Wilhelm FH. Binge eating in binge eating disorder: a breakdown of emotion regulatory process? Psychiatry Res. 2012;195(3):118–24.

Willem C, Gandolphe MC, Doba K, Roussel M, Verkindt H, Pattou F, et al. Eating in case of emotion dys-regulation, depression and anxiety: different pathways to emotional eating in moderate and severe obesity. Clin Obes. 2020;10(5):e12388.

Wang SB, Lydecker JA, Grilo CM. Rumination in patients with binge-eating disorder and obesity: associations with eating-disorder psychopathology and weight-bias internalization. Eur Eat Disord Rev J Eat Disord Assoc. 2017;25(2):98–103.

Mobbs O, Iglesias K, Golay A, Van der Linden M. Cognitive deficits in obese persons with and without binge eating disorder. Investigation using a mental flexibility task. Appetite. 2011;57(1):263–71.

Svaldi J, Naumann E, Trentowska M, Schmitz F. General and food-specific inhibitory deficits in binge eating disorder. Int J Eat Disord. 2014;47(5):534–42.

Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health-Syst Pharm AJHP Off J Am Soc Health-Syst Pharm. 2008;65(23):2276–84.

Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD. Mayo/FDA patient-reported outcomes consensus meeting group; What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2007;10(Suppl 2):S94-105.

Raevuori A, Keski-Rahkonen A, Hoek HW. A review of eating disorders in males. Curr Opin Psychiatry. 2014;27(6):426–30.

Carr MM, Wiedemann AA, Macdonald-Gagnon G, Potenza MN. Impulsivity and compulsivity in binge eating disorder: a systematic review of behavioral studies. Prog Neuropsychopharmacol Biol Psychiatry. 2021;12:110318.

Saruco E, Pleger B. a systematic review of obesity and binge eating associated impairment of the cognitive inhibition system. Front Nutr. 2021;8:609012.

Berchio C, Cambi S, Pappaianni E, Micali N. EEG biomarkers in children and adolescents with feeding and eating disorders: current evidence and future directions. Front Psychiatry. 2022;13:882358.

Turton R, Chami R, Treasure J. Emotional eating, binge eating and animal models of binge-type eating disorders. Curr Obes Rep. 2017;6(2):217–28.

Download references

Acknowledgements

Not applicable.

This scoping review was supported by grants from the French National Research Agency [Agence Nationale de la Recherche (ANR): ImplicEAT project ANR-17-CE21-0001].

Author information

Authors and affiliations.

Centre Des Sciences du Goût Et de L’Alimentation, CNRS, INRAE, Institut Agro, Université de Bourgogne, 21000, Dijon, France

Mahé Arexis, Gilles Feron, Marie-Claude Brindisi & Stéphanie Chambaron

Université de Franche-Comté, LINC, 25000, Besançon, France

Mahé Arexis & Pierre-Édouard Billot

Centre Spécialisé de L’Obésité Bourgogne, Centre Hospitalier Universitaire Dijon Bourgogne, Dijon, France

Marie-Claude Brindisi

You can also search for this author in PubMed   Google Scholar

Contributions

All authors participated in the conception of the study. Three investigators (authors MA, P-EB, and SC) developed a data charting form to extract the relevant data from each of the 32 included studies. For each study, author MA extracted the data according to the following variables of the chart: authors, title, year of publication, country of the study, journal of publication, type of study, method/study design, participants and sample sizes, type of interventions, comparisons, and outcomes/results. Two authors (MA and P-EB) listed the possible limitations of each study. The limitations identified by both authors were retained, and the others were either eliminated or retained after discussion. Two authors (SC and M-CB) checked this list, and their comments were considered. MA wrote the first draft of the article and MA, P-EB, SC and M-CB contributed to the final version. All authors proofread the final version.

Corresponding author

Correspondence to Pierre-Édouard Billot .

Ethics declarations

Ethics approval and consent to participate.

This scoping review did not involve animals or human participants, and we did not use personal information. All data used in this review were extracted from published articles.

Consent for publication

This scoping review did not involve human participants, and we did not use personal information. Thus, consent for publication was unnecessary for this scoping review.

Competing interests

The authors declare that they have no competing interests.

The review protocol can be accessed at HAL ( https://hal.science/hal-03643357v1 —HAL Id/Registration number: hal-03643357). Protocol reference: Arexis, M., Feron, G., Brindisi, M.-C., Billot, P.-E., & Chambaron, S. (2022). Impacts of emotional regulation and inhibition on Emotional Eating (EE) and Binge Eating Disorder (BED): Protocol for a scoping review. Hal-03643357 .

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Arexis, M., Feron, G., Brindisi, MC. et al. A scoping review of emotion regulation and inhibition in emotional eating and binge-eating disorder: what about a continuum?. J Eat Disord 11 , 197 (2023). https://doi.org/10.1186/s40337-023-00916-7

Download citation

Received : 24 February 2023

Accepted : 18 October 2023

Published : 10 November 2023

DOI : https://doi.org/10.1186/s40337-023-00916-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Scoping review

Journal of Eating Disorders

ISSN: 2050-2974

• General enquiries: [email protected]

Deep learning based active image steganalysis: a review

• REVIEW PAPERS
• Published: 27 November 2023
• Volume 15 , pages 786–799, ( 2024 )

Cite this article

• Punam Bedi 1 ,
• Anuradha Singhal   ORCID: orcid.org/0000-0002-0818-6597 1 &
• Veenu Bhasin 1  

224 Accesses

Explore all metrics

Steganalysis plays a vital role in cybersecurity in today’s digital era where exchange of malicious information can be done easily across web pages. Steganography techniques are used to hide data in an object where the existence of hidden information is also obscured. Steganalysis is the process for detection of steganography within an object and can be categorized as active and passive steganalysis. Passive steganalysis tries to classify a given object as a clean or modified object. Active steganalysis aims to extract more details about hidden contents such as length of embedded message, region of inserted message, key used for embedding, required by cybersecurity experts for comprehensive analysis. Images being a viable source of exchange of information in the era of internet, social media are the most susceptible source for such transmission. Many researchers have worked and developed techniques required to detect and alert about such counterfeit exchanges over the internet. Literature present in passive and active image steganalysis techniques, addresses these issues by detecting and unveiling details of such obscured communication respectively. This paper provides a systematic and comprehensive review of work done on active image steganalysis techniques using deep learning techniques. This review will be helpful to the new researchers to become aware and build a strong foundation of literature present in active image steganalysis using deep learning techniques. The paper also includes various steganographic algorithms, dataset and performance evaluation metrics used in literature. Open research challenges and possible future research directions are also discussed in the paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Deepfakes generation and detection: state-of-the-art, open challenges, countermeasures, and way forward

Deepfakes: current and future trends

A comprehensive survey of AI-enabled phishing attacks detection techniques

Data availability.

Not Applicable.

Ambalavanan A and Chandramouli R (2006) A Bayesian image steganalysis approach to estimate the embedded secret message. In: proceedings of the 7th multimedia and security workshop 2005, MM and Sec’05, vol 2006, pp 33–38. doi: https://doi.org/10.1145/1073170.1073177

Bagnall RJ (2002) Reversing the steganography myth in terrorist operations: the asymmetrical threat of simple intelligence dissemination techniques using common tools. Sans Inf Secur Read Room 19:1–16

Google Scholar  

Bas P, Filler T, Pevný T (2011) Break our steganographic system: the ins and outs of organizing BOSS. In: lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 6958 LNCS, pp 59–70. doi: https://doi.org/10.1007/978-3-642-24178-9_5

Bedi P, Singhal A (2022) Estimating cover image for Universal payload region detection in Stego Images. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/J.JKSUCI.2022.01.010

Article   Google Scholar  

Bengio Y, Louradour J, Collobert R, and Weston J (2009) Curriculum learning. In: proceedings of the 26th annual international conference on machine learning. vol 382, pp 41–48. doi: https://doi.org/10.1145/1553374.1553380

Bhatt C, Kumar I, Vijayakumar V, Singh KU, Kumar A (2021) The state of the art of deep learning models in medical science and their challenges. Multimed Syst 27(4):599–613. https://doi.org/10.1007/S00530-020-00694-1/FIGURES/10

Boroumand M, Chen M, Fridrich J (2018) Deep residual network for steganalysis of digital images. IEEE Trans Inf Forensics Secur 14(5):1181–1193. https://doi.org/10.1109/TIFS.2018.2871749

Chaumont M (2020) Deep learning in steganography and steganalysis. Digital media steganography: principles, algorithms, and advances. Elsevier, New York, pp 321–349. https://doi.org/10.1016/B978-0-12-819438-6.00022-0

Chapter   Google Scholar  

Chen C and Shi YQ (2008) JPEG image steganalysis utilizing both intrablock and interblock correlations. In: proceedings-IEEE international symposium on circuits and systems , pp 3029–3032. doi: https://doi.org/10.1109/ISCAS.2008.4542096

Chen M, Sedighi V, Boroumand M, and Fridrich J (2017) JPEG-phase-aware convolutional neural network for steganalysis of JPEG images. In: IH and MMSec 2017-proceedings of the 2017 ACM workshop on information hiding and multimedia security , pp 75–84. doi: https://doi.org/10.1145/3082031.3083248 .

Chen M, Boroumand M, and Fridrich J (2018) Deep learning regressors for quantitative steganalysis. In: is and t international symposium on electronic imaging science and technology, pp 160–167. doi: https://doi.org/10.2352/ISSN.2470-1173.2018.07.MWSF-160

Chutani S, Goyal A (2018) Improved universal quantitative steganalysis in spatial domain using ELM ensemble. Multimed Tools Appl 77(6):7447–7468. https://doi.org/10.1007/S11042-017-4656-3/FIGURES/7

Clark E (2019) GE Engineer Charged in Elaborate Theft of Trade Secrets. https://blog.twinstate.com/news/ge-trade-secrets-theft (Accessed Jan. 20, 2022)

Farooq N, Selwal A (2023) Image steganalysis using deep learning: a systematic review and open research challenges. J Ambient Intell Humaniz Comput 14(6):7761–7793. https://doi.org/10.1007/S12652-023-04591-Z

Fridrich J, Goljan M (2004) On estimation of secret message length in LSB steganography in spatial domain. Steganography Watermarking Multimedia Contents 5306:23. https://doi.org/10.1117/12.521350

Article   ADS   Google Scholar  

Fridrich J, Kodovsky J (2012) Rich models for steganalysis of digital images. IEEE Trans Inf Forensics Secur 7(3):868–882. https://doi.org/10.1109/TIFS.2012.2190402

Fridrich J, Goljan M, Du R (2001) Steganalysis based on JPEG compatibility. Multimed Syst Appl IV 4518:275–280. https://doi.org/10.1117/12.448213

Fridrich J, Goljan M, Soukal D, Holotyak T (2005) Forensic steganalysis: determining the stego key in spatial domain steganography. Steganography Watermarking of Multimedia Contents 5681:631. https://doi.org/10.1117/12.585987

Fridrich J, Goljan M, and Soukal D (2004) Searching for the stego-key. In: security, steganography, and watermarking of multimedia contents VI, vol 5306, p. 70. doi: https://doi.org/10.1117/12.521353

Goodfellow I, Bengio Y, and Courville A (2016) Deep learning . MIT Press

Guan Q, Dong J, and Tan T, Blind Quantitative steganalysis based on feature fusion and gradient boosting. In: lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 2010, vol 6526 LNCS, pp 266–279. doi: https://doi.org/10.1007/978-3-642-18405-5_22

Gui X, Li X, and Yang B (2012) Improved payload location for LSB matching steganography. In: proceedings-international conference on image processing, ICIP, pp 1125–1128. doi: https://doi.org/10.1109/ICIP.2012.6467062

Gul G, Kurugollu F (2010) Svd-based universal spatial domain image steganalysis. IEEE Trans Inf Forensics Secur 5(2):349–353. https://doi.org/10.1109/TIFS.2010.2041826

Hu J, Shen L, and Sun G (2018) Squeeze-and-excitation networks. In: proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

Hussain I, Zeng J, Xinhong X, Tan S (2020) A survey on deep convolutional neural networks for image steganography and steganalysis. KSII Trans Int Inf Syst 14(3):1228–1248. https://doi.org/10.3837/TIIS.2020.03.017

Ker AD (2008) Locating Steganographic Payload via WS Residuals. In: proceedings of the 10th ACM workshop on multimedia and security, pp 27–32

Ker AD and Lubenko (2009) Feature reduction and payload location with WAM steganalysis. In: media forensics and security, international society for optics and photonics, p 72540A

Ker AD, Böhme R (2008) Revisiting weighted stego-image steganalysis. Forensics Steganography Watermarking Multimedia Contents 6819:681905. https://doi.org/10.1117/12.766820

Kodovský J, Fridrich J, Holub V (2012) Ensemble classifiers for steganalysis of digital media. IEEE Trans Inf Forensics Secur 7(2):432–444. https://doi.org/10.1109/TIFS.2011.2175919

Kodovský J and Fridrich J (2010) Quantitative steganalysis of LSB embedding in JPEG domain. In: MM and sec’10-proceedings of the 2010 ACM SIGMM multimedia and security workshop, pp 187–197. doi: https://doi.org/10.1145/1854229.1854265

Kodovský J andx Fridrich J (2013) Quantitative steganalysis using rich models. In: media watermarking, security, and forensics, vol 8665: 86650. doi: https://doi.org/10.1117/12.2001563

Kodovsky J, Fridrich J (2010) Quantitative structural steganalysis of Jsteg. IEEE Trans Inf Forensics Secur 5(4):681–693. https://doi.org/10.1109/TIFS.2010.2056684

Kong XW, Liu WF, and You XG (2005) Secret message location steganalysis based on local coherences of hue. In: lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 3768 LNCS, pp 301–311. doi: https://doi.org/10.1007/11582267_27

Kumar V, Sharma S, Kumar C, Vishwa A, Sahu AK (2023) Latest trends in deep learning techniques for image steganography. Int J Digit Crime Forensics 15(1):1–14. https://doi.org/10.4018/IJDCF.318666

Lie WN, Lin GS (2005) A feature-based classification technique for blind image steganalysis. IEEE Trans Multimed 7(6):1007–1020. https://doi.org/10.1109/TMM.2005.858377

Liu J, Tang G (2012) Stego key estimation in LSB steganography. J Multimed 7(4):309. https://doi.org/10.4304/jmm.7.4.277-278

Liu J, Tian Y, Han T, Yang C, Liu W (2015) LSB steganographic payload location for JPEG-decompressed images. Digit Signal Process 38:66–76. https://doi.org/10.1016/j.dsp.2014.12.004

Article   CAS   Google Scholar  

Liu J, Tian Y, Han T, Wang J, Luo X (2016) Stego key searching for LSB steganography on JPEG decompressed image. Sci China Inf Sci 59(3):1–15. https://doi.org/10.1007/S11432-015-5367-X

Liu J, Yang C, Wang J, Shi Y (2020) Stego key recovery method for F5 steganography with matrix encoding. Eurasip J Image Video Process 2020(1):1–17. https://doi.org/10.1186/S13640-020-00526-2

Article   ADS   CAS   Google Scholar  

Lou DC, Chou CL, Tso HK, Chiu CC (2012) Active steganalysis for histogram-shifting based reversible data hiding. Opt Commun 285(10–11):2510–2518. https://doi.org/10.1016/j.optcom.2012.01.021

Lu J, Yang C, Liu F, Luo X (2018) Quantitative steganalysis of JPEG additive steganography based on boundary effect. J Electron Imaging 27(02):1. https://doi.org/10.1117/1.jei.27.2.023004

Lyu S, Farid H (2006) Steganalysis using higher-order image statistics. IEEE Trans Inf Forensics Secur 1(1):111–119. https://doi.org/10.1109/TIFS.2005.863485

Malhotra R, Singh P (2023) Recent advances in deep learning models: a systematic literature review. Multimed Tools Appl 2023:1–84. https://doi.org/10.1007/S11042-023-15295-Z

Mandal PC, Mukherjee I, Paul G, Chatterji BN (2022) Digital image steganography: a literature survey. Inf Sci (ny) 609:1451–1488. https://doi.org/10.1016/J.INS.2022.07.120

Mathew A, Amudha P, Sivakumari S (2021) Deep learning techniques: an overview. Adv Intell Syst Comput 1141:599–608. https://doi.org/10.1007/978-981-15-3383-9_54/TABLES/2

Mo X, Tan S, Tang W, Li B, Huang J (2023) ReLOAD: using reinforcement learning to optimize asymmetric distortion for additive steganography. IEEE Trans Inf Forensics Secur 18:1524–1538. https://doi.org/10.1109/TIFS.2023.3244094

Muralidharan T, Cohen A, Cohen A, Processing NN-S, and undefined 2022 (2022) “The infinite race between steganography and steganalysis in images,” Signal Processing , vol 201, p 108711, Accessed: Jan 25, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S016516842200250X?casa_token=t0S5VoPVAi8AAAAA:s5gDY44ig26t6_iLJ8FPDrEAjEZOM4j76RKqUlp2Dck4hmFAYL7osHZtdruhqny1zjVXT_2sCw

Nissar A, Mir AH (2010) Classification of steganalysis techniques: a study. Digit Signal Process A Rev J 20(6):1758–1770. https://doi.org/10.1016/j.dsp.2010.02.003

Pevný T, Fridrich J, Ker AD (2012) From blind to quantitative steganalysis. IEEE Trans Inf Forensics Secur 7(2):445–454. https://doi.org/10.1109/TIFS.2011.2175918

Pevný T and Ker AD (2014) Steganographic key leakage through payload metadata. In: IH and MMSec 2014-proceedings of the 2014 ACM information hiding and multimedia security workshop. pp 109–114. doi: https://doi.org/10.1145/2600918.2600921 .

Provos N and Honeyman P, Detecting steganographic content on the internet. In: USA Today, vol. 1001, no. 01–11, pp. 48103–4943, Aug. 2001, Accessed: Jan. 23, 2022. [Online]. Available: http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:Detecting+Steganographic+Content+on+the+Internet#0

Qian Y, Dong J, Wang W, and Tan T (2016) Learning and transferring representations for image steganalysis using convolutional neural network. In: proceedings-international conference on image processing, ICIP , vol 2016 pp 2752–2756. doi: https://doi.org/10.1109/ICIP.2016.7532860 .

Quach TT (2011) Optimal cover estimation methods and steganographic payload location. IEEE Trans Inf Forensics Secur 6(4):1214–1222. https://doi.org/10.1109/TIFS.2011.2160855

Quach T-T (2014) Cover estimation and payload location using Markov random fields. In: Media Watermarking, Security, and Forensics 2014, vol 9028, p 90280H. doi: https://doi.org/10.1117/12.2032711

Ruan F, Zhang X, Zhu D, Xu Z, Wan S, Qi L (2020) Deep learning for real-time image steganalysis: a survey. J Real-Time Image Process 17(1):149–160. https://doi.org/10.1007/S11554-019-00915-5/TABLES/6

Schaefer G and Stich M (2003) UCID: an uncompressed color image database. In: storage and retrieval methods and applications for multimedia 2004, vol 5307, pp 472–480. doi: https://doi.org/10.1117/12.525375

Selvaraj A, Ezhilarasan A, Wellington SLJ, Sam AR (2021) Digital image steganalysis: a survey on paradigm shift from machine learning to deep learning based techniques. IET Image Process 15(2):504–522. https://doi.org/10.1049/ipr2.12043

Simmons GJ (1984) The prisoners problem. Advances in cryptology: proceedings of crypto , 83, pp 51–67. [Online]. Available: http://www.cs.nccu.edu.tw/~raylin/UndergraduateCourse/ComtenporaryCryptography/Spring2009/ThePrisonerProblem.pdf

Singh P, Gupta S, Gupta V (2023) Multi-objective hyperparameter optimization on gradient-boosting for breast cancer detection. Int J Syst Assur Eng Manag 1:1–11. https://doi.org/10.1007/S13198-023-01955-8/TABLES/8

Singhal A and Bedi P, Blind Quantitative Steganalysis using SVD Features. In: 2018 international conference on advances in computing, communications and informatics, ICACCI 2018, 2018, pp. 369–374. doi: https://doi.org/10.1109/ICACCI.2018.8554947 .

Singhal A and Bedi P, “Blind quantitative steganalysis using CNN–long short-term memory architecture. In: strategic system assurance and business analytics. Asset analytics (performance and safety management), pp 175–186. doi: https://doi.org/10.1007/978-981-15-3647-2_14

Singhal A and Bedi P (2022) Universal Quantitative steganalysis using deep residual networks. In: international conference on innovative computing and communications. Advances in intelligent systems and computing, pp 465–475. doi: https://doi.org/10.1007/978-981-16-3071-2_37

Singhal A, Bedi P (2021) Multi-class blind steganalysis using deep residual networks. Multimed Tools Appl 80(9):13931–13956. https://doi.org/10.1007/s11042-020-10353-2

Stier C (2010) Russian spy ring hid secret messages on the web. New Sci . https://www.newscientist.com/article/dn19126-russian-spy-ring-hid-secret-messages-on-the-web/ (Accessed Jan. 19, 2022).

Sun Y, Zhang H, Zhang T, Wang R (2019) Deep neural networks for efficient steganographic payload location. J Real-Time Image Process 16(3):635–647. https://doi.org/10.1007/S11554-019-00849-Y/TABLES/7

Sun Y and Li T (2019) A Method for Quantitative steganalysis based on deep learning. In: 2019 2nd international conference on information systems and computer aided education, ICISCAE 2019, pp 302–309. doi: https://doi.org/10.1109/ICISCAE48440.2019.221640 .

Tabares-Soto R, Raúl RP, Gustavo I (2019) Deep learning applied to steganalysis of digital images: a systematic review. IEEE Access 7:68970–68990. https://doi.org/10.1109/ACCESS.2019.2918086

Tang W, Li B, Barni M, Li J, Huang J (2021) An automatic cost learning framework for image steganography using deep reinforcement learning. IEEE Trans Inf Forensics Secur 16:952–967. https://doi.org/10.1109/TIFS.2020.3025438

Trivedi S, Chandramouli R (2005) Secret key estimation in sequential steganography. IEEE Trans Signal Process 53(2):746–757. https://doi.org/10.1109/TSP.2004.839925

Article   ADS   MathSciNet   Google Scholar  

Veena ST, Arivazhagan S (2018) Quantitative steganalysis of spatial LSB based stego images using reduced instances and features. Patt Recognit Lett 105:39–49. https://doi.org/10.1016/j.patrec.2017.08.016

Veena ST, Arivazhagan S (2019) Universal secret payload location identification in spatial LSB stego images. Ann Des Telecommun Telecommun 74(5–6):273–286. https://doi.org/10.1007/S12243-018-0676-X/TABLES/3

Wang Y, Moulin P (2007) Optimized feature extraction for learning-based image steganalysis. IEEE Trans Inf Forensics Secur 2(1):31–45. https://doi.org/10.1109/TIFS.2006.890517

Wang J, Yang C, Wang P, Song X, Lu J (2020) Payload location for JPEG image steganography based on co-frequency sub-image filtering. Int J Distrib Sens Netw 16(1):1550147719899569. https://doi.org/10.1177/1550147719899569

Wang J, Yang C, Zhu M, Song X, Liu Y, Lian Y (2021) JPEG image steganography payload location based on optimal estimation of cover co-frequency sub-image. Eurasip J Image Video Process 2021(1):1–14. https://doi.org/10.1186/S13640-020-00542-2/FIGURES/7

Wu S, Zhong S, Liu Y (2018) Deep residual learning for image steganalysis. Multimed Tools Appl 77(9):10437–10453. https://doi.org/10.1007/s11042-017-4440-4

Xu G, Wu HZ, Shi YQ (2016a) Structural design of convolutional neural networks for steganalysis. IEEE Signal Process Lett 23(5):708–712. https://doi.org/10.1109/LSP.2016.2548421

Xu C, Liu J, Gan J, Luo X (2018) Stego key recovery based on the optimal hypothesis test. Multimed Tools Appl 77(14):17973–17992. https://doi.org/10.1007/s11042-017-4878-4

Xu G, Wu HZ, and Shi YQ (2016) Ensemble of CNNs for steganalysis: an empirical study. In: IH and MMSec 2016-proceedings of the 2016 ACM information hiding and multimedia security workshop , pp 103–107. doi: https://doi.org/10.1145/2909827.2930798 .

Yang C, Luo X, Lu J, Liu F (2018) Extracting hidden messages of MLSB steganography based on optimal stego subset. Sci China Inf Sci 61(11):3. https://doi.org/10.1007/s11432-017-9328-2

Yang C, Liu F, Ge S, Lu J, Huang J (2019) Locating secret messages based on quantitative steganalysis. Math Biosci Eng 16(5):4908–4922. https://doi.org/10.3934/mbe.2019247

Article   PubMed   Google Scholar  

Ye J, Ni J, Yi Y (2017) Deep learning hierarchical representations for image steganalysis. IEEE Trans Inf Forensics Secur 12(11):2545–2557. https://doi.org/10.1109/TIFS.2017.2710946

Yedroudj M, Comby F, and Chaumont M (2018) Yedroudj-net: an efficient CNN for spatial steganalysis. In: ICASSP, IEEE international conference on acoustics, speech and signal processing-proceedings , 2018, pp 2092–2096. doi: https://doi.org/10.1109/ICASSP.2018.8461438 .

You W, Zhang H, Zhao X (2021) A siamese CNN for image steganalysis. IEEE Trans Inf Forensics Secur 16:291–306. https://doi.org/10.1109/TIFS.2020.3013204

Zeng J, Tan S, Li B, Huang J (2017) Large-scale JPEG image steganalysis using hybrid deep-learning framework. IEEE Trans Inf Forensics Secur 13(5):1200–1214. https://doi.org/10.1109/TIFS.2017.2779446

Zou Y, Zhang G, Liu L (2019) Research on image steganography analysis based on deep learning. J vis Commun Image Represent 60:266–275. https://doi.org/10.1016/J.JVCIR.2019.02.034

Download references

Acknowledgements

We seriously thank the editor and anonymous reviewers for their valuable comments and suggestions which have immensely helped in improving the quality of our paper.

No funding was received to assist with the preparation of this manuscript.

Author information

Authors and affiliations.

Department of Computer Science, University of Delhi, Delhi, India

Punam Bedi, Anuradha Singhal & Veenu Bhasin

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Anuradha Singhal .

Ethics declarations

Conflict of interest.

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

List of acronyms used in paper is tabulated in Table 3 .

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Bedi, P., Singhal, A. & Bhasin, V. Deep learning based active image steganalysis: a review. Int J Syst Assur Eng Manag 15 , 786–799 (2024). https://doi.org/10.1007/s13198-023-02203-9

Download citation

Received : 25 June 2023

Revised : 02 October 2023

Accepted : 04 November 2023

Published : 27 November 2023

Issue Date : March 2024

DOI : https://doi.org/10.1007/s13198-023-02203-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Information security
• Cybersecurity
• Steganalysis
• Machine learning
• Deep learning
• Active image steganalysis
• Find a journal
• Publish with us
• Track your research