top of page
Writer's pictureBoon Yih Mah

Systematic Literature Review: A Rigorous Approach to Evidence Synthesis


A literature review is a critical and systematic examination of scholarly sources (such as books, research articles, dissertations, conference papers, and other relevant publications) on a specific topic or research question. It is a comprehensive summary and evaluation of existing knowledge, theories, and findings related to a particular subject area.


The purpose of a literature review varies depending on the context and objectives of the study. It can be conducted as a standalone work, such as a literature review paper, or as a preliminary step in a research project to establish a theoretical framework and identify research gaps. Regardless of its specific purpose, a literature review involves the following key elements:

  1. Identification and selection of sources

  2. Evaluation and analysis of sources

  3. Synthesis and organisation of information

  4. Identification of research gaps

  5. Analysis and interpretation of findings

  6. Conclusion and recommendations


Overall, a literature review serves as a foundation for research by establishing a context for the study, informing theoretical frameworks, and providing a comprehensive overview of existing knowledge. It aids researchers in understanding the current state of research, identifying areas for further investigation, and positioning their work within the broader academic discourse.


A. Systematic Literature Review


In research and academia, staying up-to-date with the ever-expanding body of knowledge is paramount. However, the sheer volume of scholarly publications can be overwhelming, making it difficult to extract meaningful insights. This is where systematic literature review (SLR) comes into play. A systematic literature review is a rigorous and comprehensive approach to synthesising existing research in a particular field or topic.


A systematic literature review is a systematic and transparent method for identifying, evaluating, and synthesising relevant research studies on a specific research question or topic. Unlike traditional literature reviews, which may be prone to bias and subjectivity, SLRs follow a well-defined and replicable methodology. By employing explicit search strategies and predefined inclusion and exclusion criteria, SLRs aim to minimise bias and ensure a comprehensive and unbiased review of the available evidence as depicted in the Hierarchy of Scientific Evidence by The Logic Of Science.


An SLR is a rigorous and structured approach to synthesising existing research in a specific field or topic. By following a well-defined methodology, SLRs provide researchers with a comprehensive overview of the available evidence, helping to inform decision-making, identify research gaps, and advance knowledge, as well as providing an invaluable resource for researchers, policymakers, and practitioners.


B. Types of SLR


There are several types of SLR, each with its own focus and purpose. Here are some commonly recognised types:

  1. Traditional/Systematic review

    1. This is the most basic type of systematic literature review.

    2. It aims to provide a comprehensive and unbiased summary of the evidence on a specific research question or topic.

    3. It follows a systematic methodology for searching, selecting, and evaluating studies.

  2. Meta-analysis

    1. A meta-analysis is a quantitative systematic review that involves statistical analysis of data from multiple studies.

    2. It aims to synthesise and combine the results of individual studies to generate an overall effect size or estimate.

    3. Meta-analysis is particularly useful when studies have similar designs, outcomes, and measures.

  3. Meta-synthesis

    1. Meta-synthesis is a qualitative systematic review method that focuses on synthesising findings from qualitative studies.

    2. It involves analysing and interpreting the findings, themes, and concepts across multiple studies to better understand a particular phenomenon or research question.

  4. Scoping review

    1. A scoping review aims to map the existing literature on a broad research topic.

    2. It provides an overview of the quantity, nature, and distribution of research in a particular field, highlighting key concepts, gaps, and emerging trends.

    3. Scoping reviews often do not assess study quality or conduct detailed data synthesis.

  5. Systematic mapping review

    1. A systematic mapping review is similar to a scoping review but focuses on systematically mapping the existing literature based on predefined criteria.

    2. It aims to identify the extent, nature, and distribution of research in a particular area, including types of studies, methodologies, and geographic coverage.

  6. Mixed methods review

    1. A mixed methods review combines both quantitative and qualitative studies in the review process.

    2. It involves synthesising data from various study designs, methodologies, and data types to understand a research question or topic comprehensively.

  7. Realist review

    1. Realist reviews explore how and why interventions work (or do not) in specific contexts.

    2. They focus on developing theories or models of program theory by synthesising evidence from multiple sources, including empirical studies, theoretical frameworks, and stakeholder perspectives.


Above are some of the main types of systematic literature reviews. It is important to note that the specific approach and terminology may vary across disciplines and research fields. The choice of review type depends on the research question, available evidence, and the goals of the review. Below are the steps for conducting an SLR.


C. Steps to Conduct an SLR Solutions


  1. Question

    1. The first step in conducting an SLR is formulating a clear, focused research question.

    2. This question should guide the entire review process and provide a framework for selecting relevant studies.

    3. It is crucial to ensure the research question is specific, relevant, and answerable through the available literature.

  2. Search

    1. A systematic and comprehensive search strategy is crucial for identifying relevant studies.

      1. It is essential to document the search strategy to ensure transparency and replicability.

    2. This involves identifying relevant keywords, synonyms, and controlled vocabulary terms associated with the research question.

    3. This involves searching multiple electronic databases such as academic journals, conference proceedings, and grey literature.

      1. Grey literature refers to materials and research produced by organisations outside traditional commercial or academic publishing and distribution channels, including government reports, conference proceedings, graduate dissertations, and unpublished clinical trials.

    4. Electronic databases, such as PubMed, Scopus, or Web of Science, are commonly used to conduct literature searches.

  3. Screen and select

    1. After executing the search strategies, the retrieved studies need to be screened based on predefined inclusion and exclusion criteria.

    2. Initially, titles and abstracts are screened to identify potentially relevant studies.

    3. Then, a full-text assessment is conducted for the selected studies.

    4. The inclusion criteria should align with the research question and study objectives, while the exclusion criteria help filter out irrelevant or low-quality studies.

  4. Extract

    1. Once the studies are selected, relevant data needs to be extracted systematically.

    2. A standardised data extraction form should be developed to collect essential information from each study, including study design, sample size, methodology, key findings, and other relevant details.

    3. This step ensures consistency and facilitates data analysis and synthesis in later stages.

  5. Assess

    1. A quality assessment ensures the included studies' reliability and validity.

    2. This step involves evaluating each study's methodological rigour, potential biases, and overall quality.

    3. Various tools and frameworks, such as the Cochrane Risk of Bias Tool or the Joanna Briggs Institute Critical Appraisal Checklist, can assist in assessing study quality.

  6. Synthesise and analyse

    1. The extracted data from the selected studies are synthesised and analysed to identify patterns, themes, and relationships.

    2. Depending on the nature of the research question and the available data, quantitative meta-analysis and thematic analysis can be employed.

    3. Quantitative analysis involves statistical techniques to combine data from multiple studies, while qualitative analysis involves identifying common themes and drawing meaningful conclusions.

  7. Interpret and report

    1. The final step of an SLR is interpreting and reporting the results clearly and transparently.

    2. The findings should be summarised, addressing the research question and objectives.

    3. Any limitations or biases should be acknowledged, and implications for future research and practice should be discussed.

    4. Adhering to reporting guidelines, such as PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), is crucial to enhancing the transparency and reproducibility of the review.


The article below exemplifies an SLR application published by Elsevier Ltd. in 2023.


D. Advantages of SLR


Systematic literature reviews offer several significant benefits, making them a valuable research method in various fields. Here are some key benefits:

  1. Comprehensive and unbiased overview

    1. Systematic literature reviews provide a comprehensive and unbiased summary of existing knowledge on a specific topic or research question.

    2. By systematically searching, selecting, and evaluating relevant studies, they ensure a thorough coverage of the available evidence, reducing the risk of bias and providing a balanced view of the field.

  2. Identification of research gaps

    1. Systematic reviews help identify gaps in the existing literature.

    2. By synthesising and analysing multiple studies, researchers can identify areas where research is lacking or where inconsistencies and contradictions exist.

    3. Identifying research gaps guides future research efforts and contributes to advancing knowledge.

  3. Evidence-based decision making

    1. Systematic reviews provide a strong evidence base for decision-making.

    2. Policymakers, practitioners, and researchers can rely on the findings of systematic reviews to inform policy development, clinical guidelines, or the design of future studies.

    3. They help ensure that decisions are based on the best available evidence rather than individual studies or anecdotal evidence.

  4. Strengthens research rigour

    1. Conducting a systematic review requires a rigorous methodology.

    2. Systematic reviews enhance the scientific rigour of the research process by following explicit and transparent procedures, such as predefined inclusion criteria, systematic searches, and study quality assessment.

    3. This methodology helps minimise bias, increase transparency, and improve the reliability of the findings.

  5. Summarises and synthesises complex information

    1. Systematic reviews distil complex and vast amounts of information into a concise, organised summary.

    2. By synthesising findings from multiple studies, they offer a clear overview of the current state of knowledge and identify consistent patterns, trends, and relationships.

    3. This synthesised information is valuable for researchers, practitioners, and policymakers looking to understand the topic comprehensively.

  6. Facilitates replication and update of findings

    1. The systematic approach followed in conducting a review ensures transparency and applicability.

    2. By documenting search strategies, inclusion criteria, and assessment methods, systematic reviews allow others to replicate the review process.

    3. Additionally, systematic reviews can be periodically updated to incorporate new evidence, ensuring the currency and relevance of the findings.

  7. Reduces research duplication

    1. Systematic reviews help prevent unnecessary duplication of research efforts.

    2. By summarising existing evidence and identifying research gaps, they guide researchers towards areas that require further investigation.

    3. This reduces redundancy and promotes a more efficient allocation of research resources.

  8. Informs policy and practice

    1. Systematic reviews are influential in informing policy development and practice guidelines.

    2. Systematic reviews can help policymakers and practitioners make evidence-based decisions, implement effective interventions, and optimise resource allocation.


Systematic literature reviews offer a robust and structured approach to synthesising existing evidence, identifying research gaps, and informing decision-making. Their benefits extend beyond individual studies, advancing knowledge, evidence-based practice, and policy development.


E. Disadvantages of SLR


While SLR offers numerous benefits, it also comes with certain disadvantages. It is important to be aware of these potential limitations when conducting and interpreting the findings of a systematic literature review. Some disadvantages include:

  1. Time and resource-intensive

    1. Conducting a systematic literature review requires significant time, effort, and resources.

    2. The process involves extensive literature searching, screening, data extraction, and analysis, which can be time-consuming and may require a team of researchers.

  2. Publication bias

    1. Systematic literature reviews heavily rely on published studies, which can be influenced by publication bias.

    2. Positive results or studies with statistically significant findings are more likely to be published, leading to an overrepresentation of certain studies and potential underrepresentation of negative or null results.

  3. Availability of literature

    1. Access to all relevant literature may be limited due to various reasons, such as restricted access to certain databases or publications, language barriers, or publication bias.

    2. This may result in some studies being missed or not included in the review, potentially affecting the comprehensiveness and generalisability of the findings.

  4. Heterogeneity of studies

    1. The studies included in a systematic literature review may vary in methodologies, sample sizes, study designs, and outcome measures.

    2. This heterogeneity can pose challenges in data synthesis and the generalisability of findings, particularly if the studies are too diverse to be directly compared or combined.

  5. Quality and bias of included studies

    1. Systematic reviews depend on the quality and rigour of the studies included.

    2. Suppose the quality of the individual studies is low or there is a high risk of bias in the included studies. In that case, it can impact the validity and reliability of the review findings.

  6. Updating challenges

    1. Literature is constantly evolving, and new studies are published regularly.

    2. Keeping a systematic review up-to-date can be challenging, especially considering the time and resources required for updates.

    3. Outdated reviews may not reflect the most current evidence and may fail to capture recent developments in the field.

  7. Interpretation and synthesis challenges

    1. Systematic reviews aim to synthesise and interpret the findings of multiple studies.

    2. However, differences in study designs, methodologies, and reported outcomes can make summarising and drawing definitive conclusions challenging.

    3. Interpreting the findings requires careful consideration of the included studies' context, heterogeneity, and limitations.


Despite these limitations, systematic literature reviews remain valuable for summarising existing evidence, identifying research gaps, and informing decision-making. Recognising and addressing these potential disadvantages can help researchers mitigate their impact and enhance the quality and reliability of the review findings.


The SLR is a systematic and comprehensive approach to synthesising existing research, providing researchers with valuable insights and informing evidence-based decision-making. By conducting systematic literature reviews, researchers can advance their knowledge and facilitate evidence-based practices and policies in their respective fields. By following the step-by-step guide outlined in this article, researchers can effectively apply the SLR methodology, ensuring rigour, transparency, and reliability throughout the review process.


To share your thoughts by commenting on this post, kindly sign up as a member by filling in your details in the Contact below.

77 views0 comments

Comments


bottom of page