Understanding The Research Methodologies Types
1. Qualitative Methodologies1. Case Study
Explanation: In-depth investigation of a specific context (e.g., city, project, policy). Use: To understand complex issues within a real-life setting. Example: Studying how Pavia and Coimbra plan and promote cultural engagement. 2. Ethnography Explanation: Immersive observation of people and practices in a community. Use: To understand lived experiences and cultural practices. Example: Observing student use of public cultural spaces in Pavia. 3. Grounded Theory Explanation: Developing theory from raw data (interviews, observations). Use: When no existing theory fully explains your topic. Example: Creating a new model for digital cultural engagement based on user interviews. 4. Phenomenology Explanation: Focuses on how people experience a phenomenon. Use: To explore perceptions or emotions tied to cultural participation. Example: Interviewing participants about feelings of belonging through local festivals. 5. Action Research Explanation: Research conducted with participants to solve a problem. Use: When aiming to intervene or improve practice. Example: Co-designing an AR cultural map with city stakeholders. 6. Narrative Inquiry Explanation: Exploring people's stories and personal accounts. Use: When identity, memory, or meaning-making is central. Example: Collecting narratives of cultural identity from migrants in Coimbra. |
2. Quantitative Methodologies7. Descriptive Survey
Explanation: Collects numerical data to describe a population. Use: To gather structured opinions or habits. Example: Surveying students about their awareness of local cultural events. 8. Experimental Design Explanation: Tests cause-effect by controlling variables. Use: In labs or field trials. Example: Testing if AR apps increase cultural engagement compared to static maps. 9. Statistical Modelling Explanation: Uses advanced math to find patterns in large datasets. Use: When analyzing big datasets (e.g., census, geospatial, web traffic). Example: Regression analysis on visitor frequency vs. digital outreach. 3. Mixed Methods10. Explanatory Sequential Design
Explanation: Starts with quantitative (e.g., survey), then uses qualitative to explain. Use: To understand the “why” behind statistical patterns. Example: Survey → Follow-up interviews with respondents to understand low participation. 11. Exploratory Sequential Design Explanation: Starts with qualitative (e.g., interviews), then uses quantitative to test. Use: To test patterns found in interviews. Example: Interviews → Design survey questions based on themes discovered. 12. Convergent Parallel Design Explanation: Collects quantitative and qualitative at the same time, then merges results. Use: When time-limited but want full picture. Example: Spatial data + interviews analyzed in parallel to identify gaps in visibility and access. |
4. Spatial and Design-Based Approaches |
Other Methods Approaches |
|
13. GIS-Based Spatial Analysis
Explanation: Uses geographic mapping to analyze spatial patterns. Use: For urban planning, accessibility, infrastructure studies. Example: Mapping underused cultural assets in Coimbra. 14. Design Research / Research Through Design Explanation: Solving problems by creating a design prototype. Use: For architecture, digital tools, experience design. Example: Developing a gamified AR prototype to test digital heritage storytelling. 15. Participatory Design / Co-Design Explanation: Involves users in the research/design process. Use: When you want research with people, not on them. Example: Workshops with students to co-create a cultural app. |
16. Policy Analysis
Explanation: Systematic study of policy content, design, and impact. Use: When evaluating existing plans or suggesting new ones. Example: Evaluating how well Pavia’s urban strategy addresses cultural sustainability. 17. Framework Analysis Explanation: Applying or comparing existing conceptual frameworks. Use: When testing global indicators locally (like UNESCO Culture|2030). Example: Comparing city policies against the CCCM or Culture 21 principles. 18. Digital Audit Explanation: Reviewing digital presence and online communication. Use: To assess digital engagement or visibility. Example: Analyzing social media and websites of local cultural institutions. |
Resources
Creswell, J. W. & Creswell, J. D. (2018). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications.
→ https://us.sagepub.com/en-us/nam/research-design/book255675
Denzin, N. K., & Lincoln, Y. S. (2018). The SAGE Handbook of Qualitative Research. SAGE.
→ https://us.sagepub.com/en-us/nam/the-sage-handbook-of-qualitative-research/book245268
Silverman, D. (2021). Qualitative Research. SAGE.
→ https://uk.sagepub.com/en-gb/eur/qualitative-research/book268361
→ https://us.sagepub.com/en-us/nam/research-design/book255675
Denzin, N. K., & Lincoln, Y. S. (2018). The SAGE Handbook of Qualitative Research. SAGE.
→ https://us.sagepub.com/en-us/nam/the-sage-handbook-of-qualitative-research/book245268
Silverman, D. (2021). Qualitative Research. SAGE.
→ https://uk.sagepub.com/en-gb/eur/qualitative-research/book268361
Literature Review Types: Three Key Typologies
There’s no single official list that includes all literature review types. The most cited typology is Grant & Booth (2009), which identified 14 review types, and later work (Paré et al. 2015; Sutton et al. 2019, which mapped 48) extends it. Three typologies together cover 50 distinct review types: Sutton et al. (2019) gives 48, Grant & Booth (2009) is the 14-type classic it builds on, and Paré et al. (2015) adds two types from outside health research. Types are listed once, grouped by Sutton's seven families. The Source column shows which papers include each type: S = Sutton et al., GB = Grant & Booth, P = Paré et al.
The three source papers
Paper |
Types |
Field |
What it offers |
Cite it when |
48, in 7 families |
Health |
The most complete typology. Built from 15 earlier typologies; gives definitions and search requirements per type. |
You need the widest, most current classification, or want to justify your choice against many alternatives. |
|
14 |
Health |
The foundational, most-cited typology. Compares types on search, appraisal, synthesis and analysis (SALSA). |
You need the classic reference that reviewers recognise, or a short definition of a common type. |
|
9 |
Information Systems |
Classifies reviews by goal (summarise, aggregate, explain, critique). Adds descriptive and theoretical reviews. |
Your work sits outside health, e.g. digital technology, management or the built environment, or you are writing a theory-building review. |
1. Traditional review family
Purposive rather than exhaustive searching, with the author's interpretation at the centre.
Type |
Brief description |
Chosen When |
Narrative review |
Conventional overview of a topic, contrasted with a systematic review. GB calls it a "literature review". |
You need to frame a study, orient research within a wider field or trace how a topic developed. |
Critical review |
Evaluates the literature's quality and goes beyond description to propose a model or hypothesis. |
You want to challenge existing work and make a conceptual contribution. |
Integrative review |
Combines experimental and non-experimental, qualitative and quantitative studies. |
Evidence on a phenomenon is spread across diverse study designs, especially in nursing or practice research. |
Narrative summary |
Short overview of evidence on a single topic, often produced quickly. |
A decision-maker needs a fast, readable summary rather than a full review. |
State-of-the-art review |
Focuses on the most current research and debates. |
The field moves fast and you want to show where it stands now and what comes next. |
2. Systematic review family
Comprehensive, protocol-driven searching across several databases, with formal appraisal and reporting (e.g. PRISMA).
Type |
Brief description |
Chosen when |
Systematic review |
Systematically searches for, appraises and synthesises research evidence. |
You need a defensible, reproducible answer to a precise question. |
Meta-analysis |
Statistically pools results from quantitative studies for a more precise effect estimate. |
Comparable quantitative studies report the same outcome. |
Network meta-analysis |
Compares several treatments at once using direct and indirect comparisons across trials. |
You need to rank multiple options that were not all tested head to head. |
Cochrane review of effects |
Systematic review of healthcare interventions, produced to Cochrane's handbook and published in its database. |
You are working within Cochrane on a health intervention question. |
Comparative effectiveness review |
Compares the benefits and harms of a range of options, not just one. |
Decision-makers must choose between several interventions. |
Diagnostic systematic review |
Summarises evidence on the accuracy of a diagnostic test. |
The question is how well a test detects a condition. |
Prognostic review |
Synthesises evidence on prognosis, prognostic factors or prediction models. |
You want to know likely outcomes or what predicts them. |
Psychometric review |
Evaluates the reliability and validity of a test or measurement instrument. |
You need to choose or justify a measurement tool. |
Review of economic evaluations |
Synthesises studies comparing costs and outcomes of technologies. |
The question concerns cost-effectiveness. |
Systematic review of epidemiology studies |
Determines prevalence, incidence, causes or risk factors. |
You need to know how common a condition is or what drives it. |
3. Review of reviews family
Synthesises existing reviews rather than primary studies.
Type |
Brief description |
Chosen when |
Review of reviews (overview) |
Brings together multiple reviews done to different standards to map an evidence base. |
Many reviews already exist on a topic, of mixed quality and method. |
Umbrella review |
Brings together reviews that share a methodology, allowing direct comparison. |
Several comparable systematic reviews exist and you want to compare their findings. |
4. Rapid review family
Systematic methods simplified or skipped to meet a deadline, with scope negotiated with the client.
Type |
Brief description |
Chosen when |
Rapid review |
Simplifies or omits steps of a systematic review to deliver in a short time. |
A policy or practice decision is due in weeks, not months. |
Rapid evidence assessment |
Faster than a systematic review but more rigorous than ad hoc searching; may use key informant interviews. |
Government or policy teams need an evidence check within days or weeks. |
Rapid realist synthesis |
Applies the realist question (what works, for whom, in what circumstances) under time limits. |
A time-sensitive policy question involves a complex intervention. |
5. Qualitative review family
Synthesises qualitative studies. Aggregative types search comprehensively; interpretive types may sample theoretically.
Type |
Brief description |
Chosen when |
Qualitative evidence synthesis / Qualitative systematic review |
Umbrella term for systematic reviews of qualitative research; finds themes across studies. Also called qualitative systematic review. |
You want to understand experiences, views or barriers rather than effects. |
Qualitative meta-synthesis |
Searches, appraises and combines qualitative evidence to answer a defined question. |
You need a structured synthesis of qualitative findings on one question. |
Qualitative interpretive meta-synthesis |
Synthesis of qualitative studies aimed at deeper understanding and theory, mainly in social work. |
You want to build theory from diverse qualitative settings. |
Qualitative research synthesis |
Interpretivist synthesis of qualitative studies, mainly in education. |
Your field is education and the aim is interpretive. |
Thematic synthesis |
Codes findings from qualitative studies into descriptive then analytical themes. |
You want to inform interventions with people's views on need and acceptability. |
Framework synthesis |
Uses an existing framework as a template for extraction, then revises it with new themes. |
A suitable framework already exists in your field. |
Best fit framework synthesis |
Systematically identifies theories to build the starting framework, then refines it. |
No single framework fits, but several partial ones do. |
Meta-aggregation |
Presents included findings as the original authors intended, without reinterpretation. |
You need transparent, practice-oriented statements, e.g. for guidelines (JBI method). |
Meta-ethnography |
Translates qualitative studies into one another to produce a new interpretation or theory. |
You aim for a new conceptual model, not a summary. |
Meta-interpretation |
Interpretive synthesis that keeps the epistemology of the primary qualitative studies. |
You want to preserve meaning in context and sample studies iteratively. |
Meta-narrative review |
Compares how different research traditions have studied the same topic over time. |
A topic is studied very differently across disciplines. |
Meta-study |
Analyses the theory, methods and findings of studies to generate theoretical claims. |
You want to examine how a body of research was built, not only its findings. |
Meta-summary |
Counts how often findings recur across qualitative studies. |
You want to show which findings are most consistently reported. |
6. Mixed methods review family
Integrates quantitative and qualitative evidence, sometimes with non-research sources.
Type |
Brief description |
Chosen when |
Mixed methods synthesis |
Combines review approaches, e.g. quantitative with qualitative, or outcome with process studies. GB calls it a "mixed studies review". |
Your question needs both whether something works and how people experience it. |
Realist synthesis (realist review) |
Explains what works, for whom, in what circumstances, by unpacking mechanisms. |
You are studying a complex programme or policy whose results vary by context. |
Critical interpretive synthesis |
Iterative, theory-driven synthesis that judges papers by their relevance to theory. |
Literature is diverse and you want to build new theory, not test it. |
Narrative synthesis |
A specific four-step method that uses text, tables and graphics to explore patterns in mixed evidence. |
Studies are too varied for meta-analysis but need structured synthesis. |
EPPI-Centre review |
Combines effectiveness studies with studies of people's views. |
You need effect and acceptability evidence side by side, often for policy. |
Bayesian meta-analysis |
Statistically combines qualitative and quantitative findings using prior distributions. |
You have expertise in Bayesian methods and want a formal combined estimate. Rarely used. |
7. Purpose-specific review family
Tailored so closely to one purpose that the method is hard to reuse beyond it.
Type |
Brief description |
Chosen when |
Scoping review |
Assesses the size and nature of the literature, including ongoing research. |
You are scoping a topic before a systematic review or primary study. |
Mapping review (systematic map) |
Maps and categorises existing literature to identify gaps. |
You want to show where evidence clusters and where it is missing across a broad area. |
Concept synthesis (concept analysis) |
Identifies concepts and their defining attributes. |
A key term is used inconsistently and needs defining. |
Content analysis |
Systematically codes the content of documents, quantitatively or interpretively. |
You want to analyse how a topic is discussed across many texts. |
Expert opinion / policy review |
Synthesises expert opinion, text or policy documents. |
Little research exists, but guidance and policy do. |
Technology assessment review |
Assesses the clinical and cost-effectiveness evidence for a technology, for decision bodies. |
A health technology appraisal body (e.g. NICE) commissions it. |
Methodological review |
Examines research methods used in a field and their effect on quality. |
Your question is about how research is done, not what it found. |
Systematic search and review |
Critical review combined with a comprehensive search. |
You want a broad "best evidence synthesis" with critical commentary. |
Systematized review |
Includes some systematic review steps but stops short of the full method. |
A thesis or assignment needs rigour without full systematic resources. |
8. Types found only in Paré et al.
Type |
Brief description |
Chosen when |
Descriptive review |
Collects and codes studies to reveal patterns or trends, e.g. by year, method or topic. |
You want to show what a body of research looks like, not judge it. |
Theoretical review |
Draws on existing studies to build a conceptual framework or new theory. It is the most common review type in top IS journals. |
You aim to develop or refine a framework from the literature. |
9. Review approaches common in architecture, design and planning
Type |
Brief description |
Chosen when |
Bibliometric / Science mapping review |
Maps publications, citations, co-authorship and keyword clusters (VOSviewer, CiteSpace, Bibliometrix) |
Charting a fast-growing topic such as digital twins, smart cities or the 15-minute city |
Hybrid review |
Bibliometric mapping followed by a narrative or critical synthesis of key clusters |
You need both breadth and interpretation, which is very common in built-environment journals |
Case survey / case study synthesis |
Codes published case studies with a common framework to compare outcomes |
Evidence in planning comes mainly from case studies, not experiments |
Precedent review |
Systematic analysis of built projects or design precedents rather than papers |
Design research, design guidance, typological studies |
Policy & grey literature review |
Synthesises plans, regulations, guidelines and municipal reports |
Policy matters as much as academic research, as in most planning questions |
Historical / genealogical review |
Traces how a concept or practice evolved |
Theory papers in architecture and urban history |
Systematic quantitative literature review |
counts and categorises studies by location, scale, method and topic to show geographic and thematic gaps. |
It’s popular in urban ecology, geography and planning. |
Evidence & Gap map |
a visual matrix of interventions against outcomes that shows where evidence exists and where it doesn’t. |
It’s increasingly used for urban policy. |
Living systematic review |
a systematic review that is continuously updated. |
It’s useful for fast-moving topics like urban digital twins. |
10. Review approaches common in business & management
Type |
Brief description |
Chosen when |
Semi-systematic review |
follows a structured search but synthesises narratively. |
It suits broad, interdisciplinary topics. |
Problematizing review |
reads the literature critically to challenge its assumptions rather than fill gaps. |
Problem focused |
Structured literature review |
codes papers against a predefined analytical framework. |
Value |
Framework-based, domain-based review |
organise a field using an established framework such as TCCM (theory, context, characteristics, methodology). |
11. From information systems and software engineering
Type |
Brief description |
Chosen when |
Hermeneutic review |
an iterative cycle of searching, reading and interpreting. |
where understanding deepens with each round. |
Systematic literature review, kitchenham style and tertiary review |
a systematic review and a review of systematic reviews. |
adapted to computing, |
Multivocal literature review |
combines academic papers with grey literature such as blogs, white papers and industry reports. |
It suits practice-led fields |
12. Emerging
Type |
Brief description |
AI or text-mining assisted review |
uses machine learning or topic modelling for screening or synthesis. It’s a growing approach, not yet a settled type. |
Argumentative review |
builds a case for a position by selectively examining literature. It’s sometimes listed in social science textbooks. |
Quick decision guide
What should your review do?
1
Frame a study or argue
Narrative reviewCritical reviewState-of-the-art reviewIntegrative reviewNarrative summarySystematic search and reviewSemi-systematic reviewProblematizing reviewHermeneutic reviewArgumentative review
2
Build theory or concepts
Theoretical reviewConcept synthesisCritical interpretive synthesisMeta-ethnographyMeta-interpretationMeta-studyFramework synthesisBest fit framework synthesisHistorical / genealogical review
3
Map the field and gaps
Scoping reviewMapping reviewDescriptive reviewContent analysisMethodological reviewMeta-narrative reviewBibliometric reviewHybrid reviewSystematic quantitative literature reviewEvidence and gap mapStructured literature reviewFramework-based review
4
Answer a precise question
Systematic reviewMeta-analysisLiving systematic reviewSystematic literature review (software eng.)Network meta-analysisCochrane review of effectsComparative effectiveness reviewDiagnostic systematic reviewPrognostic reviewPsychometric reviewReview of economic evaluationsEpidemiology systematic reviewTechnology assessment review
5
Understand experiences
Qualitative evidence synthesisThematic synthesisQualitative meta-synthesisQualitative interpretive meta-synthesisQualitative research synthesisMeta-aggregationMeta-summary
6
Combine or explain in context
Realist synthesisMixed methods synthesisNarrative synthesisEPPI-Centre reviewBayesian meta-analysisCase survey
7
Synthesise existing reviews
Umbrella reviewReview of reviewsTertiary review
8
Deliver fast for a decision
Rapid reviewRapid evidence assessmentRapid realist synthesisAI-assisted review
9
Work with limited means
Systematized reviewExpert opinion / policy review
10
Inform design and practice
Precedent reviewPolicy and grey literature reviewMultivocal literature review
TypeIn the three typologies, usable across fieldsTypeMainly health or clinicalTypeFrom other fields, incl. architecture and planning
Sources: Sutton et al. 2019 · Grant & Booth 2009 · Paré et al. 2015, plus field-specific methods papers
Review typologiesGrant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information & Management, 52(2), 183–199. https://doi.org/10.1016/j.im.2014.08.008
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019). Meeting the review family: Exploring review types and associated information retrieval requirements. Health Information & Libraries Journal, 36(3), 202–222. https://doi.org/10.1111/hir.12276
Moher, D., Stewart, L., & Shekelle, P. (2015). All in the family: Systematic reviews, rapid reviews, scoping reviews, realist reviews, and more. Systematic Reviews, 4, 183. https://doi.org/10.1186/s13643-015-0163-7
Campbell, F., Tricco, A. C., Munn, Z., Pollock, D., Saran, A., Sutton, A., White, H., & Khalil, H. (2023). Mapping reviews, scoping reviews, and evidence and gap maps (EGMs): The same but different—the “Big Picture” review family. Systematic Reviews, 12, 45. https://doi.org/10.1186/s13643-023-02178-5
Urban planningXiao, Y., & Watson, M. (2019). Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39(1), 93–112. https://doi.org/10.1177/0739456X17723971 (published online 2017; volume confirmed, issue and pages †)
Pickering, C., & Byrne, J. (2014). The benefits of publishing systematic quantitative literature reviews for PhD candidates and other early-career researchers. Higher Education Research & Development, 33(3), 534–548. https://doi.org/10.1080/07294360.2013.841651 †
Methods for specific review typesArksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Peters, M. D. J., Marnie, C., Tricco, A. C., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C. M., & Khalil, H. (2020). Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Synthesis, 18(10), 2119–2126. https://doi.org/10.11124/JBIES-20-00167
Whittemore, R., & Knafl, K. (2005). The integrative review: Updated methodology. Journal of Advanced Nursing, 52(5), 546–553. https://doi.org/10.1111/j.1365-2648.2005.03621.x
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603. https://doi.org/10.1371/journal.pmed.1001603
Saran, A., & White, H. (2018). Evidence and gap maps: A comparison of different approaches. Campbell Systematic Reviews, 14(1), 1–38. https://doi.org/10.4073/cmdp.2018.2
White, H., Albers, B., Gaarder, M., Kornør, H., Littell, J., Marshall, Z., Mathew, C., Pigott, T., Snilstveit, B., Waddington, H., & Welch, V. (2020). Guidance for producing a Campbell evidence and gap map. Campbell Systematic Reviews, 16(4), e1125. https://doi.org/10.1002/cl2.1125
Greenhalgh, T., & Shaw, S. (2017). Understanding heart failure; explaining telehealth – a hermeneutic systematic review. BMC Cardiovascular Disorders, 17, 156. https://doi.org/10.1186/s12872-017-0594-2
Boell, S. K., & Cecez-Kecmanovic, D. (2014). A hermeneutic approach for conducting literature reviews and literature searches. Communications of the Association for Information Systems, 34, Article 12. https://doi.org/10.17705/1CAIS.03412
Business, management and information systemsSnyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039 †
Alvesson, M., & Sandberg, J. (2020). The problematizing review: A counterpoint to Elsbach and Van Knippenberg’s argument for integrative reviews. Journal of Management Studies, 57(6), 1290–1304. https://doi.org/10.1111/joms.12582 †
Massaro, M., Dumay, J., & Guthrie, J. (2016). On the shoulders of giants: Undertaking a structured literature review in accounting. Accounting, Auditing & Accountability Journal, 29(5), 767–801. https://doi.org/10.1108/AAAJ-01-2015-1939 (DOI †)
Paul, J., & Criado, A. R. (2020). The art of writing literature review: What do we know and what do we need to know? International Business Review, 29(4), 101717. https://doi.org/10.1016/j.ibusrev.2020.101717 †
Software engineeringKitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (EBSE Technical Report EBSE-2007-01). Keele University and Durham University. †
Garousi, V., Felderer, M., & Mäntylä, M. V. (2019). Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. Information and Software Technology, 106, 101–121. https://doi.org/10.1016/j.infsof.2018.09.006
Reporting and quality standardsMoher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71 †
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K. K., Colquhoun, H., Levac, D., … Straus, S. E. (2018). PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Annals of Internal Medicine, 169(7), 467–473. https://doi.org/10.7326/M18-0850 †
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013a). RAMESES publication standards: Meta-narrative reviews. BMC Medicine, 11, 20. https://doi.org/10.1186/1741-7015-11-20
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013b). RAMESES publication standards: Realist syntheses. BMC Medicine, 11, 21. https://doi.org/10.1186/1741-7015-11-21
Baethge, C., Goldbeck-Wood, S., & Mertens, S. (2019). SANRA—a scale for the quality assessment of narrative review articles. Research Integrity and Peer Review, 4, 5. https://doi.org/10.1186/s41073-019-0064-8 †
Byrne, J. A. (2016). Improving the peer review of narrative literature reviews. Research Integrity and Peer Review, 1, 12. https://doi.org/10.1186/s41073-016-0019-2
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information & Management, 52(2), 183–199. https://doi.org/10.1016/j.im.2014.08.008
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019). Meeting the review family: Exploring review types and associated information retrieval requirements. Health Information & Libraries Journal, 36(3), 202–222. https://doi.org/10.1111/hir.12276
Moher, D., Stewart, L., & Shekelle, P. (2015). All in the family: Systematic reviews, rapid reviews, scoping reviews, realist reviews, and more. Systematic Reviews, 4, 183. https://doi.org/10.1186/s13643-015-0163-7
Campbell, F., Tricco, A. C., Munn, Z., Pollock, D., Saran, A., Sutton, A., White, H., & Khalil, H. (2023). Mapping reviews, scoping reviews, and evidence and gap maps (EGMs): The same but different—the “Big Picture” review family. Systematic Reviews, 12, 45. https://doi.org/10.1186/s13643-023-02178-5
Urban planningXiao, Y., & Watson, M. (2019). Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39(1), 93–112. https://doi.org/10.1177/0739456X17723971 (published online 2017; volume confirmed, issue and pages †)
Pickering, C., & Byrne, J. (2014). The benefits of publishing systematic quantitative literature reviews for PhD candidates and other early-career researchers. Higher Education Research & Development, 33(3), 534–548. https://doi.org/10.1080/07294360.2013.841651 †
Methods for specific review typesArksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Peters, M. D. J., Marnie, C., Tricco, A. C., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C. M., & Khalil, H. (2020). Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Synthesis, 18(10), 2119–2126. https://doi.org/10.11124/JBIES-20-00167
Whittemore, R., & Knafl, K. (2005). The integrative review: Updated methodology. Journal of Advanced Nursing, 52(5), 546–553. https://doi.org/10.1111/j.1365-2648.2005.03621.x
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603. https://doi.org/10.1371/journal.pmed.1001603
Saran, A., & White, H. (2018). Evidence and gap maps: A comparison of different approaches. Campbell Systematic Reviews, 14(1), 1–38. https://doi.org/10.4073/cmdp.2018.2
White, H., Albers, B., Gaarder, M., Kornør, H., Littell, J., Marshall, Z., Mathew, C., Pigott, T., Snilstveit, B., Waddington, H., & Welch, V. (2020). Guidance for producing a Campbell evidence and gap map. Campbell Systematic Reviews, 16(4), e1125. https://doi.org/10.1002/cl2.1125
Greenhalgh, T., & Shaw, S. (2017). Understanding heart failure; explaining telehealth – a hermeneutic systematic review. BMC Cardiovascular Disorders, 17, 156. https://doi.org/10.1186/s12872-017-0594-2
Boell, S. K., & Cecez-Kecmanovic, D. (2014). A hermeneutic approach for conducting literature reviews and literature searches. Communications of the Association for Information Systems, 34, Article 12. https://doi.org/10.17705/1CAIS.03412
Business, management and information systemsSnyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039 †
Alvesson, M., & Sandberg, J. (2020). The problematizing review: A counterpoint to Elsbach and Van Knippenberg’s argument for integrative reviews. Journal of Management Studies, 57(6), 1290–1304. https://doi.org/10.1111/joms.12582 †
Massaro, M., Dumay, J., & Guthrie, J. (2016). On the shoulders of giants: Undertaking a structured literature review in accounting. Accounting, Auditing & Accountability Journal, 29(5), 767–801. https://doi.org/10.1108/AAAJ-01-2015-1939 (DOI †)
Paul, J., & Criado, A. R. (2020). The art of writing literature review: What do we know and what do we need to know? International Business Review, 29(4), 101717. https://doi.org/10.1016/j.ibusrev.2020.101717 †
Software engineeringKitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (EBSE Technical Report EBSE-2007-01). Keele University and Durham University. †
Garousi, V., Felderer, M., & Mäntylä, M. V. (2019). Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. Information and Software Technology, 106, 101–121. https://doi.org/10.1016/j.infsof.2018.09.006
Reporting and quality standardsMoher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71 †
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K. K., Colquhoun, H., Levac, D., … Straus, S. E. (2018). PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Annals of Internal Medicine, 169(7), 467–473. https://doi.org/10.7326/M18-0850 †
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013a). RAMESES publication standards: Meta-narrative reviews. BMC Medicine, 11, 20. https://doi.org/10.1186/1741-7015-11-20
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013b). RAMESES publication standards: Realist syntheses. BMC Medicine, 11, 21. https://doi.org/10.1186/1741-7015-11-21
Baethge, C., Goldbeck-Wood, S., & Mertens, S. (2019). SANRA—a scale for the quality assessment of narrative review articles. Research Integrity and Peer Review, 4, 5. https://doi.org/10.1186/s41073-019-0064-8 †
Byrne, J. A. (2016). Improving the peer review of narrative literature reviews. Research Integrity and Peer Review, 1, 12. https://doi.org/10.1186/s41073-016-0019-2
Research Methodologies Types
What does your research need to do?
1
Measure, test or predict
Quantitative
ExperimentalQuasi-experimentalNatural experimentSurvey researchCorrelationalCross-sectionalLongitudinal / panelStatistical / econometric modelling
2
Understand meaning and experience
Qualitative
EthnographyPhenomenologyGrounded theoryNarrative inquiryDiscourse analysisThematic analysisWalking interviews / go-alongsPhoto-elicitation
3
Study a case in its context
Case-based
Single case studyMultiple / comparative case studyQualitative comparative analysis (QCA)Precedent analysisTypological / morphological analysis
4
Model, simulate or analyse space
Computational and spatial
Simulation and modellingAgent-based modellingNetwork analysisMachine learning / data scienceGIS and spatial analysisSpace syntaxBuilding performance simulationDigital twin-based researchAccessibility / walkability analysis
5
Interpret the past and documents
Historical and textual
Historical-interpretive researchArchival researchDocument / policy analysisContent analysisArchitectural history and theory
6
Argue or build theory
Conceptual
Logical argumentationConceptual / theoretical researchCritical theoryPhilosophical inquiry
7
Change practice with people
Participatory
Action researchParticipatory action researchCommunity-based participatory researchCo-design / co-productionLiving labs
8
Use design as a way of knowing
Design research
Research through designResearch for designResearch into designPractice-based / practice-led researchDesign science researchResearch by design
9
Evaluate places and interventions
Evaluation
Programme evaluationRealist evaluationCost-benefit analysisMulti-criteria decision analysisPost-occupancy evaluationBehaviour mapping / public life studiesImpact assessment
10
Combine, synthesise or look ahead
Mixed, secondary and futures
Convergent mixed methodsExplanatory sequentialExploratory sequentialLiterature review (see review types)Delphi methodScenario planningQ methodology
MethodUsed across the social sciencesMethodSpecific to architecture, design and planning
Grouping adapted from Creswell & Creswell (2018), Groat & Wang (2013) and Frayling (1993)