{
 "id": "ep7e7b95d7",
 "slug": "diary-study",
 "title": "Diary study",
 "updated": "2026-10-15",
 "topic_path": [
  {
   "id": "physical",
   "label": "Physical world and mathematics",
   "api_url": "https://www.edgepedia.org/api/v1/topics/physical"
  },
  {
   "id": "physical.science",
   "label": "General science and scientific practice",
   "api_url": "https://www.edgepedia.org/api/v1/topics/physical.science"
  },
  {
   "id": "physical.science.research_methods_design",
   "label": "Research methods and experimental design",
   "api_url": "https://www.edgepedia.org/api/v1/topics/physical.science.research_methods_design"
  },
  {
   "id": "physical.science.research_methods_design.ethnographic-and-field-research",
   "label": "Ethnographic and field research",
   "api_url": "https://www.edgepedia.org/api/v1/topics/physical.science.research_methods_design.ethnographic-and-field-research"
  }
 ],
 "geo": [
  {
   "id": "geo.nongeo.t1800.physical",
   "label": "Non-geographic · 1800 to 1945: Physical world and mathematics",
   "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.physical",
   "path": [
    {
     "id": "geo.nongeo",
     "label": "Non-geographic",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo"
    },
    {
     "id": "geo.nongeo.t1800",
     "label": "Non-geographic · 1800 to 1945",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800"
    },
    {
     "id": "geo.nongeo.t1800.physical",
     "label": "Physical world and mathematics",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.physical"
    }
   ]
  },
  {
   "id": "geo.nongeo.t1946.physical.science.research_methods_design",
   "label": "Non-geographic · 1946 to 2000: Research methods and experimental design",
   "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science.research_methods_design",
   "path": [
    {
     "id": "geo.nongeo",
     "label": "Non-geographic",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo"
    },
    {
     "id": "geo.nongeo.t1946",
     "label": "Non-geographic · 1946 to 2000",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946"
    },
    {
     "id": "geo.nongeo.t1946.physical",
     "label": "Physical world and mathematics",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical"
    },
    {
     "id": "geo.nongeo.t1946.physical.science",
     "label": "General science and scientific practice",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science"
    },
    {
     "id": "geo.nongeo.t1946.physical.science.research_methods_design",
     "label": "Research methods and experimental design",
     "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science.research_methods_design"
    }
   ]
  }
 ],
 "excerpt": "A diary study is a qualitative, quantitative, or mixed research method in which participants record experiences and behaviors in daily life over days to months, reducing retrospection bias.",
 "snippet": "A diary study is a qualitative, quantitative, or mixed research method in which participants record experiences and behaviors in daily life over days to months, reducing retrospection bias.",
 "node": "physical.science.research_methods_design.ethnographic-and-field-research",
 "markdown": "# Diary study\n\nA diary study is a qualitative, quantitative, or mixed-methods research method in which participants record experiences, behaviors, or events in their own daily lives, usually in situ, over periods from a few days to several months. It belongs to the family of intensive longitudinal methods (ILMs), which also includes experience sampling, ecological momentary assessment, and ambulatory assessment.<sup>[1](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)</sup> In human-computer interaction, diary studies divide into feedback studies, which collect structured answers immediately, and elicitation studies, which use sparse in-situ logging followed by a post-study interview.<sup>[2](https://ar5iv.labs.arxiv.org/html/2404.19738)</sup> Depending on design, a study yields raw time-stamped entries, coded themes, or quantitative time series; organizational researchers summarize the aim as capturing \"life as it is lived\".<sup>[3](https://d-nb.info/1097268829/34)</sup>\n\n| Aspect | Typical practice |\n|---|---|\n| Duration | Median 17 days (IQR 7–30; range 1–270) across diary, ESM, and EMA studies <sup>[4](https://link.springer.com/article/10.1186/s12874-018-0579-6)</sup>; median 10 days in a review of 162 recent ESM studies <sup>[5](https://www.psychologicalscience.org/journals/ampps/25152459261453933/)</sup> |\n| Frequency | Median 5 entries per day (IQR 3–10; range 1–50) <sup>[4](https://link.springer.com/article/10.1186/s12874-018-0579-6)</sup> |\n| Entry length | About 5–10 minutes; beyond 15 minutes participants skip questions or abandon reporting <sup>[6](https://www.nngroup.com/articles/diary-study-entries/)</sup> |\n| Sampling scheme | Event-contingent, interval-contingent, or signal-contingent <sup>[7](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)</sup> |\n| Compliance | 70–80% average in ESM reviews, though 30–50% of studies do not report compliance <sup>[8](https://journals.sagepub.com/doi/full/10.1177/25152459241267912)</sup>; only 11% of paper entries in one landmark audit were completed on time <sup>[3](https://d-nb.info/1097268829/34)</sup> |\n| Quantitative sample size | 50 participants × 7 days for mean-level hypotheses; 100 × 10 for within-person single predictors; at least 125 × 14 for cross-level interactions <sup>[7](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)</sup> |\n| Qualitative sample size | About 10–15 participants plus backups in UX practice, with saturation as the stopping rule <sup>[9](https://maze.co/collections/user-research/diary-research/)</sup><sup> • </sup><sup>[10](https://www.nngroup.com/articles/diary-studies/)</sup> |\n\n## How it works\n\nBecause reports are recorded close in time to the experience, diary methods greatly reduce the retrospection bias that affects ordinary surveys.<sup>[11](https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf)</sup> This makes within-person questions answerable: associations measured inside a person can differ from associations measured between people. Tennen and colleagues, for example, found drinking to cope associated with higher anxiety between persons but decreased anxiety within persons.<sup>[11](https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf)</sup> Diary research questions fall into three categories: average experiences and their variability, systematic change across days, and processes underlying within-person change.<sup>[11](https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf)</sup>\n\nProtocols differ in what triggers an entry. In an event-contingent study, a record is generated every time a certain type of event occurs; interval-contingent studies request a record after fixed passages of time, such as the end of a day; signal-contingent studies prompt a record whenever a signal such as a beep arrives, the so-called beeper studies.<sup>[7](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)</sup> Signal-contingent designs require a signaling device and raise feasibility and ethics issues, such as advising participants not to respond while driving.<sup>[12](https://uk.sagepub.com/sites/default/files/upm-assets/145283_book_item_145283.pdf)</sup>\n\n## How it is done\n\nA practitioner frames the research question, chooses a sampling scheme and format, then pilots the protocol. Entries should take about 5–10 minutes; most studies combine closed, open-ended, and multimedia questions to balance consistency with depth.<sup>[6](https://www.nngroup.com/articles/diary-study-entries/)</sup> Reis and Gable's recommendation, reported in the organizational-research literature, is that daily assessments not exceed 5–7 minutes, which rules out most scales of five or more items.<sup>[3](https://d-nb.info/1097268829/34)</sup>\n\nRecommended procedure includes a pilot study, a pre-study brief, over-recruiting to cover dropout, daily or periodic reminders, and a post-study interview with each participant.<sup>[10](https://www.nngroup.com/articles/diary-studies/)</sup> For US-based general samples, about $40 per hour of expected total time commitment is a broad incentive guideline, paid in milestone installments for studies longer than a week.<sup>[10](https://www.nngroup.com/articles/diary-studies/)</sup>\n\nAnalysis splits by design. Qualitative diary studies most often use thematic or content analysis, though few papers explain how they analyze time and longitudinal elements in the data.<sup>[13](https://econtent.hogrefe.com/doi/full/10.1027/1016-9040/a000511)</sup> Quantitative diary data are hierarchically nested (repeated observations within people), which violates the independence-of-errors assumption of ordinary regression, so multilevel modeling is the current standard <sup>[7](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)</sup>; current guidance is to model autocorrelated residuals to avoid inflated type I error.<sup>[1](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)</sup>\n\n## Origin\n\nDiary research has precursors in early social investigations of how working men spent their time and how poor London households managed their money.<sup>[11](https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf)</sup> In psychology, the modern method grew out of studies in which participants responded to randomly signaling pagers, a procedure that became known as experience sampling.<sup>[14](https://pmc.ncbi.nlm.nih.gov/articles/PMC2773515/)</sup> The method later entered human-computer interaction through a methods book and a conference paper that presented the paper diary study as a middle-ground solution to the opposing limitations of laboratory studies and field studies.<sup>[15](https://cmci.colorado.edu/~palen/palen_papers/palen-diarystudy.pdf)</sup>\n\nHarry T. Reis and Ladd Wheeler described the event-, interval-, and signal-contingent protocol typology in their 1991 chapter on the Rochester Interaction Record in Advances in Experimental Social Psychology.<sup>[16](https://doi.org/10.1016/s0065-2601%2808%2960332-9)</sup> Niall Bolger, Angelina Davis, and Eshkol Rafaeli consolidated diary methods in a 2003 Annual Review of Psychology review covering designs, electronic data collection, and multilevel analysis.<sup>[17](https://doi.org/10.1146/annurev.psych.54.101601.145030)</sup> Bill Gaver, Tony Dunne, and Elena Pacenti introduced cultural probes in 1999 in interactions.<sup>[18](https://doi.org/10.1145/291224.291235)</sup>\n\n## Variants\n\nThe terminology overlaps heavily: experience sampling, ecological momentary assessment, ambulatory assessment, daily diaries, and intensive longitudinal methods describe a single family of frequent in-situ self-report designs.<sup>[1](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)</sup><sup> • </sup><sup>[14](https://pmc.ncbi.nlm.nih.gov/articles/PMC2773515/)</sup> ESM is described as a structured diary method in which subjects report thoughts, feelings, symptoms, and context in normal daily life.<sup>[8](https://journals.sagepub.com/doi/full/10.1177/25152459241267912)</sup>\n\nAdjacent formats serve different purposes. Cultural probes supply participants with prompts or tools such as cameras or diaries to capture experiences in context.<sup>[18](https://doi.org/10.1145/291224.291235)</sup><sup> • </sup><sup>[19](https://researchportal.northumbria.ac.uk/ws/portalfiles/portal/167298099/01_Manuscript_29_.pdf)</sup> Mobile diary apps, rooted in mobile and digital ethnography, let researchers run remote qualitative studies via smartphones, collecting photos, videos, and notes.<sup>[19](https://researchportal.northumbria.ac.uk/ws/portalfiles/portal/167298099/01_Manuscript_29_.pdf)</sup> Voice-mail diaries replaced writing with phone calls.<sup>[15](https://cmci.colorado.edu/~palen/palen_papers/palen-diarystudy.pdf)</sup> Time diaries, which reconstruct a full day's activities, compare well with EMA: in two population-based samples, both methods gave similar estimates of moments at home and in the workplace, but EMA overestimated moments spent alone, likely because of moment selection bias.<sup>[20](https://pmc.ncbi.nlm.nih.gov/articles/PMC13095234/)</sup>\n\n## Applications\n\nIn organizational research, diary studies capture workplace experience in natural settings, covering experience-sampling, event-sampling, and other daily-assessment designs.<sup>[3](https://d-nb.info/1097268829/34)</sup> In mental health, a scoping review identified 48 qualitative diary papers, most using paper diaries (n = 30), with others using email, online survey software, mobile phones, or a custom website.<sup>[13](https://econtent.hogrefe.com/doi/full/10.1027/1016-9040/a000511)</sup> In UX research, diary studies reveal long-term user behavior that single sessions miss, typically with 10–15 participants over a few days to a few months.<sup>[9](https://maze.co/collections/user-research/diary-research/)</sup>\n\nThe field is scaling and automating. Published ILM research grew from a single paper in 1980 to more than 1,600 in 2024.<sup>[1](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)</sup> Taewan Kim and colleagues reported MindfulDiary, an LLM-driven conversational journaling app for psychiatric patients with a clinician dashboard, in 2023 on arXiv.<sup>[21](https://doi.org/10.48550/arxiv.2310.05231)</sup> CLEA collects qualitative health data through a WhatsApp chat agent twice weekly for 12 weeks and did not show the longitudinal drop-off typical of EMA, though its conversational structure limits high-frequency sampling.<sup>[22](https://journals.plos.org/digitalhealth/article?id=10.1371%2Fjournal.pdig.0001216)</sup> In one psychiatric application, 108 participants recorded about one minute of daily audio diary for two weeks, and six LLMs scored five psychopathology domains from the transcripts, with zero-shot scoring validated for both between-person differences and within-person day-to-day fluctuations.<sup>[23](https://www.cambridge.org/core/journals/psychological-medicine/article/scalable-contextsensitive-psychiatric-assessment-with-large-language-models-and-brief-diaries/ACA28FF39E1981FF67F8F9B34C2B9034)</sup>\n\n## Limitations and alternatives\n\nReactivity and anticipation are inherent to prompting, which is why some researchers choose semi-random schedules.<sup>[4](https://link.springer.com/article/10.1186/s12874-018-0579-6)</sup> Intervals that are too long in interval-contingent designs increase retrospection and undercut the method's core advantage.<sup>[12](https://uk.sagepub.com/sites/default/files/upm-assets/145283_book_item_145283.pdf)</sup> Paper diaries can get lost, forgotten, or be read by others, and must be returned.<sup>[13](https://econtent.hogrefe.com/doi/full/10.1027/1016-9040/a000511)</sup> Lengthy protocols degrade data quality: as total item count grew in one program of social-interaction diaries, the correlation between two measures increased, suggesting participants rated without answering thoughtfully.<sup>[7](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)</sup> Missingness is most damaging when it depends systematically on the phenomenon, as when a patient fails to rate anxiety during extreme panic.<sup>[24](https://ppw.kuleuven.be/okp/_pdf/Dejonckheere2021DAESS.pdf)</sup> Repeated-measures data also show an initial elevation bias, stronger for negative states and physical symptoms; omitting the first two or three observations is suggested as a remedy.<sup>[1](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)</sup> Most published ESM studies use convenience samples <sup>[5](https://www.psychologicalscience.org/journals/ampps/25152459261453933/)</sup>, and logging over time produces fatigue, shorter entries, and dropout.<sup>[9](https://maze.co/collections/user-research/diary-research/)</sup>\n\nCompared with interviews, diary data show less memory decay: a comparison of interview and diary data from the same participants found evidence of memory decay in the interviews.<sup>[25](https://journals.sagepub.com/doi/10.1177/14707853231222139)</sup> Time diaries are preferable for full-day activity reconstruction.<sup>[20](https://pmc.ncbi.nlm.nih.gov/articles/PMC13095234/)</sup>\n\n## References\n\n1. [Intensive Longitudinal Methods (Annual Review of Psychology, vol. 77)](https://www.annualreviews.org/docserver/fulltext/psych/77/1/annurev-psych-040325-025418.pdf?expires=1781266232&id=id&accname=guest&checksum=9A5B9E1C7B62AC5A48E4EB4DF73961D3)\n2. [DiaryHelper: Exploring the Use of an Automatic Contextual Information Recording Agent for Elicitation Diary Study](https://ar5iv.labs.arxiv.org/html/2404.19738)\n3. [Diary studies in organizational research: an introduction and some practical recommendations (Ohly et al., Journal of Personnel Psychology)](https://d-nb.info/1097268829/34)\n4. [A qualitative approach to guide choices for designing a diary study (BMC Medical Research Methodology)](https://link.springer.com/article/10.1186/s12874-018-0579-6)\n5. [Mapping Methodological Variation in Experience-Sampling Research From Design to Data Analysis: A Systematic Review (AMPPS)](https://www.psychologicalscience.org/journals/ampps/25152459261453933/)\n6. [Designing Diary Study Entries (NN/g)](https://www.nngroup.com/articles/diary-study-entries/)\n7. [Diary Studies in Social and Personality Psychology: An Introduction With Some Recommendations and Suggestions (Nezlek, Social Psychological Bulletin)](https://spb.psychopen.eu/index.php/spb/article/download/2679/2679.html?inline=1)\n8. [So You Want to Do ESM? 10 Essential Topics for Implementing the Experience-Sampling Method (AMPPS)](https://journals.sagepub.com/doi/full/10.1177/25152459241267912)\n9. [How to plan and run a UX diary study in 5 steps (Maze)](https://maze.co/collections/user-research/diary-research/)\n10. [Diary Studies: Understanding Long-Term User Behavior and Experiences (NN/g)](https://www.nngroup.com/articles/diary-studies/)\n11. [Using Diary Methods in Psychological Research (Iida, Shrout, Laurenceau & Bolger, APA Handbook of Research Methods in Psychology, Ch. 15)](https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf)\n12. [Qualitative Diary Methods (Sage book chapter)](https://uk.sagepub.com/sites/default/files/upm-assets/145283_book_item_145283.pdf)\n13. [Qualitative Diary Methods in Mental Health Research: A Scoping Review (European Psychologist)](https://econtent.hogrefe.com/doi/full/10.1027/1016-9040/a000511)\n14. [Experience Sampling Methods: A Modern Idiographic Approach to Personality Research](https://pmc.ncbi.nlm.nih.gov/articles/PMC2773515/)\n15. [Voice-Mail Diary Studies for Naturalistic Data Capture under Mobile Conditions](https://cmci.colorado.edu/~palen/palen_papers/palen-diarystudy.pdf)\n16. [Studying Social Interaction with the Rochester Interaction Record (Advances in experimental social psychology, 1991)](https://doi.org/10.1016/s0065-2601%2808%2960332-9)\n17. [Niall Bolger, Angelina Davis, Eshkol Rafaeli (2002). Diary Methods: Capturing Life as it is Lived. Annual Review of Psychology.](https://doi.org/10.1146/annurev.psych.54.101601.145030)\n18. [Bill Gaver, Tony Dunne, Elena Pacenti (1999). Design: Cultural probes. interactions.](https://doi.org/10.1145/291224.291235)\n19. [Exploring the Potential of Off-The-Shelf Tools as Digital Probes: Appropriation of a Mobile Diary App](https://researchportal.northumbria.ac.uk/ws/portalfiles/portal/167298099/01_Manuscript_29_.pdf)\n20. [Comparing Ecological Momentary Assessments and Time Diary Methods for Measuring Daily Life (Sociological Methodology)](https://pmc.ncbi.nlm.nih.gov/articles/PMC13095234/)\n21. [Kim, Taewan and colleagues (2023). MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling. arXiv (Cornell University).](https://doi.org/10.48550/arxiv.2310.05231)\n22. [Conversational, Longitudinal, Ecological Assessment (CLEA): Exploring a new AI-driven method for qualitative data collection in a behavioural health context (PLOS Digital Health)](https://journals.plos.org/digitalhealth/article?id=10.1371%2Fjournal.pdig.0001216)\n23. [Scalable, context-sensitive psychiatric assessment with large language models and brief diaries (Psychological Medicine)](https://www.cambridge.org/core/journals/psychological-medicine/article/scalable-contextsensitive-psychiatric-assessment-with-large-language-models-and-brief-diaries/ACA28FF39E1981FF67F8F9B34C2B9034)\n24. [Designing an experience sampling study (Dejonckheere & Erbas, 2021, Open Handbook of ESM)](https://ppw.kuleuven.be/okp/_pdf/Dejonckheere2021DAESS.pdf)\n25. [Diary studies in research: More than a research method (International Journal of Market Research)](https://journals.sagepub.com/doi/10.1177/14707853231222139)\n\n---\n*Topic: Encyclopedia › Physical world and mathematics › General science and scientific practice › Research methods and experimental design › Ethnographic and field research*\n\n*Initially written Sep 29, 2026 · Edited: Oct 15, 2026*\n\n*Copyright 2026 EdgeChat AI, a subsidiary of Biostate AI.*\n\nLicense: Edgepedia Community License 1.0, https://www.edgepedia.org/edgepedia/license\n",
 "same_as": [
  "https://www.columbia.edu/~nb2229/docs/Iida,%20Shrout,%20Laurenceau%20&%20Bolger%20%282012%29.pdf",
  "https://cmci.colorado.edu/~palen/palen_papers/palen-diarystudy.pdf"
 ],
 "url": "https://www.edgepedia.org/diary-study",
 "markdown_url": "https://www.edgepedia.org/diary-study.md",
 "license": {
  "name": "Edgepedia Community License 1.0",
  "url": "https://www.edgepedia.org/edgepedia/license",
  "summary": "Free with credit, commercial use included. AI training is open to everyone. For other uses, organizations over USD 100M in revenue or 100M monthly users license separately.",
  "spdx": "LicenseRef-Edgepedia-Community-1.0"
 },
 "credit": "\"Diary study\", Edgepedia (EdgeChat), https://www.edgepedia.org/diary-study. Edgepedia Community License 1.0.",
 "credit_md": "\"[Diary study](https://www.edgepedia.org/diary-study)\", Edgepedia (EdgeChat), [https://www.edgepedia.org/diary-study](https://www.edgepedia.org/diary-study). [Edgepedia Community License 1.0](https://www.edgepedia.org/edgepedia/license).",
 "credit_html": "\"<a href=\"https://www.edgepedia.org/diary-study\">Diary study</a>\", Edgepedia (EdgeChat), <a href=\"https://www.edgepedia.org/diary-study\">https://www.edgepedia.org/diary-study</a>. <a href=\"https://www.edgepedia.org/edgepedia/license\">Edgepedia Community License 1.0</a>.",
 "speakable": "A diary study is a qualitative, quantitative, or mixed research method in which participants record experiences and behaviors in daily life over days to months, reducing retrospection bias."
}