{ "id": "epbwyaxkt6", "slug": "cloze-test", "title": "Cloze test", "updated": "2026-10-15", "topic_path": [ { "id": "society", "label": "Society and history", "api_url": "https://www.edgepedia.org/api/v1/topics/society" }, { "id": "society.people", "label": "Social life and human behavior", "api_url": "https://www.edgepedia.org/api/v1/topics/society.people" }, { "id": "society.people.psychology", "label": "Psychology and behavior", "api_url": "https://www.edgepedia.org/api/v1/topics/society.people.psychology" }, { "id": "society.people.psychology.psychometrics-intelligence", "label": "Psychometrics and intelligence", "api_url": "https://www.edgepedia.org/api/v1/topics/society.people.psychology.psychometrics-intelligence" }, { "id": "society.people.psychology.psychometrics-intelligence.language-and-neuropsychological-tests", "label": "Language and neuropsychological tests", "api_url": "https://www.edgepedia.org/api/v1/topics/society.people.psychology.psychometrics-intelligence.language-and-neuropsychological-tests" } ], "geo": [ { "id": "geo.nongeo.t1800.society.people", "label": "Non-geographic · 1800 to 1945: Social life and human behavior", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.society.people", "path": [ { "id": "geo.nongeo", "label": "Non-geographic", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo" }, { "id": "geo.nongeo.t1800", "label": "Non-geographic · 1800 to 1945", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800" }, { "id": "geo.nongeo.t1800.society", "label": "Society and history", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.society" }, { "id": "geo.nongeo.t1800.society.people", "label": "Social life and human behavior", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.society.people" } ] } ], "excerpt": "A cloze test is a fill-in-the-blank assessment in which readers restore words deleted from a passage, introduced by Wilson L. Taylor in 1953 to measure readability, comprehension, and language proficiency.", "snippet": "A cloze test is a fill-in-the-blank assessment in which readers restore words deleted from a passage, introduced by Wilson L. Taylor in 1953 to measure readability, comprehension, and language proficiency.", "node": "society.people.psychology.psychometrics-intelligence.language-and-neuropsychological-tests", "markdown": "# Cloze test\n\nA cloze test is a fill-in-the-blank assessment in which words are deleted from a passage and readers must restore them, used in psychology, education, and language testing to measure reading comprehension and language proficiency.[1](https://arxiv.org/pdf/2403.01456) Because restoration depends on grammar, vocabulary, and discourse knowledge simultaneously, scores have been treated as measures of overall language ability; a 2025 meta-analysis proposes reframing the format as a versatile intelligence test rather than solely a language measure.[2](https://ideas.repec.org/a/eee/intell/v113y2025ics0160289625000650.html)\n\n| Key fact | Detail |\n|---|---|\n| Origin | Introduced by Wilson L. Taylor in 1953 in *Journalism Quarterly*, as a readability tool[3](https://doi.org/10.1177/107769905303000401) |\n| Core task | Restore words deleted by a systematic rule (e.g., every fifth word) or by the test developer's choice[4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf) |\n| Deletion rates | Fixed-ratio deletion (every nth word, typically n = 5 to 7) or rational deletion of chosen word types[5](https://files.eric.ed.gov/fulltext/ED050893.pdf) • [6](https://link.springer.com/article/10.1186/2229-0443-3-15) |\n| Scoring | Exact-word, semantically acceptable-word, or frequency-weighted scoring; semantic scoring is more reliable[7](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf) |\n| Reliability range | Reported estimates span 0.31 to 0.95 across studies[7](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf) |\n| Intelligence correlations | r = .54 with crystallized, r = .48 with fluid, r = .61 with general intelligence[2](https://ideas.repec.org/a/eee/intell/v113y2025ics0160289625000650.html) |\n| Named variants | Fixed-ratio, rational, multiple-choice, discourse cloze, C-test, deep cloze[6](https://link.springer.com/article/10.1186/2229-0443-3-15) • [8](https://doi.org/10.1007/s11145-021-10230-w) |\n\n## How it works\n\nThe name comes from [Gestalt psychology](https://www.edgepedia.org/gestalt-psychology)'s concept of \"closure,\" the tendency to complete a familiar but not-quite-finished pattern; Taylor pronounced \"cloze\" like the verb \"close.\"[4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf) His definition describes intercepting a message from a transmitter (writer or speaker), mutilating its language patterns by deleting parts, and giving it to receivers (readers or listeners) whose attempts to restore the patterns yield scorable responses.[5](https://files.eric.ed.gov/fulltext/ED050893.pdf)\n\nIn building the procedure Taylor drew on Miller's work in communication theory, Osgood's \"dispositional mechanisms,\" and the principles of statistical random sampling.[5](https://files.eric.ed.gov/fulltext/ED050893.pdf) Unlike sentence-completion tests, cloze blanks are contextually interrelated and sampled mechanically rather than pre-selected to carry specific information.[4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf)\n\n## How it is done\n\nConstruction starts with passage selection, then a deletion rule. In Taylor's protocol, an equal number of words is deleted from each passage by an essentially random counting-out system, based on a table of random numbers or by counting out every nth word (every fifth one, for example); each deletion is replaced with a standard-length blank.[4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf) He found every-fifth-word deletions successful for measuring readability provided a passage contained more than 16 blanks, and he arrived at that rate rather arbitrarily.[5](https://files.eric.ed.gov/fulltext/ED050893.pdf) A later account describes his recommendation as every nth word with n ranging from 5 to 7.[6](https://link.springer.com/article/10.1186/2229-0443-3-15)\n\nScoring determines what a correct answer is. In cloze readability testing, a response is scored correct only when it exactly matches the deleted word.[9](https://files.eric.ed.gov/fulltext/ED010983.pdf) Semantic (acceptable-word) scoring also accepts responses that are grammatically and semantically appropriate, judged against the requirements of the whole discourse context or of the local sentence.[10](https://sage.cnpereading.com/doi/10.1177/0265532219840382) A frequency-weighted system, clozentropy, scores each response by how often native speakers give it; a simpler three-tier weighting (3 points exact, 2 for synonyms, 1 for the correct word class) correlated .99 with exact scoring, so the extra effort was judged not worthwhile.[7](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf) • [5](https://files.eric.ed.gov/fulltext/ED050893.pdf)\n\nScoring and deletion choices measurably change reliability. A meta-analysis of 24 ESL/EFL studies found mean reliability of .74 for semantic scoring versus .64 for exact scoring, with semantic-scoring estimates more stable (.60 to .97) than exact-scoring estimates (.14 to .99).[10](https://sage.cnpereading.com/doi/10.1177/0265532219840382) Deletion pattern also matters: rational deletion showed the highest mean reliability (M = 0.80), the eighth-word deletion pattern the lowest, and pattern effects were statistically significant, F(10, 174) = 4.921, p < .001.[7](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf)\n\n## Origin\n\nWilson L. Taylor introduced the cloze procedure in 1953, in \"Cloze Procedure\": A New Tool for Measuring Readability, published in *Journalism Quarterly* and first presented briefly at a workshop of the 1953 AEJ convention.[3](https://doi.org/10.1177/107769905303000401) • [4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf) He is generally credited as the father of the procedure; earlier completion-type exercises had used selective deletion of high-content words, whereas Taylor required systematic, mechanical deletion.[5](https://files.eric.ed.gov/fulltext/ED050893.pdf) The method was extended to measuring reading comprehension for native speakers.[11](https://www.hawaii.edu/sls/wp-content/uploads/2014/09/McKameyTreela.pdf) Research on cloze for testing the reading proficiency of native speakers of English began appearing, and the procedure spread through reading and second-language research from there.[12](https://ijls.net/sample/71-1.pdf)\n\n## Variants\n\nFour construction procedures can be applied to the same text, and a comparison published in *Language Testing* in 1990 by Carol A. Chapelle and Roberta G. Abraham found they produced tests of similar reliability but distinct difficulty and different patterns of correlation with other tests.[13](https://doi.org/10.1177/026553229000700201)\n\n- **Fixed-ratio cloze** deletes words by a fixed pattern (e.g., every seventh word), sampling both locally constrained and long-range constrained words.[14](https://okt.kmf.uz.ua/atc/oktat-atc/Bakalavr/MELT/Readings_III-5/Chapelle_&_Abraham_1990_cloze_method.pdf)\n- **Rational cloze** lets the test developer control which word types are deleted, shifting the construct toward whatever the deletions target.[14](https://okt.kmf.uz.ua/atc/oktat-atc/Bakalavr/MELT/Readings_III-5/Chapelle_&_Abraham_1990_cloze_method.pdf)\n- **Multiple-choice cloze** changes the response mode from production to selection among options.[14](https://okt.kmf.uz.ua/atc/oktat-atc/Bakalavr/MELT/Readings_III-5/Chapelle_&_Abraham_1990_cloze_method.pdf)\n- **C-test** deletes the second half of every other word in short text segments, yielding a test of more grammatical and less textual competence.[14](https://okt.kmf.uz.ua/atc/oktat-atc/Bakalavr/MELT/Readings_III-5/Chapelle_&_Abraham_1990_cloze_method.pdf)\n- **Discourse cloze** applies deletions across longer connected text.[6](https://link.springer.com/article/10.1186/2229-0443-3-15)\n- **Deep cloze**, introduced by Katrine Lyskov Jensen and Carsten Elbro in 2022, deletes words whose restoration requires global inference about the situation described, not just the local sentence.[8](https://doi.org/10.1007/s11145-021-10230-w)\n\n## Applications\n\nTaylor's original application was readability: the passage with the highest number of correctly restored words is judged the most readable.[4](https://gwern.net/doc/psychology/writing/1953-taylor.pdf) In language testing, cloze has been evaluated as an integrative measure of EFL proficiency, including as a possible substitute for essays on college entrance examinations; despite debate over what is actually measured, published comparisons favor a positive view of the cloze test as an effective measure.[15](https://onlinelibrary.wiley.com/doi/10.1111/j.1467-1770.1991.tb00609.x) In cognitive psychology, the 2025 meta-analysis of 89 studies (N = 37,912; k = 634 effect sizes) covering 110 years of research found average correlations of r = .54 (95% CI [.49, .59], k = 485) with crystallized intelligence, r = .48 (95% CI [.42, .54], k = 69) with fluid intelligence, and r = .61 (95% CI [.46, .77], k = 32) with general intelligence.[2](https://ideas.repec.org/a/eee/intell/v113y2025ics0160289625000650.html)\n\n## Limitations and alternatives\n\nReported reliabilities span the spectrum from 0.31 to 0.95, so a cloze test's quality depends heavily on its construction and scoring.[7](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf) Scores may reflect the method itself rather than the intended reading comprehension construct, a problem of method bias.[16](https://journals.sagepub.com/doi/10.1177/2158244019832706) Several researchers have proposed cloze and its variations as measures of crystallized intelligence, indicating that the construct measured may be knowledge-based rather than pure comprehension.[16](https://journals.sagepub.com/doi/10.1177/2158244019832706) The standard format is also limited to local textuality: comprehension assessment with cloze is understood as reaching the conceptual world of the encoder, but skills beyond those accessible by cloze cannot be directly tapped.[17](https://www.jbe-platform.com/content/journals/10.1075/itl.64.04fol) The deep cloze test was designed to address this limitation by targeting global situational understanding; in follow-up work, students' language background, word recognition, and working memory each explained unique variance in deep cloze scores.[18](https://link.springer.com/article/10.1007/s11145-024-10521-y)\n\nSince 2023, large language models have entered both item generation and scoring research. The nCloze method generates cloze tests automatically with pedagogically aligned training objectives, reaching a Pearson correlation of 0.6347 with teacher-created CLOTH tests (nCloze-m) and Spearman-Brown split-half reliability of 0.6708 (nCloze-m) and 0.7592 (nCloze-r); notably, rational deletion did not help that method, placing it last in validity despite having the highest reliability.[19](https://aclanthology.org/2024.naacl-long.220.pdf)\n\n\n## References\n\n1. [Controlling Cloze-test Question Item Difficulty with PLM-based Surrogate Models for IRT Assessment (arXiv, 2024)](https://arxiv.org/pdf/2403.01456)\n2. [Cloze test performance and cognitive abilities: A comprehensive meta-analysis (Intelligence, 2025)](https://ideas.repec.org/a/eee/intell/v113y2025ics0160289625000650.html)\n3. [Wilson L. Taylor (1953). “Cloze Procedure”: A New Tool for Measuring Readability. Journalism Quarterly.](https://doi.org/10.1177/107769905303000401)\n4. [\"Cloze Procedure\": A New Tool for Measuring Readability (Taylor, 1953)](https://gwern.net/doc/psychology/writing/1953-taylor.pdf)\n5. [Cloze Procedure: Literature Review (ERIC ED050893)](https://files.eric.ed.gov/fulltext/ED050893.pdf)\n6. [Doubts on the validity of correlation as a validation tool in second language testing research: the case of cloze testing](https://link.springer.com/article/10.1186/2229-0443-3-15)\n7. [A Meta-Analysis of Second Language Cloze Testing Research (Watanabe & Koyama)](https://manoa.hawaii.edu/sls/manoa-sls-migration/sls/wp-content/uploads/2014/09/Watanabe_Koyama.pdf)\n8. [Katrine Lyskov Jensen, Carsten Elbro (2022). Clozing in on reading comprehension: a deep cloze test of global inference making. Reading and Writing.](https://doi.org/10.1007/s11145-021-10230-w)\n9. [ERIC document ED010983 on cloze readability testing](https://files.eric.ed.gov/fulltext/ED010983.pdf)\n10. [Cloze testing for comprehension assessment: The HyTeC-cloze (Language Testing, 2019)](https://sage.cnpereading.com/doi/10.1177/0265532219840382)\n11. [Developments in Cloze Testing (University of Hawai'i at Manoa)](https://www.hawaii.edu/sls/wp-content/uploads/2014/09/McKameyTreela.pdf)\n12. [My twenty-five years of cloze testing research: So what? (International Journal of Language Studies)](https://ijls.net/sample/71-1.pdf)\n13. [Carol A. Chapelle, Roberta G. Abraham (1990). Cloze method: what difference does it make?. Language Testing.](https://doi.org/10.1177/026553229000700201)\n14. [Cloze method: what difference does it make? (Chapelle & Abraham, 1990, Language Testing)](https://okt.kmf.uz.ua/atc/oktat-atc/Bakalavr/MELT/Readings_III-5/Chapelle_&_Abraham_1990_cloze_method.pdf)\n15. [The Cloze Test as an Integrative Measure of EFL Proficiency: A Substitute for Essays on College Entrance Examinations? (Language Learning, 1991)](https://onlinelibrary.wiley.com/doi/10.1111/j.1467-1770.1991.tb00609.x)\n16. [Method Bias in Cloze Tests as Reading Comprehension Measures (SAGE Open)](https://journals.sagepub.com/doi/10.1177/2158244019832706)\n17. [A Rationale for the Cloze Procedure (ITL, John Benjamins)](https://www.jbe-platform.com/content/journals/10.1075/itl.64.04fol)\n18. [Gaining a deeper understanding of the deep cloze reading comprehension test (Reading and Writing, 2024)](https://link.springer.com/article/10.1007/s11145-024-10521-y)\n19. [Pedagogically Aligned Objectives Create Reliable Automatic Cloze Tests (NAACL 2024)](https://aclanthology.org/2024.naacl-long.220.pdf)\n\n---\n*Topic: Encyclopedia › Society and history › Social life and human behavior › Psychology and behavior › Psychometrics and intelligence › Language and neuropsychological tests*\n\n*Initially written Sep 29, 2026 · Edited: Oct 15, 2026*\n\n*Copyright 2026 EdgeChat AI, a subsidiary of Biostate AI.*\n\nLicense: Edgepedia Community License 1.0, https://www.edgepedia.org/edgepedia/license\n", "same_as": [], "url": "https://www.edgepedia.org/cloze-test", "markdown_url": "https://www.edgepedia.org/cloze-test.md", "license": { "name": "Edgepedia Community License 1.0", "url": "https://www.edgepedia.org/edgepedia/license", "summary": "Free with credit, commercial use included. AI training is open to everyone. For other uses, organizations over USD 100M in revenue or 100M monthly users license separately.", "spdx": "LicenseRef-Edgepedia-Community-1.0" }, "credit": "\"Cloze test\", Edgepedia (EdgeChat), https://www.edgepedia.org/cloze-test. Edgepedia Community License 1.0.", "credit_md": "\"[Cloze test](https://www.edgepedia.org/cloze-test)\", Edgepedia (EdgeChat), [https://www.edgepedia.org/cloze-test](https://www.edgepedia.org/cloze-test). [Edgepedia Community License 1.0](https://www.edgepedia.org/edgepedia/license).", "credit_html": "\"Cloze test\", Edgepedia (EdgeChat), https://www.edgepedia.org/cloze-test. Edgepedia Community License 1.0.", "speakable": "A cloze test is a fill-in-the-blank assessment in which readers restore words deleted from a passage, introduced by Wilson L. Taylor in 1953 to measure readability, comprehension, and language proficiency." }