{ "id": "epjgghpd93", "slug": "citation-analysis", "title": "Citation analysis", "updated": "2026-10-15", "topic_path": [ { "id": "physical", "label": "Physical world and mathematics", "api_url": "https://www.edgepedia.org/api/v1/topics/physical" }, { "id": "physical.science", "label": "General science and scientific practice", "api_url": "https://www.edgepedia.org/api/v1/topics/physical.science" }, { "id": "physical.science.peer_review_publishing", "label": "Peer review, journals, and scientific publishing", "api_url": "https://www.edgepedia.org/api/v1/topics/physical.science.peer_review_publishing" } ], "geo": [ { "id": "geo.nongeo.t1800.physical", "label": "Non-geographic · 1800 to 1945: Physical world and mathematics", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.physical", "path": [ { "id": "geo.nongeo", "label": "Non-geographic", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo" }, { "id": "geo.nongeo.t1800", "label": "Non-geographic · 1800 to 1945", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800" }, { "id": "geo.nongeo.t1800.physical", "label": "Physical world and mathematics", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1800.physical" } ] }, { "id": "geo.nongeo.t1946.physical.science.peer_review_publishing", "label": "Non-geographic · 1946 to 2000: Peer review, journals, and scientific publishing", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science.peer_review_publishing", "path": [ { "id": "geo.nongeo", "label": "Non-geographic", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo" }, { "id": "geo.nongeo.t1946", "label": "Non-geographic · 1946 to 2000", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946" }, { "id": "geo.nongeo.t1946.physical", "label": "Physical world and mathematics", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical" }, { "id": "geo.nongeo.t1946.physical.science", "label": "General science and scientific practice", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science" }, { "id": "geo.nongeo.t1946.physical.science.peer_review_publishing", "label": "Peer review, journals, and scientific publishing", "api_url": "https://www.edgepedia.org/api/v1/geo/geo.nongeo.t1946.physical.science.peer_review_publishing" } ] } ], "excerpt": "Citation analysis is a bibliometric method that measures scholarly influence and maps research fields by examining citations among publications, originating with Eugene Garfield's 1955 citation index proposal.", "snippet": "Citation analysis is a bibliometric method that measures scholarly influence and maps research fields by examining citations among publications, originating with Eugene Garfield's 1955 citation index proposal.", "node": "physical.science.peer_review_publishing", "markdown": "# Citation analysis\n\nCitation analysis is a bibliometric method that examines the citations among publications to measure scholarly influence, map the structure of research fields, and evaluate journals, authors, and institutions. Its techniques fall into two categories: performance analysis, which assesses the contributions of research constituents, and science mapping, which focuses on the relationships between them.[1](https://www.sciencedirect.com/science/article/abs/pii/S0148296321003155) Its origin lies in [Eugene Garfield](https://www.edgepedia.org/eugene-garfield)'s 1955 proposal of a citation index for scientific literature; the impact factor, developed afterward, is a journal-level citation measure used for journal evaluation, not a measure of an individual article's influence.[2](https://doi.org/10.1126/science.122.3159.108) Practitioners retrieve citation data chiefly from [Web of Science](https://www.edgepedia.org/web-of-science), Scopus, and the open index OpenAlex, and analyze it with software such as [VOSviewer](https://www.edgepedia.org/vosviewer) and CiteSpace.[3](https://www.casrai.org/guides/citation-network-analysis)\n\n| Key fact | Detail |\n|---|---|\n| Two branches | Performance analysis (contributions of constituents) and science mapping (relationships between them) [1](https://www.sciencedirect.com/science/article/abs/pii/S0148296321003155) |\n| Origin | Garfield's 1955 Science proposal, modeled on Shepard's Citations (in use since 1873) [2](https://doi.org/10.1126/science.122.3159.108) |\n| Core database | The 1977 Science Citation Index edition held 7.4 million references to 3.8 million items from 2655 journals and 1400 other sources [4](https://garfield.library.upenn.edu/ci/chapter2.pdf) |\n| Co-citation | The frequency with which two documents are cited together, formalized by Henry Small in 1973 [5](https://doi.org/10.1002/asi.4630240406) |\n| Field normalization | Mean normalized citation score = actual over expected citations; sold as Category Normalized Citation Impact (InCites) and Field Weighted Citation Impact (Scopus, SciVal) [6](https://arxiv.org/pdf/1801.09985) |\n| Journal impact factor | For a JCR year, citations made in that year to items published in the preceding two years, divided by the number of citable items published in those two years; proprietary to Clarivate [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC8504821/) |\n| Open data shift | Average citations per publication: Scopus 35.9, Web of Science 32.4, OpenAlex 28.5 [8](https://link.springer.com/article/10.1007/s11192-026-05638-6) |\n\n## How it works\n\nA citation is a directed link from a citing publication to a cited one, recorded in the citing paper's reference list. **Two assumptions** underlie evaluative use: that the most-cited works are those most important to the research, and that citations indicate influence.[9](https://journals.sagepub.com/doi/full/10.1177/10439862231170972) Both are contested. Authors cite for many scientific and non-scientific reasons, so a highly cited paper cannot be assumed highly influential.[10](https://pmc.ncbi.nlm.nih.gov/articles/PMC4613388/) A citation link is not an endorsement; papers are cited critically, in passing, or as required background rather than as genuine intellectual influence.[3](https://www.casrai.org/guides/citation-network-analysis) Database selection reflects a concentration regularity: Garfield's Law of Concentration holds that a small core of journals, 10 to 20 percent, accounts for 80 to 90 percent of what is cited, and it underlies Web of Science content selection.[11](https://services.anu.edu.au/files/system/indicators-handbook.pdf)\n\n## How it is done\n\nScience-map construction follows a five-step workflow: data collection, pre-processing and cleaning, network extraction, normalization, and visualization.[12](https://iris.unito.it/retrieve/76ced7b6-29de-4f1a-8d1b-28b8558f6f27/Petrovich_Science%20maps_academia_version.pdf) Cleaning is pivotal because results depend on data quality; homonym authors must be disambiguated and authors publishing under multiple name variants merged.[13](https://research.gold.ac.uk/id/eprint/26859/1/Zupic%20Cater%202015%20-%20Bibliometric%20methods%20in%20management%20and%20organization.pdf) Raw co-citation frequencies reflect unit size rather than similarity, so they are normalized with measures such as the cosine, the association strength used in VOSviewer, the inclusion index, and the [Jaccard index](https://www.edgepedia.org/jaccard-index); Pearson's correlation is a global alternative whose reliability has been contested.[12](https://iris.unito.it/retrieve/76ced7b6-29de-4f1a-8d1b-28b8558f6f27/Petrovich_Science%20maps_academia_version.pdf) Clustering the network yields field structures; a systematic comparison of methods found map equation methods perform best overall.[14](https://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0154404) A published biomedical protocol illustrates the sequence: retrieve and clean Web of Science records, visualize trends and collaboration networks in [CiteSpace](https://www.edgepedia.org/citespace), map co-authorship, co-citation, and keyword co-occurrence in VOSviewer, then analyze highly cited publications, defined as the top 10 percent within the chosen window.[15](https://doi.org/10.1016/j.xpro.2024.103269)\n\n## Origin\n\nCounting citations to evaluate literature predates computers: P. L. K. Gross and E. M. Gross used citation counts in their 1927 study of college libraries and chemical education.[16](https://doi.org/10.1126/science.66.1713.385) Garfield's 1955 Science paper proposed a citation index for science on the model of Shepard's Citations, the legal citation tool published since 1873.[2](https://doi.org/10.1126/science.122.3159.108) W. C. Adair published a proposal for citation indexes of scientific literature in American Documentation the same year.[17](https://doi.org/10.1002/asi.5090060105) Pilot work established practicality: the 1961 Genetics Citation Index, derived from 600 journals covered by Current Contents,[4](https://garfield.library.upenn.edu/ci/chapter2.pdf) and, by 1963, more than one million citations processed at the Institute for Scientific Information under NSF and NIH sponsorship.[18](https://onlinelibrary.wiley.com/doi/10.1002/asi.5090140304) ISI then published the Science Citation Index on a continuing annual basis.[4](https://garfield.library.upenn.edu/ci/chapter2.pdf) [Derek J. de Solla Price](https://www.edgepedia.org/derek-j-de-solla-price)'s 1965 Science paper analyzed networks of scientific papers, bringing citation data into quantitative studies of science.[19](https://doi.org/10.1126/science.149.3683.510) Garfield, Irving H. Sher, and Richard J. Torpie showed in 1964 how citation data can reconstruct the temporal development of scientific ideas, the historiograph.[20](https://doi.org/10.21236/ad0466578)\n\n## Variants\n\n**Bibliographic coupling**, introduced by M. M. Kessler in 1963, links two documents that share one or more references; the link is intrinsic to the documents and static.[21](https://doi.org/10.1002/asi.5090140103) • [22](https://www.ugr.es/~benjamin/TRI/citation-analysis.pdf) **Co-citation**, introduced by Henry Small in 1973, links two documents cited together in later papers; the link is extrinsic and dynamic, valid only while the co-citation continues.[5](https://doi.org/10.1002/asi.4630240406) • [22](https://www.ugr.es/~benjamin/TRI/citation-analysis.pdf) Small defined co-citation frequency as the size of the intersection of the two citing sets: if A is the set of papers citing document a and B the set citing b, the frequency is \\( n(A \\cap B) \\), with a relative version \\( n(A \\cap B) \\div n(A \\cup B) \\).[5](https://doi.org/10.1002/asi.4630240406) Which technique better indicates subject similarity is unsettled: Small found bibliographic coupling less reliable than co-citation, while Boyack and Klavans found coupling slightly outperforms co-citation and that a hybrid of references and title/abstract words improves further.[23](https://www.isko.org/cyclo/citation_analysis)\n\n## Applications\n\nEvaluative bibliometrics applies citation counts, impact factors, and field-normalized indicators to scientists, universities, and countries; citation analysis also supports information retrieval and mapping of the micro- and macrostructure of disciplines.[22](https://www.ugr.es/~benjamin/TRI/citation-analysis.pdf) Journal evaluation remains a major use.[24](https://doi.org/10.1126/science.178.4060.471) Science maps visualize the structure of a research area from co-citation, coupling, or co-authorship networks.[12](https://iris.unito.it/retrieve/76ced7b6-29de-4f1a-8d1b-28b8558f6f27/Petrovich_Science%20maps_academia_version.pdf) In literature discovery, seed-based tools such as Litmaps, ResearchRabbit, Connected Papers, and Inciteful traverse citation graphs, and OpenAlex and [Semantic Scholar](https://www.edgepedia.org/semantic-scholar) expose citation data through free APIs.[3](https://www.casrai.org/guides/citation-network-analysis) Citation context analysis supports rigorous literature reviews by showing how the knowledge claims of a source work are used, empirically examined, or critically challenged by later authors.[25](https://journals.sagepub.com/doi/10.1177/1094428120969905) [Performance](https://www.edgepedia.org/performance) studies commonly flag highly cited publications as the top 10 percent within a defined window.[15](https://doi.org/10.1016/j.xpro.2024.103269)\n\nThe journal impact factor is, for a JCR year, the citations made in that year to items a journal published in the preceding two years divided by the number of citable items published in those two years; it is proprietary to Clarivate Analytics and published in [Journal Citation Reports](https://www.edgepedia.org/journal-citation-reports).[7](https://pmc.ncbi.nlm.nih.gov/articles/PMC8504821/) The h-index assigns a researcher the value h when at least h publications have received at least h citations each; it is skewed toward older papers, ignores authorship position, is vulnerable to self-citation, and should not be compared across fields.[11](https://services.anu.edu.au/files/system/indicators-handbook.pdf) • [7](https://pmc.ncbi.nlm.nih.gov/articles/PMC8504821/) **Field-normalized indicators** correct for differences between fields in publication, collaboration, and citation practices.[6](https://arxiv.org/pdf/1801.09985) The normalized citation score is the ratio of actual to expected citations, where expected citations equal the field-and-year average; averaged over a unit it becomes the mean normalized citation score.[6](https://arxiv.org/pdf/1801.09985) Recursive indicators include the Eigenfactor and the [SCImago Journal Rank](https://www.edgepedia.org/scimago-journal-rank).[6](https://arxiv.org/pdf/1801.09985) Source normalized impact per paper (SNIP) was introduced by Henk F. Moed in 2010[26](https://doi.org/10.1016/j.joi.2010.01.002) and modified by Ludo Waltman and colleagues in 2013.[27](https://doi.org/10.1016/j.joi.2012.11.011)\n\n## Limitations and alternatives\n\nCitation analysis faces at least five significant shortcomings: it is limited to academic interest, citing motivations conflict, the data can be manipulated, author ordering is not accounted for, and non-indexed journals are excluded.[9](https://journals.sagepub.com/doi/full/10.1177/10439862231170972) Any journal's impact factor is primarily determined by citations to a small fraction, 10 to 30 percent, of its articles, so it is not a valid measure of an individual article's impact.[10](https://pmc.ncbi.nlm.nih.gov/articles/PMC4613388/) It can also be manipulated: editors may restructure publication types, reduce denominator items, solicit citations, or favor reviews, which consistently receive more citations than original research.[7](https://pmc.ncbi.nlm.nih.gov/articles/PMC8504821/) Citations depend on factors beyond merit, including field, publication age, document type, and database coverage; field normalization is sensitive to how fields are defined, with broad fields mixing subfields of different citation density and narrow fields carrying large error margins.[28](https://journals.plos.org/plosbiology/article?id=10.1371%2Fjournal.pbio.1002542) Coverage is uneven: Scopus includes cited references only for documents published from 1970 onward, and [Google Scholar](https://www.edgepedia.org/google-scholar) publishes little about its coverage.[9](https://journals.sagepub.com/doi/full/10.1177/10439862231170972) Citations probably reflect significance more than rigor or originality, and they do not reflect societal impact.[29](https://arxiv.org/pdf/2407.00135) Papers need roughly two to three years after publication for indicators to be reliable.[10](https://pmc.ncbi.nlm.nih.gov/articles/PMC4613388/) [Peer review](https://www.edgepedia.org/peer-review) rarely produces consistent or reproducible results and cannot evaluate large sets, so the bibliometric community recommends indicators as a complement to, not a replacement for, informed peer review;[10](https://pmc.ncbi.nlm.nih.gov/articles/PMC4613388/) peer review's main disadvantages are the expert time it consumes and disagreement and bias among experts.[29](https://arxiv.org/pdf/2407.00135) DORA and CoARA caution against relying on any single citation-based metric, including network position, as a standalone judgment of quality.[3](https://www.casrai.org/guides/citation-network-analysis) The Leiden Manifesto for research metrics, published by Diana Hicks and colleagues in Nature in 2015, codifies principles for responsible indicator use.[30](https://doi.org/10.1038/520429a)\n\n**OpenAlex**, described as a fully open index of scholarly works, authors, venues, institutions, and concepts, was released by Jason Priem in 2022[31](https://doi.org/10.5281/zenodo.7151910) and is now a prominent open challenger to Scopus and Web of Science, supporting transparency and lowering the financial cost of citation analysis.[29](https://arxiv.org/pdf/2407.00135) In a portfolio comparison, publications indexed in Scopus averaged 35.9 citations, in Web of Science 32.4, and in OpenAlex 28.5, the lower OpenAlex figure reflecting broader coverage of less-cited works.[8](https://link.springer.com/article/10.1007/s11192-026-05638-6) The Leiden Ranking Open Edition, launched by CWTS in 2023, is built exclusively on OpenAlex data to increase reproducibility and transparency.[8](https://link.springer.com/article/10.1007/s11192-026-05638-6)\n\n## References\n\n1. [How to conduct a bibliometric analysis: An overview and guidelines (Journal of Business Research)](https://www.sciencedirect.com/science/article/abs/pii/S0148296321003155)\n2. [Eugene Garfield (1955). Citation Indexes for Science. Science.](https://doi.org/10.1126/science.122.3159.108)\n3. [Citation Network Analysis: Co-Citation, Bibliographic Coupling, and Mapping Tools (CASRAI guide)](https://www.casrai.org/guides/citation-network-analysis)\n4. [Garfield, \"A Historical View of Citation Indexing\" (chapter of Citation Indexing)](https://garfield.library.upenn.edu/ci/chapter2.pdf)\n5. [Henry Small (1973). Co‐citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science.](https://doi.org/10.1002/asi.4630240406)\n6. [Field normalization of scientometric indicators (Waltman)](https://arxiv.org/pdf/1801.09985)\n7. [Practical publication metrics for academics (PMC)](https://pmc.ncbi.nlm.nih.gov/articles/PMC8504821/)\n8. [Data source effects in research performance assessment: comparing OpenAlex with established bibliographic databases (Scientometrics)](https://link.springer.com/article/10.1007/s11192-026-05638-6)\n9. [Citation Data and Analysis: Limitations and Shortcomings (SAGE, 2023)](https://journals.sagepub.com/doi/full/10.1177/10439862231170972)\n10. [Bibliometric indicators: opportunities and limits (Journal of the Medical Library Association)](https://pmc.ncbi.nlm.nih.gov/articles/PMC4613388/)\n11. [InCites Indicators Handbook (Clarivate)](https://services.anu.edu.au/files/system/indicators-handbook.pdf)\n12. [Science maps (book chapter, institutional repository copy)](https://iris.unito.it/retrieve/76ced7b6-29de-4f1a-8d1b-28b8558f6f27/Petrovich_Science%20maps_academia_version.pdf)\n13. [Bibliometric Methods in Management and Organization (Zupic & Čater, 2015)](https://research.gold.ac.uk/id/eprint/26859/1/Zupic%20Cater%202015%20-%20Bibliometric%20methods%20in%20management%20and%20organization.pdf)\n14. [Clustering Scientific Publications Based on Citation Relations: A Systematic Comparison of Different Methods (PLOS ONE)](https://journals.plos.org/plosone/article?id=10.1371%2Fjournal.pone.0154404)\n15. [Protocol for conducting bibliometric analysis in biomedicine and related research using CiteSpace and VOSviewer software (STAR Protocols, 2024)](https://doi.org/10.1016/j.xpro.2024.103269)\n16. [P. L. K. Gross, E. M. Gross (1927). College Libraries and Chemical Education. Science.](https://doi.org/10.1126/science.66.1713.385)\n17. [W. C. Adair (1955). Citation indexes for scientific literature?. American Documentation.](https://doi.org/10.1002/asi.5090060105)\n18. [Garfield & Sher, \"New factors in the evaluation of scientific literature through citation indexing,\" American Documentation 14(3):195-201 (July 1963)](https://onlinelibrary.wiley.com/doi/10.1002/asi.5090140304)\n19. [Derek J. de Solla Price (1965). Networks of Scientific Papers. Science.](https://doi.org/10.1126/science.149.3683.510)\n20. [Eugene Garfield, Irving H. Sher, Richard J. Torpie (1964). THE USE OF CITATION DATA IN WRITING THE HISTORY OF SCIENCE. .](https://doi.org/10.21236/ad0466578)\n21. [M. M. Kessler (1963). Bibliographic coupling between scientific papers. American Documentation.](https://doi.org/10.1002/asi.5090140103)\n22. [Citation analysis (Linda C. Smith, Annual Review of Information Science and Technology, 1981)](https://www.ugr.es/~benjamin/TRI/citation-analysis.pdf)\n23. [Citation analysis (IEKO, International Encyclopedia of Knowledge Organization)](https://www.isko.org/cyclo/citation_analysis)\n24. [Eugene Garfield (1972). Citation Analysis as a Tool in Journal Evaluation. Science.](https://doi.org/10.1126/science.178.4060.471)\n25. [Citation Context Analysis as a Method for Conducting Rigorous and Impactful Literature Reviews (SAGE)](https://journals.sagepub.com/doi/10.1177/1094428120969905)\n26. [Henk F. Moed (2010). Measuring contextual citation impact of scientific journals. Journal of Informetrics.](https://doi.org/10.1016/j.joi.2010.01.002)\n27. [Ludo Waltman and colleagues (2013). Some modifications to the SNIP journal impact indicator. Journal of Informetrics.](https://doi.org/10.1016/j.joi.2012.11.011)\n28. [Citation Metrics: A Primer on How (Not) to Normalize (PLOS Biology)](https://journals.plos.org/plosbiology/article?id=10.1371%2Fjournal.pbio.1002542)\n29. [Quantitative Methods in Research Evaluation: Citation Indicators, Altmetrics, and Artificial Intelligence (Thelwall, 2024)](https://arxiv.org/pdf/2407.00135)\n30. [Diana Hicks and colleagues (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature.](https://doi.org/10.1038/520429a)\n31. [Priem, Jason (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. Zenodo (CERN European Organization for Nuclear Research).](https://doi.org/10.5281/zenodo.7151910)\n\n---\n*Topic: Encyclopedia › Physical world and mathematics › General science and scientific practice › Peer review, journals, and scientific publishing*\n\n*Initially written Sep 29, 2026 · Edited: Oct 15, 2026*\n\n*Copyright 2026 EdgeChat AI, a subsidiary of Biostate AI.*\n\nLicense: Edgepedia Community License 1.0, https://www.edgepedia.org/edgepedia/license\n", "same_as": [], "url": "https://www.edgepedia.org/citation-analysis", "markdown_url": "https://www.edgepedia.org/citation-analysis.md", "license": { "name": "Edgepedia Community License 1.0", "url": "https://www.edgepedia.org/edgepedia/license", "summary": "Free with credit, commercial use included. AI training is open to everyone. For other uses, organizations over USD 100M in revenue or 100M monthly users license separately.", "spdx": "LicenseRef-Edgepedia-Community-1.0" }, "credit": "\"Citation analysis\", Edgepedia (EdgeChat), https://www.edgepedia.org/citation-analysis. Edgepedia Community License 1.0.", "credit_md": "\"[Citation analysis](https://www.edgepedia.org/citation-analysis)\", Edgepedia (EdgeChat), [https://www.edgepedia.org/citation-analysis](https://www.edgepedia.org/citation-analysis). [Edgepedia Community License 1.0](https://www.edgepedia.org/edgepedia/license).", "credit_html": "\"Citation analysis\", Edgepedia (EdgeChat), https://www.edgepedia.org/citation-analysis. Edgepedia Community License 1.0.", "speakable": "Citation analysis is a bibliometric method that measures scholarly influence and maps research fields by examining citations among publications, originating with Eugene Garfield's 1955 citation index proposal." }