|
| | BRIEF REPORT | | | | | Year : 2009 | Volume : 75 | Issue : 5 | Page : 488-491 | Accuracy of references cited in articles published in Indian Journal of Dermatology, Venereology and Leprology: A pilot study
Sanjay Singh, Rahul Chaudhary
Department of Dermatology, Institute of Medical Sciences, Banaras Hindu University, Varanasi, India
| Date of Web Publication | 3-Sep-2009 | Correspondence Address:
Sanjay Singh
C-9, New Medical Enclave, Banaras Hindu University, Varanasi - 221005
India
DOI: 10.4103/0378-6323.55392 PMID: 19736428 Background: Progress in science takes place when investigators build on the work of others. Therefore, in scientific communications, it is very important that others' work is correctly noted and understood. Cited references have been found to be inaccurate in every journal in which they have been examined. Aim: To analyze references cited in articles published in Indian Journal of Dermatology, Venereology and Leprology for their citation and quotation precision as an indicator of the quality of articles. Methods: Twelve citation and five quotation errors were identified and defined. Fifty cited references were selected randomly from the May-June 2008 issue of the journal. For these citations, we obtained 44 full texts of papers and two abstracts. In one case, only citation errors could be verified from the Internet. Three citations of books could not be verified. Thus, citation errors were examined in 47 and quotation errors in 46 citations. Results: Thirteen cited references (28.3%; 95% confidence interval [CI] 15.3-41.3%) were error-free. Twenty-eight citations (59.6%; 95% CI 45.5-73.6%) contained citation errors and 20 (43.5%; 95% CI 29.2-57.8%) quotation errors. Conclusion: Results of this pilot study suggest that improving accuracy of the references is important. Solutions to this problem are suggested.
Keywords: Citation errors, Quotation errors, Reference accuracy
How to cite this article:
Singh S, Chaudhary R. Accuracy of references cited in articles published in Indian Journal of Dermatology, Venereology and Leprology: A pilot study. Indian J Dermatol Venereol Leprol 2009;75:488-91 |
How to cite this URL:
Singh S, Chaudhary R. Accuracy of references cited in articles published in Indian Journal of Dermatology, Venereology and Leprology: A pilot study. Indian J Dermatol Venereol Leprol [serial online] 2009 [cited 2014 Mar 6];75:488-91. Available from: http://www.ijdvl.com/text.asp?2009/75/5/488/55392 |
| Introduction | |  |
Science advances gradually by the hard work of many investigators. Usually the work of an investigator builds on that of others. Sir Isaac Newton famously said, 'If I have seen further, it is by standing on the shoulders of giants.' The lists of references at the end of articles testify to this fact. In order to build on others' work, it is important that their work is correctly noted and interpreted. Only then it would be possible to draw reasonable conclusions. In the present work, we analyzed references cited in articles published in the Indian Journal of Dermatology, Venereology and Leprology (IJDVL) for their accuracy with regard to citation (bibliographic accuracy) and quotation (whether the claimed assertion was correct) as one indicator of the quality of published articles. Such analysis has not been performed for this journal earlier.
| Methods | | |
In the May-June 2008 issue of IJDVL, a total of 440 references have been cited. We did not include references cited in the E-IJDVL section (net study, net case, net letters, net quiz) of the journal. Out of the 440 references cited, we randomly selected 50 references using an online random number generator. [1] For these references, we were able to obtain 44 complete articles and two abstracts from local library, DELNET facility of the India International Center Library and the Internet. Additionally, in one case, only the citation precision could be verified from the Internet, as the abstract and paper were not obtainable. Three citations referred to books, which were unobtainable. Thus, we examined citation precision in 47 references and quotation precision in 46 references cited in the journal.
We identified and defined different citation and quotation errors [Table 1] and [Table 2]. These errors were partially based on and modified from earlier similar work done in Public Health journals. [2] Among the citation errors, errors C1-C4 were considered major because their presence made locating the cited paper difficult. Following were not considered errors: missing '-' between two words, and use of capital letters. Among the quotation errors, errors Q1-Q4 were considered major because they led to misinterpretation of the cited reference. All citations and quotations were verified against the original. If a single reference was cited more than once in the paper, all quotations were verified.
| Results | | |
Results are shown in [Table 1] and [Table 2]. Out of the cited references examined, there were 13 references (28.3%; 95% confidence interval [CI] 15.3-41.3%) that did not contain any error. More than one error was present in 22 citations. Fifteen cited references contained both citation and quotation errors, 13 contained only citation errors, and 5 contained only quotation errors. There were a total of 50 citation errors (three major) and 25 quotation errors (21 major) [Table 3]. Major citation errors were present in two (4.3%, 95% confidence interval [CI] -1.5-10.0%) references and major quotation errors in 18 (39.1%, 95% CI 25.0-53.2%).
The most common citation imprecision was C8 (error in author's initial or title), which was present 19 times. This was followed by C12 (spelling or grammatical mistake in title or journal name, present 15 times), and C10 (incomplete title of paper, present seven times). Out of the quotation imprecision, Q1 (assertion not in the cited reference) was present most frequently (11 times). This was followed by Q4 (oversimplification or overgeneralization, present six times); and Q2 (assertion contradicted by reference) and Q5 (secondary reference), each present four times. With regard to Q5, we did not check the primary reference and, therefore, cannot tell whether the assertion attributed to the secondary reference was correct or incorrect.
| Discussion | | |
List of references in the end of an article is a very important part of any publication. This is so because the cited references form the basis on which the reported work intends to build on. Therefore, it is very important that the cited references are correct bibliographically, as well as assertions attributed to them are accurate. Unfortunately, cited references have been found to be inaccurate in every journal in which they have been examined. In the present work, we analyzed a randomly selected sample of reference citations in papers published in May-June 2008 issue of IJDVL. We examined 47 cited references for citation errors and 46 for quotation errors. We found that 13 cited references (28.3%; 95% CI 15.3-41.3%) were error-free.
Previous studies have also found a high error rate in reference citations. These studies have analyzed references from different medical specialties, such as Anatomy, [3] Public Health, [2] Ophthalmology, [4] Radiology, [5] General Medicine, [6] Emergency Medicine, [7] Surgery [8] and Dermatology, [9],[10] among others. There is no reason to believe that reference citations are likely to contain more errors in one medical specialty than others. Also, as these papers have aimed to detect somewhat different errors, the error rates cannot be compared. However, in the only two studies published in dermatology literature, one showed that only 36% references were error-free. [9] The overall rate of citation errors was 41% and that of quotation errors was 35%. In the other study, [10] the overall rate of citation errors was 29% and that of the quotation errors was 21%. Obviously the problem of reference imprecision is not confined to IJDVL, but is widespread. Although the presence of errors in references is one indication of the quality of published articles, the quality of a journal cannot be evaluated or compared with other journals by these numbers only. These numbers do, however, tell that a problem exists and that it is important to improve the reference accuracy.
If a reference contains citation errors, it becomes difficult for the interested reader to obtain full text of the paper. On the other hand, if a quotation error is present, the base on which the entire work intends to build on becomes questionably quoted. The conclusions drawn from such a paper may lose some of their meaningfulness. Consequently, it becomes clearly important that references are correctly cited and quoted.
Probable causes of errors in references may include oversight, rush to publish, or the creating of pressure by believing in the concept of 'publish or perish'. However, these reasons hardly justify the presence of errors. Despite the persistent problem of reference errors, no effective solutions appear to have emerged. Although it may be impossible to develop a foolproof system that ensures reference accuracy, checks can be performed at the following points: the authors, the editors, and the referees. To minimize such errors, the International Committee of Medical Journal Editors asks authors to verify references against the original documents. [11] It would be really hard on referees if one expects them to check every reference from papers they are reviewing. One solution could be that, on receiving an article, editors randomly select a few references cited in the submitted paper and ask authors to send full texts of these papers to them after highlighting assertions quoted in the submitted paper. Then the submitted paper, along with these full texts of selected cited references, may be sent to referees. This system is likely to reduce errors as authors would be more careful in citing and quoting references. Other probable solutions could be to ask authors to submit the first pages of cited references, to limit the number of references and to electronically check citations from the respective journal websites, rather than PubMed, which being a secondary source may contain a few errors. Efforts are desirable to improve the accuracy of references cited in the scientific literature.
| References | | |
| 1. | Urbaniak GC, Plous S. Research randomizer. Available from: http://www.randomizer.org/form.htm. [accessed on 2008 Sep 30].  | | 2. | Eichorn P, Yankauer A. Do authors check their references? A survey of accuracy of references in three public health journals. Am J Public Health 1987;77:1011-2. | | 3. | Lukic IK, Lukic A, Gluncic V, Katavic V, Vucenik V, Marusic A. Citation and quotation accuracy in three anatomy journals. Clin Anat 2004;17:531-3. | | 4. | Buchan JC, Norris J, Kuper H. Accuracy of referencing in the ophthalmic literature. Am J Ophthalmol 2005;140:1146-8. [PUBMED] [FULLTEXT] | | 5. | Hansen ME, McIntire DD. Reference citations in radiology: accuracy and appropriateness of use in two major journals. Am J Roentgenol 1994;163:719-23. | | 6. | Siebers R, Holt S. Accuracy of references in five leading medical journals. Lancet 2000;356:1445. [PUBMED] [FULLTEXT] | | 7. | Raja UY, Cooper JG. How accurate are the references in emergency medical journal? Emerg Med J 2006;23:625-6. [PUBMED] [FULLTEXT] | | 8. | Reddy MS, Srinivas S, Sabanayagam N, Balasubramanian SP. Accuracy of references in general surgical journals-an old problem revisited. Surgeon 2008;6:71-5. [PUBMED] | | 9. | George PM, Robbins K. Reference accuracy in the dermatologic literature. J Am Acad Dermatol 1994;31:61-4. [PUBMED] | | 10. | Lee SY, Lee JS. A survey of reference accuracy in two asian dermatologic journals (the journal of dermatology and the Korean journal of dermatology). Int J Dermatol 1999;38:357-60. [PUBMED] [FULLTEXT] | | 11. | International committee of medical journal editors. Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication. Available from: http://www.icmje.org/#prepare. [accessed on 2008 Nov 21]. |
[Table 1], [Table 2], [Table 3]
| This article has been cited by | | 1 | References in the Indian Journal of Pathology and Microbiology: Are they accurate | | | Panduranga, C., Kirtilaxmi, K.B. | | Indian Journal of Pathology and Microbiology. 2012; 55(1): 135-137 | | [Pubmed] | | | 2 | Survey of the relationship between article citations of dental school faculty and status of publishing hi dentistry journals | | | Hamissi, J., Gholami, S. | | Asian Journal of Information Technology. 2011; 10(7): 286-289 | | [Pubmed] | | | 3 | The virtues of correct citation: Careful referencing is important but is often neglected even in peer reviewed articles | [Den referenzen reverenz erweisen: Korrektes zitieren ist eine wissenschaftliche tugend, aber auch in begutachteten artikeln nicht selbstverständlich] | | | Mertens, S., Baethge, C. | | Deutsches Arzteblatt. 2011; 108(33): 550-552 | | [Pubmed] | |
| | | |
