สถิติกับงานวิทยาเอ็นโดดอนต์ ตอนที่ 2: ความเชื่อถือได้
Keywords:
reliability, inter-rater reliability, intra-rater reliability, kappa, intraclass correlation coefficient.Abstract
This article provides an in-depth exploration of the concept of reliability, its significance, and various methods used for its assessment. Reliability is crucial in research and evaluation as it represents consistency and reproducibility in various contexts. High reliability instills confidence in the research or evaluation outcomes, advancing knowledge in several domains. Conversely, unreliable data can lead to erroneous analyses. Key aspects of reliability discussed include its definition and types. Test-retest reliability focuses on the consistent outcomes of repeated measurements over time. Inter-rater reliability examines the consistency of evaluations between different assessors of the same data, while intra-rater reliability emphasizes the consistency of a single assessor over different times. Various methods to assess reliability, such as percent agreement, Cohen’s kappa, and Intra-Class Correlation (ICC), among others, are also detailed.
References
Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26(4):217-38.
Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155-63.
Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Social Adm Pharm. 2013;9(3):330-8.
Hallgren KA. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutor Quant Methods Psychol. 2012;8(1):23-34.
Stemler S. A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability. Pract Assess Res Eval. 2004;9:1-19.
Lam EWN, Law AS, Nguyen RHN, Basile S, Austah O, Gilbert GH, et al. Interexaminer Agreement in the Radiologic Identification of Apical Periodontitis/Rarefying Osteitis in the National Dental Practice-Based Research Network PREDICT Endodontic Study. J Endod. 2021;47(10):1575-82.
Cohen J. A Coefficient of Agreement for Nominal Scales. Educ Psychol Meas. 1960;20(1):37-46.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biom. 1977;33(1):159-74.
Al-Manei KK. Radiographic Quality of Single vs. Multiple-Visit Root Canal Treatment Performed by Dental Students: A Case Control Study. Iran Endod J. 2018;13(2):149-54.
Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213-20.
Barros de Oliveira ML, Junqueira RB, Kamburoglu K, Eratam N, Cakmak EE, Sonmez G, et al. Assessment of the Metal Artifact Reduction Tool for the Detection of Root Isthmus in Mandibular Molars with Intraradicular Posts in Cone-beam Computed Tomographic Scans. J Endod. 2021;47(10):1583-91.
Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76(5):378.
Siegel S, Castellan NJ. Nonparametric Statistics for the Behavioral Sciences: McGraw-Hill; 1988.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307-10.
Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135-60.
Sutam N, Jantarat J, Ongchavalit L, Sutimuntanakul S, Hargreaves KM. A Comparison of 3 Quantitative Radiographic Measurement Methods for Root Development Measurement in Regenerative Endodontic Procedures. J Endod. 2018;44(11):1665-70.
McGraw K, Wong SP. Forming Inferences About Some Intraclass Correlation Coefficients. Psychological Methods. 1996;1:30-46.
Bujang MA. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Arch Orofac Sci. 2017;12:1-11.
Koppenhaver SL, Parent EC, Teyhen DS, Hebert JJ, Fritz JM. The effect of averaging multiple trials on measurement error during ultrasound imaging of transversus abdominis and lumbar multifidus muscles in individuals with low back pain. J Orthop Sports Phys Ther. 2009;39(8):604-11.
Nagendrababu V, Duncan HF, Fouad AF, Kirkevang LL, Parashos P, Pigg M, et al. PROBE 2023 guidelines for reporting observational studies in endodontics: Explanation and elaboration. Int Endod J. 2023;56(6):652-85.
Nagendrababu V, Duncan HF, Bjorndal L, Kvist T, Priya E, Jayaraman J, et al. PRIRATE 2020 guidelines for reporting randomized trials in Endodontics: a consensus-based development. Int Endod J. 2020;53(6):764-73.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Thai Endodontic Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Thai Endod Journal is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) license, unless otherwise stated. Please read our Policies in Copyright for more information.
