TY - JOUR
T1 - Assessing the Reporting of Reliability in Published Content Analyses
T2 - 1985-2010
AU - Lovejoy, Jennette
AU - Watson, Brendan R.
AU - Lacy, Stephen
AU - Riffe, Daniel
PY - 2014/7
Y1 - 2014/7
N2 - Content analysis is a common research method employed in communication studies. An important part of content analysis is establishing the reliability of the coding protocol, and reporting must be detailed enough to allow for replication of methodological procedures. This study employed a content analysis of published content analysis articles (N=581) in three communication journals over a 26-year period to examine changes in reliability sampling procedures and reporting of reliability coefficients across time. Findings indicate that general improvements have been made in the detail of reporting reliability, in the practice of reporting reliability coefficients that take chance into consideration, and in the reporting of reliability coefficients for more than one variable. However, explaining the reliability sampling process and use of a probability or census reliability sample did not change over time. In recent years, the preponderance of articles did not explain the reliability sampling method or report a reliability coefficient for all key study variables, and few utilized a census or probability sampling frame. Implications are discussed and recommendations made for reporting of reliability in content analysis.
AB - Content analysis is a common research method employed in communication studies. An important part of content analysis is establishing the reliability of the coding protocol, and reporting must be detailed enough to allow for replication of methodological procedures. This study employed a content analysis of published content analysis articles (N=581) in three communication journals over a 26-year period to examine changes in reliability sampling procedures and reporting of reliability coefficients across time. Findings indicate that general improvements have been made in the detail of reporting reliability, in the practice of reporting reliability coefficients that take chance into consideration, and in the reporting of reliability coefficients for more than one variable. However, explaining the reliability sampling process and use of a probability or census reliability sample did not change over time. In recent years, the preponderance of articles did not explain the reliability sampling method or report a reliability coefficient for all key study variables, and few utilized a census or probability sampling frame. Implications are discussed and recommendations made for reporting of reliability in content analysis.
UR - http://www.scopus.com/inward/record.url?scp=84906355031&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84906355031&partnerID=8YFLogxK
U2 - 10.1080/19312458.2014.937528
DO - 10.1080/19312458.2014.937528
M3 - Article
AN - SCOPUS:84906355031
SN - 1931-2458
VL - 8
SP - 207
EP - 221
JO - Communication Methods and Measures
JF - Communication Methods and Measures
IS - 3
ER -