Transcript Reliability Cleaning Percentage (TRCP): An Alternative Interrater Reliability Measure of Message Transcripts in Online Learning

Peter K. Oriogun and John Cook

Abstract
In this article, the authors extend previous work with respect to interrater reliability measure of computer-mediated conferencing (CMC), and suggest coding categories relevant to problem-based learning. Calculating inter-rater reliability agreement by using a Transcript Reliability Cleaning Percentage (TRCP) approach is simple for academics with limited mathematical background and can provide insights into the nature of the learning process from the prospective of categorization of online discourse. TRCP enhances interrater reliability (percentage agreement between coders) of the rating of online transcripts.