Measuring the reliability of a computer-aided systematic observation instrument.

Abstract

The inter- and intraobserver reliabilities of data collected by observers trained in the use of the coach analysis instrument (CAI) are reported. The CAI is part of the computerized coaching analysis system (CCAS). The CAI collects data related to the learning environment created by the coach in a team/sport practice situation. Both inter- and intraobserver reliabilities are reported for each of the instrument's seven dimensions as well as for the overall instrument. The reliability measures reported are total percent agreement (T) and Cohen's kappa (K). The results indicated that, although the overall coaching analysis instrument reached a T value of 90.8%, it failed to meet the 80% level for the K measure (K = 78.5%). A dimension by dimension examination of the data was undertaken to determine the reasons for these results and it was revealed that the problem was associated with three specific dimensions of the instrument.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 12 citations exist upstream.