Reliability and the ACTFL Oral Proficiency Interview: Reporting Indices of Interrater Consistency and Agreement for 19 Languages

Eric Alan Surface · Erich C. Dierdorff

46 citations0/0 files storedForeign Language Annals

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

EFL/ESL Teaching and Learning Psychometric Methodologies and Testing Reliability and Agreement in Measurement

Abstract

Abstract: The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristics of the assessment. This study provided the most comprehensive analysis of ACTFL OPI reliability to date, reporting interrater consistency and agreement data for 19 different languages. Overall, the interrater reliability of the ACTFL OPI was found to be very high. These results demonstrate the importance of using an OPI assessment program that has a well‐designed interview process, a well‐articulated set of criteria for proficiency determination, a solid rater training program, and an experienced cadre of testers. Based on the data reported, educators and employers who use the ACTFL OPI can expect reliable results and use the scores generated from the testing process with increased confidence. Recommendations for future research are discussed.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 46 citations exist upstream.

References

1979Review of Psychometric theory (2nd ed.).1980Tests for comparing elements of a correlation matrix.1989Educational measurement, 3rd ed.1992Comparing correlated correlation coefficients.2015Educational measurement.2017Standards for Educational and Psychological Testing.1982Psychological Testing: Principles, Applications, and Issues 1987Psychological Testing

Cited by

2010Oral Proficiency Assessment: Current Approaches and Applications for Post‐Secondary Foreign Language Programs 2010The Development of Oral Proficiency During a Semester in Germany 2014Relationships of attitudes toward homework and time spent on homework to course outcomes: The case of foreign language learning.2011The Benefits of Living in Foreign Language Housing: The Effect of Language Use and Second-Language Type on Oral Proficiency Gains 2016Comparing the OPI and the OPIc: The Effect of Test Method on Oral Proficiency Scores and Student Preference 2013

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.