SZodixStudyAcademic Library
ShelvesOpen access
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
The influence of training and experience on rater performance in scoring spoken language
16 references·6 citing·39 second hop
The influence of training and experience on rater performance in scoring spoken language (2015)The influence of training and experience …Testing Second Language Speaking (2014)Testing Second Language Speak…Introduction to Many-Facet Rasch Measurement (2011)Introduction to Many-Facet Ra…Decision by sampling (2006)Decision by samplingAssessing Second Language Writing: The Rater’s Perspective (2005)Assessing Second Language Wri…Applying the Rasch Model: Fundamental Measurement in the Human Sciences (2004)Applying the Rasch Model: Fun…A many-facet Rasch analysis of the second language group oral discussion task (2003)A many-facet Rasch analysis o…Decision Making while Rating ESL/EFL Writing Tasks: A Descriptive Framework (2002)Decision Making while Rating …Using FACETS to model rater training effects (1998)Using FACETS to model rater t…Measuring Second Language Performance (1998)Measuring Second Language Per…Designing Second Language Performance Assessments (1998)Designing Second Language Per…Rater characteristics and rater bias: implications for training (1995)Rater characteristics and rat…The Research Manual: Design and Statistics for Applied Linguistics (1994)The Research Manual: Design a…Effects of training on raters of ESL compositions (1994)Effects of training on raters…The Effect of Raters' Background and Training on the Reliability of Direct Writing Tests (1992)The Effect of Raters' Backgro…Expertise in evaluating second language compositions (1990)Expertise in evaluating secon…The Measurement of Observer Agreement for Categorical Data (1977)The Measurement of Observer A…None of the Above: Integrity Concerns of Standardized English Proficiency Tests (2023)None of the Above: Integrity …The impact of pre-task planning on speaking test performance for English-medium university admission (2019)The impact of pre-task planni…A process for establishing and maintaining inter-rater reliability for two observation instruments as a fidelity of implementation measure: A large-scale randomized controlled trial perspective (2019)A process for establishing an…Teachers’ Judgement Accuracy Concerning CEFR Levels of Prospective University Students (2018)Teachers’ Judgement Accuracy …Evaluating CEFR rater performance through the analysis of spoken learner corpora (2018)Evaluating CEFR rater perform…Building Better Open-Source Tools to Support Fairness in Automated Scoring (2017)Building Better Open-Source T…Protocol Analysis: Verbal Reports as Data (1986)Case Study Research in Education : A Qualitative Approach (1991)Qualitative Data Analysis: An Expanded Sourcebook (1994)Automated Scoring of Complex Tasks in Computer-Based Testing (2006)Rater types in writing performance assessments: A classification approach to rater variability (2008)Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment (2017)Fundamental Considerations in Language Testing (1991)Focus Article: On the Structure of Educational Assessments (2003)Language Testing and Validation (2005)Assessment Literacy for the Language Classroom (2012)A Rating Formulation for Ordered Response Categories (1978)Annual Meeting of the American Educational Research Association (2000)Measuring and promoting inter-rater agreement of teacher and principal performance ratings. (2012)The effect of rater variables in the development of an occupation-specific language performance test (1995)Reliability and validity of rubrics for assessment through writing (2010)The magical number seven, plus or minus two: Some limits on our capacity for processing information. (1956)Prospect Theory: An Analysis of Decision under Risk (1979)Prospect theory: An analysis of decision under risk (1988)Mindful Judgment and Decision Making (2008)Influencing behaviour: The mindspace way (2011)Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources (2019)Expertise in Problem Solving. (1981)The role of knowledge in discourse comprehension: A construction-integration model. (1988)The Psychology of Written Composition (1989)Metalinguistic and Ideational Thinking in Second Language Composing (1990)A Coefficient of Agreement for Nominal Scales (1960)Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. (1994)Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial Reliability and Validity Data (1997)The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. (1998)Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement (2015)RoB 2: a revised tool for assessing risk of bias in randomised trials (2019)The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing (2009)Overview of Classical Test Theory and Item Response Theory for the Quantitative Assessment of Items in Developing Patient-Reported Outcomes Measures (2014)Issues and recommendations for exploratory factor analysis and principal component analysis (2020)Second Language Fluency: Judgments on Different Tasks (2004)Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research (2011)Mixed-methods research in language teaching and learning: Opportunities, issues and challenges (2014)Language Testing and Validation: An Evidence-Based Approach (2004)DEVELOPING ASSESSMENT LITERACY (2009)
this work references cited by second hop

References

  • 1977The Measurement of Observer Agreement for Categorical Data81,000 cited
  • 2004Applying the Rasch Model: Fundamental Measurement in the Human Sciences1,989 cited
  • 1998Measuring Second Language Performance1,253 cited
  • 2006Decision by sampling737 cited
  • 1994The Research Manual: Design and Statistics for Applied Linguistics736 cited
  • 2014Testing Second Language Speaking603 cited
  • 1998Using FACETS to model rater training effects371 cited
  • 1995Rater characteristics and rater bias: implications for training344 cited
  • 1990Expertise in evaluating second language compositions269 cited
  • 2002Decision Making while Rating ESL/EFL Writing Tasks: A Descriptive Framework243 cited
  • 2003A many-facet Rasch analysis of the second language group oral discussion task234 cited
  • 1994Effects of training on raters of ESL compositions208 cited
  • 2011Introduction to Many-Facet Rasch Measurement184 cited
  • 1998Designing Second Language Performance Assessments182 cited
  • 1992The Effect of Raters' Background and Training on the Reliability of Direct Writing Tests175 cited
  • 2005

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

Assessing Second Language Writing: The Rater’s Perspective
160 cited

Cited by

  • 2019The impact of pre-task planning on speaking test performance for English-medium university admission60 cited
  • 2018Evaluating CEFR rater performance through the analysis of spoken learner corpora46 cited
  • 2017Building Better Open-Source Tools to Support Fairness in Automated Scoring45 cited
  • 2018Teachers’ Judgement Accuracy Concerning CEFR Levels of Prospective University Students24 cited
  • 2019A process for establishing and maintaining inter-rater reliability for two observation instruments as a fidelity of implementation measure: A large-scale randomized controlled trial perspective15 cited
  • 2023None of the Above: Integrity Concerns of Standardized English Proficiency Tests3 cited