EFFECTS OF DISCOURSE AND RESPONSE MODE ON THE MEASUREMENT OF WRITING COMPETENCE

Abstract

Journal of Educational MeasurementVolume 19, Issue 4 p. 241-258 EFFECTS OF DISCOURSE AND RESPONSE MODE ON THE MEASUREMENT OF WRITING COMPETENCE EDYS S. QUELLMALZ, Corresponding Author EDYS S. QUELLMALZ Center for the Study of Evaluation University of California, Los Angeles QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this authorFRANK J. CAPELL, Corresponding Author FRANK J. CAPELL Social Action Research Center San Rafael, California QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this authorCHIH-PING CHOU, Corresponding Author CHIH-PING CHOU Center for the Study of Evaluation University of California, Los Angeles QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this author EDYS S. QUELLMALZ, Corresponding Author EDYS S. QUELLMALZ Center for the Study of Evaluation University of California, Los Angeles QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this authorFRANK J. CAPELL, Corresponding Author FRANK J. CAPELL Social Action Research Center San Rafael, California QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this authorCHIH-PING CHOU, Corresponding Author CHIH-PING CHOU Center for the Study of Evaluation University of California, Los Angeles QUELLMALZ, EDYS S. Address: Center for the Study of Evaluation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Senior Research Associate. Degrees: B.A., M.A., Ph.D. University of California at Los Angeles. Specialization: Test design, Instructional theory. CAPELL, FRANK J. Address: Social Action Research Center, San Rafael, CA. Title: Senior Research Analyst. Degrees; B.A. Trenton State University. Specialization: Educational research methodology. CHOU, CHIH-PING. Address: Center for the Study of Evaulation, UCLA Graduate School of Education, Los Angeles, CA 90024. Title: Post-Graduate Research Assistant. Degrees: B.S., M.S. National Taiwan University. Specialization: Research methodology, Statistics.Search for more papers by this author First published: December 1982 https://doi.org/10.1111/j.1745-3984.1982.tb00131.xCitations: 52 This research was supported by a grant to the Center for the Study of Evaluation from the National Institute of Education, United States Department of Education (Grant No. NIE-G-80-0112). However, the opinions and findings expressed here do not necessarily reflect the position or policy of NIE and no official NIE endorsement should be inferred. The work was completed while Frank Capell was on the staff of the Center for the Study of Evaluation, University of California, Los Angeles. AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinkedInRedditWechat REFERENCES ANDERSON, R. C. The notion of schemata and the educational enterprise. In R. C. Anderson, R. J. Spiro & W. E. Montague (Eds.), Schooling and the acquisition of knowledge. Hilisdale , NJ : Lawrence Earlbaum Associates, 1977. BOURNE, L. J. Human conceptual behavior. Boston : Allyn and Bacon, 1966. BRADDOCK, R., LLOYD-JONES, R., & SCHOER, L. Research in written composition. Champaign , IL : National Council of Teachers of English, 1963. BRELAND, H. M. A study of college English placement and the test of standard written English. Princeton , NJ : Educational Testing Service, January 1977. BRELAN D. H. M. & GAYNOR, J. L. A comparison of direct and indirect assessments of writing skill. Journal of Educational Measurement, 1979, 16, 119–128. CAMPBELL, D. T., & FISKE, D. W. Convergent and discriminant validity by the multitraitmultimethod matrix. Psychological Bulletin, 1959, 56, 81–105. COFFMAN, W. E. On the validity of essay tests of achievement. Journal of Educational Measurement, 1966, 3, 151–156. COFFMAN, W. E. Essay exams. In R. L. Thorndike (Ed. ), Educational Measurement( 2nd ed.). Washington , D.C. : American Council on Education, 1971. C. COOPER & L. ODELL (Eds. ) Evaluating writing: Describing, measuring, judging. Buffalo , NY : State University of New York at Buffalo, 1977. CROWHURST, M. Syntactic complexity in narration and argument at three grade levels. CanadiaNJournal of Education, 1980. CROWHURST, M., & PICHE, G. L. Audience and mode of discourse effects on syntactic complexity in writing at two grade levels. Research in the Teaching of English, 1979, 13, 101–109. GODSHALK, F. I., SWINEFORD, F., & COFFMAN, W. E. The measurement of writing ability. New York : College Entrance Examination Board, 1966. GRAESSER, A. C., HAUFT-SMITH, K., COHEN, A. D., & PYLES, D. Familiarity and test genre on retention of prose. Journal of Experimental Education, 1979, 48, 281–290. HOGAN, T. P., & MISHLER, C. Relationships between essay tests and objective tests of language skills for elementary school students. Journal of Educational Measurement, 1980, 17, 219–227. HUNTLEY, R. M., SCHMEISER, C. B., & STIGGENS, R. J. The assessment of rhetorical proficiency: The role of objective tests and writing samples. Presented at the Annual Meeting of the National Council of Measurement in Education, San Francisco, 1979. JORESKOG, K. G. Analyzing psychological data by structural analysis of covariance matrices. In R. C. Atkinson, D. H. Krantz & P. D. Suppes (Eds. ). Contemporary Development in Mathematical Psychology, Vol. II. San Francisco : W. H. Freeman & Co., 1974, 1–56. JORESKOG, K. G., & SORBOM, D. LISREL IV. A general computer program for the estimation of linear structural equation systems by maximum likelihood methods. University of Uppsala, Department of Statistics, 1978. KINNEAVY, J. L. A theory of discourse. The aims of discourse. Englewood Cliffs , NJ : Prentice Hall, Inc., 1971. MCARTHUR, D. L. Detection of item bias using analyses of response pat terns, Paper presented at the Annual Meeting of the American Educational Research Association, New York , 1982. MEYER, B. F. The organization of prose and its effects on memory. North Holland Studies in Theoretical Poetics Vol. I. Amsterdam : North Holland Publishing Company, 1975. MOSS, P. A., COLE, N. S. & KHAMPALIKIT, C. A comparison of procedures to assess written language skills at grades 4, 7, and 10. Journal of Educational Measurement, 1982, 19, 37–48. PERRON, J. D. Written syntactic complexity in modes of discourse. Paper presented at the Annual Meeting of the American Educational Research Association, New York , April 1977. PITTS, M. The relationship of classroom instructional characteristics and writing in the descriptive/narrative mode. Report to the National Institute of Education, November, 1978. (Grant No. OB-NIE-G-78-0213 to the UCLA Center for the Study of Evaluation). PRAETER, D., & PADIA, W. Effects of modes of discourse in writing performance in grades four and six. Paper presented at the Annual meeting of the American Educational Research Association, Boston, 1980. QUELLMALZ, E. Interim Report. Defining writing domains: Effects of discourse and response mode. Report to the National Institute of Education. (Grant No. OB-NIE-G-79-0213 to the UCLA Center for the Study of Evaluation). SANJOSE, C. P. M. Grammatical structures in four modes of writing at the fourth grade level. Unpublished doctoral dissertation, Syracuse University, 1972. Dissertation Abstracts International. 1973, 33, 5411-A. SIMON, H. A. The Sciences of the Artificial( 2nd ed.). Cambridge : MIT Press, 1981. SKINNER, B. F. Teaching machines and programmed learning. New York : Appleton Century Crofts, 1963. SMITH, L. S. Investigation of writing assessment strategies. Report to the National Institute of Education, November, 1978. (Grant No. OB-NIE-G-78-0213 to the UCLA Center for the Study of Evaluation). TRAUB, R. E., & FISHER, C. W. On the equivalence of constructed-response and multiple-choice tests. Applied Psychological Measurement, 1977, 1(3), 355–369. VEAL, L. R., & TILLMAN, M. Mode of discourse variation in the evaluation of children's writing. Research in the Teaching of English, 1971, 5, 37–45. WERTS, C. E., BRELAND, H. M., GRANDY, .I., & ROCK, D. R. Using longitudinal data to estimate reliability in the presence of correlated measurement errors. Educational and Psychological Measurement, 1980, 40, 19–29. WERTS, C. E., JORESKOG, K. G., & LINN, R. L. A multitrait-multimethod model for studying growth. Educational and Psychological Measurement, 1972, 32, 655–678. WlNTERS, L. The effects of differing response criteria on the assessment of writing competence. Report to the National Institute of Education, November, 1978. (Grant No. OB-NIE-G-78-0213 to the UCLA Center for the Study of Evaluation). YATES, A. Distinguishing trait from method variance in fitting the invariant common factor model to observed intercorrelations among personality rating scales. Paper presented at the Annual Meeting of the Society of Multivariate Experimental Psychology, Los Angeles, 1979. Citing Literature Volume19, Issue4December 1982Pages 241-258 ReferencesRelatedInformation