Applying Classical Test Theory to Test Critical Period Hypothesis: The Case of Iranian EFL Learners' Grammatical Performance in a Subject-Verb Test on Agreement

Document Type : Original Article

Authors

1 PhD Graduate of TEFL, Allameh Tabatabe’i University, Tehran, Iran.

2 PhD Graduate of TEFL, IKIU, Qazvin, Iran

3 MA in TEFL, University of Guilan, Rasht, Iran

Abstract

The current paper pursues two aims: to employ Classical Test Theory (CTT) to develop and refine a test, and to determine the impact of the age factor on L2 grammar among Iranian EFL learners, providing evidence for the claim that CTT best evaluates the consistency of measurements in age-related studies. The study examines the performance of adults or teenagers as pre- and post-puberty learners, in the grammar test devised through CTT, to conclude whether younger learners or older ones perform better on subject-verb agreement. Based on random sampling, twenty-three male participants, including 12 adults and 11 adolescents, upper-intermediate native speakers of Persian, took part in the study. They were tested on a 60-item test of grammar (on subject-verb agreement), which has been developed using the CTT model, as it fits small sample sizes and can be used for understanding complex issues (e.g., age-related issues). Other than devising a test on agreement using CTT as a model, the results revealed that post-puberty learners scored better than their younger counterparts, partly because they are cognitively more mature. However, age is not the one and only factor in second language learning, and other factors like individual differences, contextual factors, and methodological rigor should be taken into account. Future work on more CTT-based assessments and developing more tests through adopting longitudinal designs can better shed light on the role of the important factors on grammatical performance, informed by the impact of the age factor.

Keywords

Main Subjects

References

Angoff, William H. Scales, Norms, and Equivalent Scores. ETS, 1971.
Bachman, Lyle F. Fundamental considerations in language testing. Oxford University Press, 1990.
Bachman, Lyle F., and Adrian S. Palmer. Language testing in practice: Designing and developing useful language tests. Oxford University Press, 1996.
Benítez-Burraco, Antonio. "The cognitive science of language diversity: achievements and challenges." Cognitive Processing (2025): 1-18.
Birdsong, David, and Michelle Molis. "On the evidence for maturational constraints in second-language acquisition." Journal of Memory and Language, 44,2, 2001, pp. 235-249.
Brown, James Dean. "Multiple views of L1 writing score reliability." 2007.
Brown, James Dean, and Kathleen M. Bailey. "Language testing courses: What are they in 2007?." Language Testing, 25,3, 2008, pp. 349-383.
Brown, James Dean. Testing in language programs: A comprehensive guide to English language assessment, 2011.
DeKeyser, Robert M. "The Robustness of Critical Period Effects in Second Language Acquisition." Studies in Second Language Acquisition, vol. 22, no. 4, 2000, pp. 499–533. Cambridge University Press, https://doi.org/10.1017/S0272263100004022..
DeKeyser, Robert. "Age effects in second language learning." The Routledge handbook of second language acquisition. Routledge, 2013, pp. 442-460.
DeMars, Christine E. "Classical test theory and item response theory." The Wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development (2018): 49-73.
Dörnyei, Zoltán, and Ema Ushioda. Teaching and researching motivation. Routledge, 2021.
Ekstrand, Lars Henric. "Age and Length of Residence as Variables Related to the Adjustment of Migrant Children, with Special Reference to Second Language Learning." 1975.
Ellis, Rod. SLA research and language teaching. Oxford University Press, 198 Madison Avenue, New York, NY 10016-4314, 2008.
Fathman, Ann. "The relationship between age and second language productive ability." Language learning, 25,2, 1982, pp. 245-253.
Fulcher, Glen, and Davidson, Fred. "Language testing and assessment: An Advanced Resource Book." Oxford: Routledge, 2007.
Geisinger, Kurt F., Bruce A. Bracken, Janet F. Carlson, Jo-Ida C. Hansen, Nathan R. Kuncel, Steven P. Reise, and Michael C. Rodriguez. APA handbook of testing and assessment in psychology, Vol. 2: Testing and assessment in clinical and counseling psychology. American Psychological Association, 2013.
Hakuta, Kenji, Ellen Bialystok, and Edward Wiley. "Critical evidence: A test of the critical-period hypothesis for second-language acquisition." Psychological science, 14,1, 2003, pp. 31-38.
Hartshorne, Joshua K., Joshua B. Tenenbaum, and Steven Pinker. "A critical period for second language acquisition: Evidence from 2/3 million English speakers." Cognition 177 (2018): 263-277.
Holland, Paul W., and Machteld, Hoskens. "Classical test theory as a first-order item response theory: Application to true-score prediction from a possibly nonparallel test." Psychometrika, 68, 2003, pp. 123-149.
Hambleton, Ronald K., and Russell W. Jones. "An NCME instructional module on." Educational measurement: issues and practice 12.3 (1993): 38-47.
Hyltenstam, Kenneth. "Maturational Constraints in SLA." The Handbook of Second Language Acquisition/Blackwell, 2003.
Johnson, Jacqueline S., and Elissa L. Newport. "Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language." Cognitive psychology, 21,1, 1989, pp. 60-99.
Kumaravadivelu, Balasubramanian. Understanding language teaching: From method to postmethod. Routledge, 2006.
Krashen, Stephen D. Issues in second language research. London: Newbury House, 1979.
Krashen, Stephen D., Long, Michael A. and Scarcella, Robin C. “Age, Rate and Eventual Attainment in Second Language Acquisition.” TESOL Quarterly, vol. 13, no. 4, (1979), pp. 573–82. JSTOR, https://doi.org/10.2307/3586451.
Krashen, Stephen D. "Second language acquisition." Second Language Learning, 3,7, 1981, pp. 19-39.
Larsen-Freeman, Diane, and Michael H. Long. An introduction to second language acquisition research. Routledge, 2014.
Larsen‐Freeman, Diane. "Teaching and testing grammar." The handbook of language teaching, 2009, pp. 518-542.
Lenneberg, Eric H. "Biological foundations of language." 1967.
Lightbown, Patsy, Nina Spada, and Robert Wallace. "Some effects of instruction on child and adolescent ESL learners." Research in second language acquisition, 1980, 162-172.
Spada, Nina, and Patsy M. Lightbown. How languages are learned. Oxford University Press, 2006.
Lin, Siyan, Xia Wang, and Yumeng Zhang. "Evaluating the Critical Period Influence on the Development of Semantic Radicals Awareness and Lexical Tones Awareness in Chinese Character Recognition." Lecture Notes in Education Psychology and Public Media, 2, 2023, pp. 662-668.
Liu, Yanyan. “The influence of critical period hypothesis on the second language acquisition.” Lecture Notes in Education Psychology and Public Media, 11, 2023, pp. 26-31. https://doi.org/10.54254/2753-7048/11/20230706
Mayberry, Rachel I., and Elizabeth Lock. "Age constraints on first versus second language acquisition: Evidence for linguistic plasticity and epigenesis." Brain and language, 87,3, 2003, pp. 369-384.
Muñoz, Carmen, and Teresa Cadierno. "How do differences in exposure affect English language learning? A comparison of teenagers in two learning environments." Studies in Second Language Learning and Teaching 11.2 (2021): 185-212.
Oyama, Susan. "A sensitive period for the acquisition of a nonnative phonological system." Journal of psycholinguistic research, 5, 1976, pp. 261-283.
Oyama, Susan. "The sensitive period and comprehension of speech." Child-adult differences in second language acquisition, 3951, 1982.
Patkowski, Mark S. "The sensitive period for the acquisition of syntax in a second language 1." Language learning, 30,2, 1980, pp. 449-468.
Quirk, Randolph, and David Crystal. A comprehensive grammar of the English language. Pearson Education India, 2010.
Rahman, Mohammad Mosiur, et al. "Effect of age in second language acquisition: A critical review from the perspective of critical period hypothesis and ultimate attainment." International Journal of English Linguistics, 7,5, 2017, 1-7.
Richards, Jack C. and Schmidt, Richard. Longman dictionary of language teaching & applied Linguistics (3rd ed.). NY: Pearson Education, 2002.
Singleton, David. "Critical period or general age, Age and the acquisition of English as a foreign language”. Clevedon, 2003, pp. 3-22.
Singleton, David. "Language acquisition: The age factor." Multilingual Matters, 2004.
Singleton, David, and Justyna Leśniewska. "The critical period hypothesis for L2 acquisition: An unfalsifiable embarrassment?." Languages, 6,3, 2021, pp. 149-162.
Stevens, Gillian. "Using census data to test the critical-period hypothesis for second-language acquisition." Psychological Science, 15,3, 2004, pp. 215-216.
Wang, Meihua. "A study on the relationship between age onset of English learning and English achievement." Theory and Practice in Language Studies, 5,1, 2015, pp. 164-178.

Files

History

  • Receive Date: 13 September 2024
  • Revise Date: 26 January 2025
  • Accept Date: 09 February 2025

Share

How to cite

Statistics