Uma versão em Português Europeu do C-test
DOI:
https://doi.org/10.21814/diacritica.575Palavras-chave:
C-test, Avaliação, Proficiência, Aprendizagem de português, Português como língua estrangeira (PLE)Resumo
A avaliação da proficiência é uma questão importante na interpretação dos resultados das investigações sobre a aprendizagem de língua segunda. Dados contraditórios entre os estudos podem decorrer dos diferentes procedimentos empregues para avaliar os aprendentes. De modo geral, são consideradas informações institucionais, estimativas baseadas no perfil linguístico e, mais raramente, são utilizados resultados de testes independentes. No presente estudo, foi desenvolvida uma versão portuguesa do C-test, um teste de preenchimento simples utilizado para medira proficiência geral. Elevados coeficientes de Cronbach Alfa e Omega revelaram a fiabilidade do teste. A classificação da proficiência dos aprendentes baseada na pontuação do teste demonstrou uma correlação forte com a avaliação pelos professores (r = 0.74), mostrando que o teste é eficiente para avaliar a proficiência geral. Para além disso, outros parâmetros, nomeadamente nível da turma e autoavaliação dos aprendentes também mostraram uma correlação forte com a avaliação por professores (r = 0.79 e 0.77). A utilização futura do teste é discutida.
Referências
Alderson, J. C. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment. London & New York: Continuum.
Anderson, J. (1992). Automaticity and the ACT theory. The American Journal of Psychology, 105(2), 165–180. DOI: https://doi.org/10.2307/1423026
Babaii, E. & Ansary, H. (2001). The C-test: A valid operationalization of the reduced redundancy principle? System, 29(2), 209–219. DOI: https://doi.org/10.1016/S0346-251X(01)00012-4
Babaii, E. & Moghaddam, M. J. (2006). On the interplay between test task difficulty and macro-level processing in the C-test. System, 34(4), 586–600. https://doi.org/10.1016/j.system.2006.09.002. DOI: https://doi.org/10.1016/j.system.2006.09.002
Baghaei, P. & Tabatabaee, M. (2015). The C-Test: An integrative measure of crystallized intelligence. Journal of Intelligence, 3(2), 46-58. https://doi.org/10.3390/jintelligence3020046. DOI: https://doi.org/10.3390/jintelligence3020046
Bialystock, E. & Smith, M. S. (1985). Interlanguage is not a state of mind: An evaluation of the construct for second-language acquisition. Applied Linguistics, 6(2), 101–117. DOI: https://doi.org/10.1093/applin/6.2.101
Brown, J. (2005). Testing in Language Programs. McGraw-Hill Companies.
Chapelle, C. A. & Abraham, R. (1990). Cloze method: what difference does it make? Language Testing, 7(2), 121–146. DOI: https://doi.org/10.1177/026553229000700201
Cleary, C. (1988). The C-test in English. RELC Journal, 19(2), 26–37. DOI: https://doi.org/10.1177/003368828801900203
Cohen, A. D., Segal, M., & Bar-Siman-To, R. (1984). The C-Test in Hebrew. Language Testing, 1(2), 221–225. https://doi.org/10.1177/026553228400100206. DOI: https://doi.org/10.1177/026553228400100206
Corder, P. (1967). The significance of learner's errors. International Review of Applied Linguistics, 5(1), 161–170. DOI: https://doi.org/10.1515/iral.1967.5.1-4.161
Correia, R. D. Z. (2011). Os erros no discurso escrito de Hispano-Falantes de nível B2 (Dissertação de Mestrado, Universidade de Lisboa).
Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. DOI: https://doi.org/10.1007/BF02310555
Curto, P. (2014). Classificador de textos para o ensino de português como segunda língua (Dissertação de Mestrado, Universidade de Lisboa).
Curto, P., Mamede, N. & Baptista, J. (2014). Automatic readability classifier for European Portuguese. System, 5, 6.
DeKeyser, R. (1997). Beyond explicit rule learning. Studies in Second Language Acquisition, 19(2), 195–222. DOI: https://doi.org/10.1017/S0272263197002040
Eckes, T. & Baghaei, P. (2015). Using Testlet Response Theory to Examine Local Dependence in C-Tests. Applied Measurement in Education, 28(2), 85-98. https://doi.org/10.1080/08957347.2014.1002919. DOI: https://doi.org/10.1080/08957347.2014.1002919
Eckes, T. & Grotjahn, R. (2006). A closer look at the construct validity of C-tests. Language Testing, 23(3), 290–325. https://doi.org/10.1191/0265532206lt330oa. DOI: https://doi.org/10.1191/0265532206lt330oa
Ellis, N. (2015). Implicit and explicit learning.pdf. In P. Rebuschat (Ed.), Implicit and explicit learning of languages (pp. 3–23). Amsterdam: John Benjamins. DOI: https://doi.org/10.1075/sibil.48.01ell
Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language. Studies in Second Language Acquisition, 27(2), 141–172. DOI: https://doi.org/10.1017/S0272263105050096
Firth, A. & Wagner, J. (2007). Second/Foreign Language Learning as a Social Accomplishment: Elaborations on a Reconceptualized SLA. The Modern Language Journal, 91(s1), 800–819. https://doi.org/10.1111/j.1540-4781.2007.00670.x. DOI: https://doi.org/10.1111/j.0026-7902.2007.00670.x
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32(3), 221–233. DOI: https://doi.org/10.1037/h0057532
Grotjahn, R. (2016). The electronic C-Test bibliography: Version 2015. Disponível em: http://www.c-test.de/deutsch/ctest/pdf/C%20Test%20Bibliography/Grotjahn_Electronic_Ctest_Bibliography.pdf.
Grotjahn, R. & Stemmer, B. (2002). C-Tests and language processing.pdf. In J. Coleman, R. Grotjahn, & U. Raatz (Eds.), University language testing and the C-Test (pp. 115–130). Bochum: AKS-Verlag.
Hill, M. & Hill, A. (2008). Investigação por questinário. Edições Sílabo.
Isabel, L. (2006). Léxico, aquisição e leitura do português europeu língua não materna. Lisboa, Portugal: Fundação Calouste Gulbenkian.
Jafarpur, A. (1999). Can the C-test be improved with classical item analysis? System, 27(1), 79–89. DOI: https://doi.org/10.1016/S0346-251X(98)00043-8
Kamimoto, T. (1993). Tailoring the test to fit the students: Improvement of the C-test through classical item analysis. Fukuoka Women’s Junior College Studies, 30(11), 47–61.
Katona, L. & Dornyei, Z. (1993). The C-test. FORUM, 31(2), 35–38.
Khodadady, E. (2014). Construct Validity of C-tests: A Factorial Approach. Journal of Language Teaching and Research, 5(6). https://doi.org/10.4304/jltr.5.6.1353-1362. DOI: https://doi.org/10.4304/jltr.5.6.1353-1362
Klein-Braley, C. (1985). A cloze-up on the C-Test: A study in the construct validation of authentic tests. Language Testing, 2(1), 76-104. DOI: https://doi.org/10.1177/026553228500200108
Klein-Braley, C. (1997). C-Tests in the context of reduced redundancy testing: An appraisal. Language Testing, 14(1), 47–84. DOI: https://doi.org/10.1177/026553229701400104
Krashen, S. (1982). Principles and Practice in Second Language Acquisition. Pergamon Press: Longman.
Lado, R. (1957). Linguistics across cultures. United States of America: The University of Michigan Press.
Lee-Ellis, S. (2009). The development and validation of a Korean C-Test using Rasch Analysis. Language Testing, 26(2), 245–274. https://doi.org/10.1177/0265532208101007. DOI: https://doi.org/10.1177/0265532208101007
Lei, L. (2008). Validation of the C-Test amongst Chinese ESL Learners. THE JOURNAL OF ASIA TEFL, 5(2), 117–140.
Leiria, I. (1991). A aquisição por falantes de Português Europeu língua não materna dos aspectos verbais expressos pelos Pretéritos Perfeito e Imperfeito (Dissertação de Mestrado, Universidade de Lisboa).
Li, S. (2010). The Effectiveness of Corrective Feedback in SLA: A Meta-Analysis: Meta-Analysis of Corrective Feedback. Language Learning, 60(2), 309–365. https://doi.org/10.1111/j.1467-9922.2010.00561.x. DOI: https://doi.org/10.1111/j.1467-9922.2010.00561.x
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174. DOI: https://doi.org/10.1007/BF02296272
McDonough, K. & Kim, Y. (2009). Syntactic Priming, Type Frequency, and EFL Learners’ Production of Wh-Questions. The Modern Language Journal, 93(3), 386–398. https://doi.org/10.1111/j.1540-4781.2009.00897.x. DOI: https://doi.org/10.1111/j.1540-4781.2009.00897.x
Montrul, S., Dias, R. & Santos, H. (2010). Clitics and object expression in the L3 acquisition of Brazilian Portuguese. Second Language Research, 27(1), 21–58. DOI: https://doi.org/10.1177/0267658310386649
Okada, K. (2011). Beyond Cronbach’s alpha: a comparison of recent methods for estimating reliability. The Japanese Journal for Research on Testing, 7(1), 38–50.
Okada, K. (2015). Reliability in psychology and psychological measurement, with focus on Cronbach’s Alpha. The Annual Report of Educational Psychology in Japan, 54(1), 71–83. DOI: https://doi.org/10.5926/arepj.54.71
Pienemann, M. (1998). Language processing and second language development: Processability Theory. Amsterdam: John Benjamins. DOI: https://doi.org/10.1075/sibil.15
Pinto, J. (2014). A aquisição do género e da concordância de género em português língua terceira ou língua adicional. In P. Osório & F. Bertinetti (Eds.), Teorias e Usos Linguísticos. Lisboa: Lidel.
Raatz, U. & Klein-Braley, C. (1981). The C-testa – modification of the cloze procedure. Practice and Problems in Language Testing, University of Essex Department of Language and Linguistics Occasional Papers No. 26.
Raatz, U. & Klein-Braley, C. (2002). Introduction to language and to C-Tests. In James Coleman, R. Grotjahn, & U. Raatz (Eds.), University Language Testing and the C-Test. AKS-Verlag Bochum.
Rodrigues, E. (2015). Concordância de número e gênero em estruturas predicativas no português brasileiro. LinguíStica, 11(1), 135-152.
Samejima, F. (1968). Estimation of latent ability using a response pattern of graded scores. ETS Research Report Series, 1968(1), i-169. DOI: https://doi.org/10.1002/j.2333-8504.1968.tb00153.x
Selinker, L. (1972). Interlanguage. International Review of Applied Linguistics in Language Teaching, 10(1-4), 209-241. DOI: https://doi.org/10.1515/iral.1972.10.1-4.209
Spolsky, B. (1973). What does it mean to know a language; or how do you get somebody to perform his competence? In J. Oller & J. Richards (Eds.), Focus on the learner (pp. 164-176). Newbury House Pub.
Taylor, W. (1953). Cloze procedure - a new tool for measuring readability. Journalism Quarterly, 30(4), 414-438. DOI: https://doi.org/10.1177/107769905303000401
Thomas, M. (1994). Assessment of L2 proficiency in second language acquisition research. Language Learning, 44(2), 307-336. DOI: https://doi.org/10.1111/j.1467-1770.1994.tb01104.x
Thomas, M. (2006). Research synthesis and historiography. In J. Norris & L. Ortega (Eds.), Synthesizing research on language learning and teaching (pp. 279-298). Amsterdam & Philadelphia: John Benjamins Publishing Company. DOI: https://doi.org/10.1075/lllt.13.13tho
Tremblay, A. (2011). Proficiency assessment standard in second language. Studies in Second Language Acquisition, 33(3), 339-372. https://doi.org/10.1017/S0272263111000015. DOI: https://doi.org/10.1017/S0272263111000015
VanPatten, B. (2007). Input processing in adult SLA. In B. VanPatten & J. Williams (Eds.), Theories in second language acquisition: An introduction (pp. 115-135). DOI: https://doi.org/10.4324/9781410615299
Wainer, H. & Kiely, G. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24(3), 185-201. DOI: https://doi.org/10.1111/j.1745-3984.1987.tb00274.x
Wang, W.-C. & Wilson, M. (2005). The Rasch Testlet Model. Applied Psychological Measurement, 29(2), 126-149. https://doi.org/10.1177/0146621604271053. DOI: https://doi.org/10.1177/0146621604271053
Downloads
Publicado
Como Citar
Edição
Secção
Licença
Direitos de Autor (c) 2023 Masayuki Yamada
Este trabalho encontra-se publicado com a Creative Commons Atribuição-NãoComercial 4.0.
