Conference Presentations

2023 Presentations
  • Chen, M. Y. & Flasko, J. J. (2023, Nov). Leveraging generative AI for enhanced content development in language testing: implications for item writer recruitment, training, and engagement. [Oral presentation]. Association for Language Testing and Assessment of Australia and New Zealand (ALTAANZ) Online Conference 2023. [Virtual conference].
  • Chen, M. Y., Edelblut, P., Volkov, A., Wallace, K. & Asbury, T. (2023, June). Exploring the performance of transcript-based automated rating models for speaking tasks. [Work-in-progress presentation]. Language Testing Research Colloquium (LTRC), New York, US.
  • Chen, M. Y., Volkov, A., Wallace, K., & Edelblut, P. (2023, April). Towards AI assisted essay marking: Developing and evaluating automated writing scoring models for a general English proficiency test. [Oral presentation]. Association of Language Testers in Europe (ALTE) International Conference, Madrid, Spain.
2022 Presentations
  • Chen, M. Y., & Flasko, J. J. (2022, March). Challenges and barriers of providing appropriate accommodations: Perspectives from various stakeholder groups. [Work-in-progress presentation]. Language Testing Research Colloquium (LTRC). [Virtual conference].
  • Chen, M. Y., Kuan, L., & Cherry, G. (2022, October). Examining the suitability of live remote proctoring for language proficiency assessments from a psychometric standpoint. [Oral presentation]. 2022 European ATP (E-ATP) conference. London, UK.
  • Lin, Y. (2022, March). Formulaic sequences in advanced native and non-native writing in a standardized English proficiency test. Paper presented at Language Testing Research Conference (LTRC) 2022. [Virtual conference].
2021 Presentations
  • Chen, M. Y., & Asbury, T., Chau, L. H., Tang, W. (2021, October). Evaluating consequential validity by investigating the accuracy of proficiency classifications [Poster presentation]. The East Coast Organization of Language Testers (ECOLT) 2021. [Virtual conference].
  • Chen, M. Y., Asbury, T., Chau, L. H., Tang, W., & Zumbo, B. D. (2021, June). Assessing differential item functioning (DIF) for a large number of groups [Poster presentation]. National Council on Measurement in Education (NCME) annual conference. [Virtual conference] [presentation file].
  • Lin, Y. & Chen, M. Y. (2021, October). Lexical sophistication in advanced l1 and l2 writing in a standardized language proficiency test [Poster presentation]. The East Coast Organization of Language Testers (ECOLT) 2021. [Virtual conference].
2020 Presentations
  • Chen, M. Y. (2020, June). Methods for assessing differential item functioning (DIF) in short scales [Paper presentation]. A Meeting of Methodologies (AMOM) 2020. [Virtual conference].
  • Chen, M. Y. (2020, September). Using scale anchoring to assist the content validity study of large-scale assessments [Paper presentation]. 2020 conference of the National Council on Measurement in Education (NCME). [Virtual conference].
  • Chen, M. Y., & Lin, Y. (2020, March). The effect of repeat test taking on test score and language quality changes in writing. Paper accepted by 2020 conference of the American Association for Applied Linguistics (AAAL). Denver, Colorado. (Conference cancelled)
  • Lin, Y. & Chen, M. Y. (2020, October). Adult test takers’ lexical development: A study of repeaters of a standardized writing proficiency test [Paper presentation]. The East Coast Organization of Language Testers (ECOLT) 2020. [Virtual conference][presentation file].
  • Lin, Y., & Chen, M. Y., (2020, March). A longitudinal analysis of adult test takers’ lexical development: Evidence from a high-stakes standardized writing proficiency test. Poster accepted by 2020 Language Assessment Research Conference (LARC). Provo, Utah. (Conference cancelled)
2019 Presentations
  • Chen, M. Y. (2019, April). Performance and response behaviors in multiple-choice questions: A response process-based validation study. Paper presented at 2019 Annual Meeting of the National Council on Measurement in Education (NCME). Toronto, Ontario.
  • Chen, M. Y., Flasko, J. J., Lin, Y. (2019). The CLB as a resource for test development and validation. Paper will be presented in S. ElAtia & S. Saif (chairs), Implication and challenges of a national framework for bilingual assessment in Canada. Theme session will be held at the 12th International Symposium on Bilingualism (ISB12). Edmonton, Alberta. [presentation file]
  • Flasko, J. & Wallace, K. (2020, Feb). Context matters: Choosing the right language test. Workshop offered at Languages Canada Conference 2020. Vancouver, Canada.
  • Kennedy-Barrows, L. (2019). Testing for fairness: Ensuring the quality and integrity of high-stakes language tests. Paper will be presented at the annual conference of Languages Canada. Winnipeg, MB. Canada. [presentation file]
  • Kennedy-Barrows, L. (2019). CAEL CE: Assessing test takers’ language skills for the academic tasks that lie ahead. Show and tell paper will be presented at the 8th International Conference on Task-Based Language Teaching. Ottawa, ON. Canada. [presentation file]
  • Zumbo, B. D. (2019, October). On Invariance in IRT and CTT: Classical Insights into Modern Approaches, and Modern Insights into Classical Approaches. Keynote address at the Inaugural Tri-University Conference, hosted by the College of Education, University of Washington, Seattle, WA.
2018 Presentations
  • Banerjee, J., Iwashita, N., & Plough, I. (2018). Assessing interactional competence in contexts of movement and change. Paper presented at the Language Testing Research Colloquium. Auckland, New Zealand.
  • Chen, M. Y., Liu, Y., & Zumbo, B. (2018). Testing for differential item functioning in performance assessments. Paper presented at the International Test Commission (ITC) Conference. Montreal, Quebec. [presentation file]
  • Chen, M. Y., Wu, A. D., & Liu, Y. (2018). Are test-takers’ reflection on test-taking processes predictive of their performance on a listening test? Paper presented at the American Educational Research Association Annual Meeting. New York, NY. USA
  • Douglas, S. R., Doe, C., & Cheng, L. (2018). Hindered competence: How interlocutors inhibit workplace communication. Paper presented at the 2018 Annual Conference of Canadian Association of Applied Linguistics. Regina, SK. Canada. [presentation file]
  • Li, Z., Chen, M. Y., & Banerjee, J. (2018). Answer-changing behaviour in multiple-choice questions: Looking beyond the impact of changes. Paper presented at the International Test Commission (ITC) Conference. Montreal, Quebec. [presentation file]
  • Li, Z. (2018). Investigating the consequences of an ESL placement test. Paper presented at the Language Assessment Research Conference. Ames, IA. USA. [presentation file]
  • Li, Z. (2018). Understanding how test takers complete a while-listening performance test: Insights from response time data. Paper presented at the Language Assessment Research Conference, Ames, IA. USA
  • Li, Z. (2018). Does course delivery mode matter? A multidimensional analysis of linguistic variations in lecture scripts from face-to-face courses and MOOCs. Paper presented at the American Association for Applied Linguistics Conference. Chicago, IL. USA. [presentation file]
  • Liu, Y., Wu, A. D., Hubley, A. M., Kim, C., Chen, M. Y., Beliveau, A., & Zumbo, B. D. (2018). Mixed models of item response processes from a social-cognitive perspective. Paper presented at the American Educational Research Association Annual Meeting. New York, NY. USA
  • Payant, C., McDonough, K., & Uludag, P. (2018). The effect of planning on English L2 speakers’ integrated writing CAEL test performance. Paper presented at the 2018 Annual Conference of Canadian Association of Applied Linguistics. Regina, SK. Canada. [presentation file]
  • Plough, I. C., Banerjee, J., & Noriko, I. (2018). The “Inconvenient Truth” of interactional competence. Paper presented at the American Association for Applied Linguistics Conference. Chicago, IL. [presentation file]
  • Pullman, A., Chen, M. Y., Hives, B. A., Zou, D., & Liu, Y. (2018). Similarities and differences in science and technology attitudes in the United States, South Korea, China and Japan. Paper presented at the American Educational Research Association Annual Meeting. New York, NY. USA
  • Wu, A. D., Hu, S.-H, Chen, M. Y., Chau, H. L., & Kroc, E. (2018). A mediated measurement model to investigate whether test scores are invariant to the test-taking strategies. Paper presented at the American Educational Research Association Annual Meeting. New York, NY. USA
2017 Presentations
  • Banerjee, J. (2017). High stakes EAP assessment: Enabling useful score inferences. Paper presented at the TESOL International Conference & English Language Expo. Seattle, WA. USA. [presentation file]
  • Chen, M. Y. (2017). Validating test content and score interpretation through scale anchoring procedures. Poster presented at American Association for Applied Linguistics (AAAL) Conference. Portland, OR, USA.
  • Chen, M.Y., Banerjee, J., & Li, Z. (2017). Reducing the number of options in multiple-choice items: Does the option reduction method matter? Work-in-progress presentation at the 39th Language Testing Research Colloquium. Bogotá, Colombia.
  • Doe, C., & Douglas, S. (2017). May I take your order? The interface between non-professionally regulated workplace contexts and two English language testing constructs. Paper presented at the Seventh CALA/ACEL Annual Symposium. Toronto, Canada. [presentation file]
  • Douglas, S., Doe, C. D., & Cheng, L. (2017). Spoken workplace Language: Perspectives of newcomers from diverse linguistic backgrounds. Paper presented at 2017 Annual Conference of the Canadian Association of Applied Linguistics . Toronto, Canada. [presentation file]
  • Li, Z., Chen, M. Y., & Banerjee, J. (2017). How might test-taker gender affect test-score meaning in a test of writing? Using corpus tools to extend a DIF study. Paper presented at American Association for Applied Linguistics (AAAL) Conference. Portland, OR, USA. [presentation file]
  • Li, Z., Ewatski, C., & Banerjee, J. (2017). Undercover learners in test preparation courses: A test security perspective. Poster presented at 19th Annual Midwest Association of Language Testers (MwALT) Conference, Dayton, OH. USA. [presentation file]
  • Li, Z., Jones, J., & Lodge, S. (2017). Disciplinary differences in university lecture slides as a part of classroom discourse – Findings from corpus-based analysis and multimodal analysis. Paper presented at the 2017 Annual Conference of the Canadian Association of Applied Linguistics. Toronto, Canada. [presentation file]
  • Park, M., & Wu, A. D. L. (2017). Detecting differential options functioning using multinomial logistic regression in SPSS. In 2017 AERA Annual Meeting. San Antonio, TX, USA. [presentation file]
  • Volkov, A., Li, Z., & Banerjee, J. (2017). Speaking proficiency lies in the eye of beholder? A comparison of rating and justifications from university instructors and experienced raters. Paper presented at the Seventh CALA/ACEL Annual Symposium. Toronto, Canada. [presentation file]
  • Zhou, Z., & Li, Z. (2017). Measuring speed, breakdown, and repair fluency in prospective international teaching assistants’ speaking performance. Paper presented at  American Association for Applied Linguistics Conference (AAAL). Portland, OR, USA.
2016 Presentations
  • Chen, M. Y., Lam, W., & Zumbo, B. D. (2016). Testing for differential item functioning with no internal matching variable and continuous item ratings. Poster presented at the Language Testing Research Colloquium (LTRC). Palermo, Italy. (Poster)
  • Chen, M.Y., & Zumbo, B. D. (2016). Regression Methods to Study Differential Item Functioning In the Case of No Internal Matching Variable and Continuous Item Ratings. Poster presented at the annual conference of International Testing Commission (ITC). Vancouver, BC.
  • Doe, C., Douglas, S., & Liying, C. (2016). Mapping Language Use to the CLB and CELPIP-General LS within Workplace Contexts for New Immigrants. Work in Progress presented at the Language Testing Research Colloquium (LTRC). Palermo, Italy.
  • Douglas, S. & Rosvold, M. (2016). Vocabulary used for general writing tasks across proficiency levels. Paper presented at the BC TEAL Annual Conference. Surrey, BC.
  • Dursun, A., & Li, Z. (2016). The current state of argument-based approach to validtion in language testing research. Paper presented at the annual conference of the East Coast Organization of Language Testers (ECOLT). Washington, D.C., USA.
  • Ercikan. K., Chen. M. Y., & Campbell. C. (2016). Validity of interpretation of mathematics and science scores for linguistic minority students. Paper presented at the annual conference of the International Test Commission (ITC). Vancouver, BC.
  • Li, Z., & Volkov, A. (2016). What is Academic English in a Canadian Context, and How Can it be Tested? Paper presented at the annual conference of Languages Canada. Victoria, BC. [presentation file]
  • Li, Z., & Volkov, A. (2016). Investigating the lexical bundles used in an email writing task in an English proficiency test. Paper presented at the annual conference of the Canadian Association of Applied Linguistics (ACLA/CAAL). Calgary, AB. [presentation file]
  • Plough, I. & Banerjee, J. (2016). Revisiting the speaking construct: Multiple perspectives. Symposium presented at the European Association for Language Testing and Assessment (EALTA), Valencia, Spain.
  • Wu, A. D., Chen, M. Y., & Stone, J. E. (2016). Switch in test-taking strategies as responding to increased task difficulty in a reading comprehension test- An application of 3 step latent transition analysis. Paper presented at the annual conference of the International Testing Commission (ITC). Vancouver, BC.
  • Zhou, Z., & Li, Z. (2016). Can fluency predict raters’ decisions? Exploring the relationship between fluency measures and speaking performance of prospective international teaching assistants. Paper presented at the annual Pronunciation in Second Language Learning and Teaching Conference, Calgary, AB.
2015 Presentations
  • Chen, M. Y. (2015). Comparing dimensionality assessment approaches using empirical data: Investigating the dimensionality of CELPIP-G reading test. Poster presented at the Language Testing Research Colloquium. Toronto, ON.
  • Douglas, S. (2015). Characteristics of Test-Taker Vocabulary in Use Associated with Varying Levels of English Language Proficiency Measured by the CELPIP-General Test. Paper presented at the annual conference of the American Association for Applied Linguistics. Toronto, ON.
  • Douglas, S. (2015). Lexical Performance and Rater Judgements of English Language Proficiency: Implications for Teaching, Learning, and Assessment. Paper presented at the Language Testing Research Colloquium. Toronto, ON.
  • Volkov, A., Stone, J., Asbury, T. & Hsu, M. (2015). Analysis of norm-referencing modifiers as a component of rating rubrics. Paper presented at the Language Testing Research Colloquium. Toronto, ON. [presentation file]
  • Volkov, A., Stone, J., & Gesicki, A. (2015). Empirically derived rating rubric in a large-scale testing context. Paper presented at the Language Testing Research Colloquium. Toronto, ON. [presentation file]
  • Wagner, M., Chen, M. Y., Park, G., Stone, J., & Jang, E. E. (2015). Evaluating and revising a reading test blueprint through multiple methods: The case of the CELPIP-G. Paper presented at the Language Testing Research Colloquium. Toronto, ON.
2014 Presentations
  • Chen, M. Y., & Wu, A. D. (2014). Univariate and Multivariate Dependability of the CELPIP-G Writing Test: Effect of Scoring and Number of Raters and Tasks. Poster presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain.
  • Chen, M. Y., & Wu, A. D. (2014). Documenting Impact of Reliability on Estimates of Classification Accuracy and Consistency of the CELPIP-G Speaking and Writing Scores. Paper presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain.
  • Chen, M. Y., Wu, A., & Stone, J. (2014). Classification consistency and accuracy of CELPIP-G Test for Canadian immigration application. Paper presented at the Language Testing Research Colloquium. Amsterdam, The Netherlands.
  • Douglas, S. (2014). Exploring lexical validity in standardized English language proficiency testing. Paper presented at the annual conference of the Canadian Association of Applied Linguistics St Catharines, ON.
  • Gesicki, A. (2014). Detection of Plagiarism in the Writing Component of the Computer-Administered CELPIP-G. Poster presented at the Language Testing Research Colloquium. Amsterdam, The Netherlands.
  • Gesicki, A., Wu, A. D., Stone, J. E., & Chen, M. Y. (2014). Methods for Checking Fit between Angoff Ratings and IRT Response Data. Paper presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain.
  • Stone, J. E., Liu, Y., & Wu, A. D. (2014). Latent Class Structural Equation Modeling as a Tool for Developing Validity Arguments. Paper presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain.
  • Volkov, A., Chang, K., Stone, J. E., Chen, M. Y., & Wu, A. D. (2014). Comparing the Rating Effectiveness of Personalized vs. Non-personalized Feedback to the On-Line Raters of English Speaking and Writing Assessment. Paper presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain. [presentation file]
  • Wu, A. D., Stone, J. E., & Laufer, M. (2014). Understanding Test-taking Strategies – A Validation Study of the CELPIP-G English Reading Comprehension Test. Paper presented at the annual conference of the International Test Commission (ITC). San Sebastian, Spain.
  • Wu, A., Volkov, A., Gesicki, A., Chen, M. Y., & Stone, J. (2014). Evaluating a Rating Assignment System Designed to Reduce Rater Demand and Biases while Maintaining Reliability. Paper presented at the Language Testing Research Colloquium. Amsterdam, The Netherlands.
2012 Presentations
  • Wu, A. D., Wehrung, D., & Zumbo, B. D. (2012). The Validation of the CELPIP-G Test for Canadian Immigration: Classification Consistency and Accuracy as Reliability and Validity Evidence for Consequences of Assessment Outcomes. Paper presented at the annual meeting of the American Educational Research Association, Vancouver.