Grants and Sponsored Projects
Co-PI (2020-2021). The development of lexico-grammatical complexity in two task types: A year-long study. PI: Masaki Eguchi. Co-PI: Dr. Kristopher Kyle. Spaan Research Grant Program, Michigan Language Assessment ($4,000)
PI (2019-2020). Evaluating NLP for L2 Research: A gold standard part of speech tagged and dependency parsed corpus of L2 speaking. PI: Dr. Kristopher Kyle. Language Learning Early Career Grant ($9,977)
PI (2018-2020). A linguistic analysis of the communication demands in typical technology-mediated learning environments. PI: Dr. Kristopher Kyle. Co-PIs: Dr. Geoffrey LaFlair & Dr. Nicole Ziegler. Grant sponsored by TOEFL Committee of Examiners ($100,000)
Journal articles
in press
Kyle, K., Crossley, S. A., & Jarvis, S. (in press). Assessing the validity of lexical diversity using direct judgements. Language Assessment Quarterly.
Kyle, K., Crossley, S., & Verspoor, M. (in press). Measuring longitudinal writing development using indices of syntactic complexity and sophistication. Studies in Second Language Acquisition. https://doi.org/10.1017/S0272263120000546
Zenker, F., Kyle, K. (in press). Investigating minimum text lengths for lexical diversity indices. Assessing Writing 47. https://doi.org/10.1016/j.asw.2020.100505
2020
Eguchi, M. & Kyle, K. (2020). Continuing to explore the multidimensional nature of lexical sophistication: The case of oral proficiency interviews. The Modern Language Journal 104(2), pp. 381-400. https://doi.org/10.1111/modl.12637
Garner, J., Crossley, S. A., & Kyle, K. (2020). Beginning and intermediate L2 writer’s use of N-grams: An association measures study. International Review of Applied Linguistics in Language Teaching (IRAL) 58(1), pp. 51-74. https://doi.org/10.1515/iral-2017-0089
Kyle, K. (2020). The relationship between features of source text use and integrated writing quality. Assessing Writing 45. https://doi.org/10.1016/j.asw.2020.100467
Monteiro, K., Crossley, S. A., & Kyle, K. (2020). In search of new benchmarks: Using L2 lexical frequency and contextual diversity indices to assess second language writing. Applied Linguistics 41(2), pp. 280-300. https://doi.org/10.1093/applin/amy056
Smith, G. F., Kyle, K., Crossley, S. A. (2020). Word lists and the role of academic vocabulary use in high stakes speaking assessments. International Journal of Learner Corpus Research 6(2), pp. 194-220.
2019
Berger, C. M., Crossley, S. A., & Kyle, K. (2019). Using Native-Speaker Psycholinguistic Norms to Predict Lexical Proficiency and Development in Second Language Production. Applied Linguistics 40(1), pp. 22-42. https://doi.org/10.1093/applin/amx005
Crossley, S.A., Kyle, K. & Dascalu, M. (2019). The Tool for the Automatic Analysis of Cohesion 2.0: Integrating semantic similarity and text overlap. Behavior Research Methods 51(1), pp. 14-27. https://doi.org/10.3758/s13428-018-1142-4
Crossley, S.A., Skalicky, S., Kyle, K., & Monteiro, K. (2019). Absolute frequency effects in second language lexical acquisition. Studies in Second Language Acquisition 41(4), pp. 721-744. https://doi.org/10.1017/S0272263118000268
Garner, J., Crossley, S., & Kyle, K. (2019). N-gram measures and L2 writing proficiency. System 80, pp. 176-187. https://doi.org/10.1016/j.system.2018.12.001.
2018
Crossley, S. A., & Kyle, K. (2018). Assessing writing with the tool for the automatic analysis of lexical sophistication (TAALES). Assessing Writing 38, pp. 46-50. https://doi.org/10.1016/j.asw.2018.06.004
Kim, M., Crossley, S. A., & Kyle, K. (2018). Lexical sophistication as a multidimensional phenomenon: Relations to second language lexical proficiency, development, and writing quality. The Modern Language Journal 102(1), pp. 120-141.
Kyle, K. & Crossley, S. A. (2018). Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices. Modern Language Journal 102(2), pp. 333-349.
Kyle, K., Crossley, S. A., & Berger, C. (2018). The tool for the analysis of lexical sophistication (TAALES): Version 2.0. Behavior Research Methods 50(3) , pp. 1030-1046. article
2017
Berger, C. M., Crossley, S., & Kyle, K. (2017). Using novel word context measures to predict human ratings of lexical proficiency. Educational Technology & Society 20(2), pp. 201-212.
Crossley, S. A., Kyle, K., & McNamara, D. S. (2017). Sentiment analysis and social cognition engine (SEANCE): An automatic tool for sentiment, social cognition, and social order analysis. Behavior Research Methods 49(3), pp. 803-821. doi:10.3758/s13428-016-0743-z. article
Crossley, S. A., Russell, D. R., Kyle, K., & Römer, U. (2017). Applying natural language processing tools to a student academic writing corpus: How large are disciplinary differences across science and engineering fields? Journal of Writing Analytics 1, pp. 48 - 81. article
Crossley, S. A., Skalicky, S., Dascalu, M., McNamara, D. S., & Kyle, K. (2017). Predicting text comprehension, processing, and familiarity in adult readers: New approaches to readability formulas. Discourse Processes 54(5-6), 340-359. http://doi.org/10.1080/0163853X.2017.1296264 article
Kyle, K. & Crossley, S. A. (2017). Assessing syntactic sophistication in L2 writing: A usage-based approach. Language Testing 34(4), pp. 513-535. doi: 10.1177/0265532217712554 article
2016
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The development and use of cohesive devices in L2 writing and their relations to judgments of essay quality. Journal of Second Language Writing 32(2), pp. 1-16. doi:10.1016/j.jslw.2016.01.003 article
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods 48(4), pp. 1227-1237. doi:10.3758/s13428-015-0651-7 article
Crossley, S. A., Kyle, K., & Salsbury, T. (2016), A usage-based investigation of L2 lexical acquisition: The role of input and output. The Modern Language Journal 100(3), pp. 702–715. doi:10.1111/modl.12344 article
Kyle, K. & Crossley, S. A. (2016). The relationship between lexical sophistication and independent and source-based writing. Journal of Second Language Writing 34(4), pp. 12-24. doi:10.1016/j.jslw.2016.10.003 article
Kyle, K., Crossley, S. A., McNamara, D. S. (2016). Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing. Language Testing 33 (3), pp. 319-340: doi:10.1177/0265532215587391 article
2015
Crossley, S. A., Kyle, K., & McNamara, D. S. (2015). To aggregate or not? Linguistic features in automatic essay scoring and feedback systems. Journal of Writing Assessment 8(1). article
Kyle, K. & Crossley, S. A. (2015). Automatically assessing lexical sophistication: Indices, tools, findings, and application. TESOL Quarterly 49(4), pp. 757-786. doi: 10.1002/tesq.194 article
Kyle, K., Crossley, S.A., & Kim, Y. J. (2015). Native Language Identification and Writing Proficiency. International Journal of Learner Corpus Research 1(2), pp. 187-209. doi: 10.1075/ijlcr.1.2.01kyl. article
2014
Crossley, S. A., Kyle, K., Allen, L., Gou, L., & McNamara, D. S. (2014). Linguistic microfeatures to predict L2 writing proficiency: A case study in automated writing evaluation. Journal of Writing Assessment 7(1). article
Crossley, S. A., Varner, L. K., Kyle, K., & McNamara, D.S. (2014). Analyzing discourse processing using a simple natural language processing tool (SiNLP). Discourse Processes, 51(5-6), pp. 511-534. doi: 10.1080/0163853X.2014.910723 article
Refereed book chapters
in press
Kyle, K. (in press). Lexis. In N. Tracy-Ventura & M. Paquot (Eds.). Handbook of SLA and Corpora. New York: Routledge.
Kyle, K. & Eguchi, M. (in press) Automatically assessing lexical sophistication using word, bigram, and dependency indices. In S. Granger (Ed.). Perspectives on the Second Language Phrasicon: The View from Learner Corpora. Bristol: Multilingual Matters.
2020
Kyle, K. (2020). Measuring lexical richness. In S.Webb (Ed.). The Routledge Handbook of Vocabulary Studies(pp. 454-476). New York: Routledge.
2019
Crossley, S. A., Kyle, K., & Römer (2019). Lexical and cohesion differences in discipline specific writing: What a multi-dimensional approach tells us. In T. B. Sardinha & M. C. Pinto (Eds.). Multidimensional analysis: Research methods and current issues.New York: Bloomsbury.
2018
Crossley, S. A., & Kyle, K. (2018). Analyzing spoken and written discourse: A role for natural language processing tools. In A Phakiti, P. De Costa, L. Plonsky, & S. Starfield (Eds.). The Palgrave Handbook of Applied Linguistics Research Methodology (pp. 567-594). London: Palgrave Macmillan.
Kim, Y. J., Crossley, S. A., Jung, Y. J., Kyle, K., & Kang, S. H. (2018). The effects of task repetition and task complexity on L2 lexicon use. In M. Bygate (Ed.). Learning language through task repetition (pp. 75 - 96). Amsterdam: John Benjamins.
Conference proceedings and other publications
Kyle, K., Choe, A. T., Eguchi, M., LaFlair, G. T., & Ziegler, N. (in press). A comparison of spoken and written language use in traditional and technology mediated learning environments. ETS Research Report Series.
Kyle, K. (2017). Modelling quality in source-based writing tasks. In E. Snow (Ed.), Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.
Peffer, M. E. & Kyle, K. (2017). Assessment of language in authentic science inquiry reveals putative differences in epistemology. In M. Hatala (Ed.), Proceedings of the Seventh International Learning Analytics & Knowledge (LAK) Conference (pp. 138-142).
Crossley, S. A, Kyle, K., Davenport, J., & McNamara, D. S. (2016). Automatic assessment of constructed response data in a chemistry tutor. In T. Barnes, M. Chi, & M. Feng (Eds.), Proceedings of the 9th International Educational Data Mining (EDM) Society Conference (pp. 336-340). article
Crossley, S. A., Kyle, K., Allen, L, & McNamara, D. S. (2014). How important are grammar and mechanics in writing assessment and instruction? Evidence from essay analyses. Stamper, J., Pardos, Z., Mavrikis, M., & McLaren, B.M. (Eds.). Proceedings of the 7th Educational Data Mining (EDM) Conference. (pp. 300-303). Heidelberg, Berlin, Germany: Springer. article
Crossley, S. A., Defore, C., Kyle, K, Dai, J., & McNamara, D. S. (2013). Paragraph Specific N-Gram Approaches to Automatically Assessing Essay Quality. Proceedings of the Educational Data Mining (EDM) Conference. article
Kyle, K., Crossley, S.A., Dai, J., & McNamara, D.S. (2013). Native language identification: A key ngrams approach. In Proceedings of the 8th Workshop on Innovative Use of NLP for Building Educational Applications. Atlanta, GA. article
Invited Talks and Workshops
Kyle, K. (September, 2019). Using learner corpora to study SLA. Invited workshop at the 2019 Second Language Research Forum (SLRF 2019). East Lansing, MI.
Kyle, K. (July, 2019). A framework for measuring productive lexical proficiency as a multidimensional construct.Invited colloquium presentation at the Vocab@Leuven conference. Leuven, Belgium.
Kyle, K. (March, 2019). Automatically assessing multiple features of lexical sophistication with TAALES.Invited colloquium presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019).
Kyle, K. (January, 2019). Measuring lexical (and lexicogrammatical) proficiency from a multivariate perspective.Keynote presentation at the 32nd Cheongram Curriculum and Instruction Forum International Conference. Korea National University of Education, Cheongju, South Korea.
Crossley, S. A. & Kyle, K. (September, 2018). An introduction to natural language processing tools: The curious case of the lexicon. Invited workshop at the 14thAmerican Association for Corpus Linguistics Conference (AACL 2018). Atlanta, GA.
Kyle, K. (March, 2017). A scalable approach to the extraction of constructions: Replicable (semi-) automatic techniques for analyzing linguistic patterns. Invited workshop given at the University of Basel. Basel, Switzerland.
Crossley, S. A. & Kyle, K. (October, 2015). Natural language processing tools and second language research. Invited workshop at the 34thSecond Language Research Forum. Atlanta, GA.
Presentations (main presenter):
Kyle, K. & Eguchi, M. (July, 2019). Measuring productive lexical proficiency using dependency-based collocations. Presentation at the Vocab@Leuven Conference. Leuven, Belgium.
Kyle, K. & Zenker, F. (March, 2019). Development of text length guidelines for the measurement of lexical sophistication. Presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019). Atlanta, GA.
Kyle, K., LaFlair, G., & Ziegler, N. (September, 2018). The TMLE-Corpus project: Academic language in technology-mediated contexts. Presentation at the 14th American Association for Corpus Linguistics Conference (AACL 2018). Atlanta, GA.
Kyle, K. (March, 2018). The relationship between automatic indices of source text use and holistic scores of TOEFL integrated writing responses. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Kyle, K. (February, 2018). Measuring verb-argument construction use: A comprehensive, automated approach. Presentation at the 3rdConstructionist Approaches to Language Pedagogy (CALP) Conference. Austin, TX.
Kyle, K. (May, 2017). Using corpus derived indices related to words, n-grams, and verb argument constructions to predict L2 writing quality. Presentation at the 38th International Computer Archive of Modern and Medieval English (ICAME) Conference. Prague, Czech Republic.
Kyle, K. & Crossley, S. A. (April, 2017). Measuring longitudinal writing development: A usage based perspective. Presentation at the first Learner Corpus based approaches to Second Language Acquisition workshop. Utrecht, Netherlands.
Kyle, K. (March, 2017). A scalable approach to the extraction of constructions: Replicable (semi-) automatic techniques for analyzing linguistic patterns. Invited workshop given at the University of Basel. Basel, Switzerland.
Kyle, K. & Crossley, S. A. (March, 2017). Measuring longitudinal writing development: A usage based perspective. Presentation at the 2017 Association of American Applied Linguistics Conference (AAAL 2017). Portland, OR.
Kyle, K. (January, 2017). Classroom testing, evaluation, and assessment. Invited talk given at the 121st Workshop for Teachers of English by the Center for Asia-Pacific Exchange (CAPE). Honolulu, HI.
Kyle, K. & Crossley, S. A. (September, 2016). Measuring longitudinal writing development: A usage based perspective. Presentation at the 35th Second Language Research Forum. New York, NY.
Kyle, K. & Crossley, S. A. (April, 2016). Assessing written L2 lexical proficiency: The varying roles of word frequency, n-gram frequency, and n-gram association strength. Presentation at the 2016 Association of American Applied Linguistics Conference (AAAL 2016). Orlando, FL.
Crossley, S. A. & Kyle, K. (October, 2015). Natural language processing tools and second language research. Workshop at the 34th Second Language Research Forum. Atlanta, GA.
Kyle, K. & Crossley, S. A. (October, 2015). Predicting holistic scores of TOEFL essays using indices of syntactic development: New Perspectives. Presentation at the 34th Second Language Research Forum. Atlanta, GA.
Kyle, K., Crossley, S. A. (June, 2015). Writing task performance: A usage based perspective. Presentation at the second Thinking, Doing, Learning conference. Groningen, Netherlands.
Kyle, K., Crossley, S. A. (May, 2015). Measuring syntactic development in longitudinal learner corpora from a usage-based perspective. Poster presentation at the 36th International Computer Archive of Modern and Medieval English (ICAME) Conference. Trier, Germany.
Kyle, K., Crossley, S. A. (March, 2015). Automatically assessing syntactic complexity: Traditional, revised, & new measures. Presentation at the Annual American Association for Applied Linguistics Conference, Toronto, Canada.
Crossley, S.A., & Kyle, K. (March 2015). Automatically assessing lexical proficiency using TAALES: Applications for assessment. Roundtable presentation at the Annual American Association for Applied Linguistics Conference, Toronto, Canada.
Murphy, C. M., Kostenko, O., Kyle, K., & Skalicky, S. (October, 2014). Differential rater functioning in L2 writing performance assessment: Language sub-scales and multi-word units. Presentation at the 33rd Second Language Research Forum, Columbia, South Carolina.
Kyle, K., Crossley, S. A., & McNamara, D.S. (March, 2014). Construct validity of TOEFL iBT spoken assessment tasks: Insights from natural language processing. Presentation at the Annual American Association for Applied Linguistics Conference, Portland, OR.
Kyle, K., Crossley, S.A. (October, 2013). The effects of proficiency on crosslinguistic influence. Presentation at the 32nd Annual Second Language Research Forum, Provo, UT.
Kyle, K., Crossley, S.A., Dai, J., & McNamara, D.S. (June, 2013). Native language identification: A key ngrams approach. Presentation at the Annual Conference of the North American Association for Computational Linguistics, Atlanta, GA.
Kyle, K. (September, 2012). Objective measures of ESL/EFL writing quality. Presentation at the Symposium on Second Language Writing 2012, West Lafayette, IN.
Ehlers-Zavala, F., Kyle, K., Novak, J., Thorson, L., Correa-Dominguez, M., & Flahive, D. (March, 2012). Teachers' current views on bilingual/L2 reading research and their professional practices. Presentation at the American Association for Applied Linguistics (AAAL) Conference 2012, Boston, MA.
Kyle, K. (October, 2011). Helping ESL writers. Presentation given at the Colorado State University Writing Center, Fort Collins, CO.
Kyle, J., & Kyle, K. (November, 2011). Vocabulary Selection: What, why, and how. Presentation at the 35th Colorado Affiliate of Teachers of English to Speakers of Other Languages Conference, Denver, CO.
Presentations (not main presenter):
Zenker, F. & Kyle, K. (March, 2019). Investigating Minimum Text Lengths for Lexical Diversity Indices. Presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019). Atlanta, GA.
Crossley, S. A., Skalicky, S., & Kyle, K. (March, 2018). What’s the frequency in it? A longitudinal analysis of second language lexical development. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Monteiro, K., Crossley, S. A., & Kyle, K. (March, 2018). In search of new benchmarks: Using non-native lexical frequency and contextual diversity indices to assess language learning. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Garner, J. G., Crossley, S. A., & Kyle, K. (March, 2017). N-gram measures and L2 writing quality. Presentation at the 2017 Association of American Applied Linguistics Conference (AAAL 2017). Portland, OR.
Berger, C. M., Crossley, S. A., Kyle, K. (September, 2016). Using native-speaker word recognition norms to assess spoken lexical proficiency in L2 learners. Presentation at the 35th Second Language Research Forum. New York, NY.
Crossley, S. A., Kyle, K., & Berger, C. M. (April, 2016). Assessing lexical proficiency using the English Lexicon Project and a bit more. Paper presentation at the 2016 American Association for Applied Linguistics (AAAL) Conference. Orlando, Florida, USA.
Crossley, S. A., Kyle, K., & Salsbury, T. (October, 2015). A usage‐based investigation of L2 lexical acquisition: The role of input and output. Presentation at the 34th Second Language Research Forum. Atlanta, GA.
Crossley, S. A., Kyle, K., Varner, L, & McNamara, D. S. (July, 2014). How important are grammar and mechanics in writing assessment and instruction? Evidence from essay analyses. Presentation at the 7th Educational Data Mining (EDM) Conference. Heidelberg, Berlin, Germany: Springer.
Crossley, S. A., Defore, C., Kyle, K., Dai, J., & McNamara, D. S. (July, 2013). Paragraph specific n-gram approaches to automatically assessing essay quality. Presentation at the Sixth International Conference on Educational Data Mining, Memphis, TN.
Book reviews:
Kyle, K. (2013). [Review of the book Research methods in second language acquisition: A Practical Guide by Alison Mackey and Susan M. Gass (Eds.)]. System.
Master’s thesis:
Kyle, K. (2011). Objective measures of writing quality. (Colorado State University). ProQuest Dissertations and Theses, 98.
Doctoral dissertation:
Kyle, K. (2016). Measuring syntactic development in L2 writing: Fine grained indices of syntactic complexity and usage-based indices of syntactic sophistication (Doctoral Dissertation). Retrieved from http://scholarworks.gsu.edu/alesl_diss/35.
Co-PI (2020-2021). The development of lexico-grammatical complexity in two task types: A year-long study. PI: Masaki Eguchi. Co-PI: Dr. Kristopher Kyle. Spaan Research Grant Program, Michigan Language Assessment ($4,000)
PI (2019-2020). Evaluating NLP for L2 Research: A gold standard part of speech tagged and dependency parsed corpus of L2 speaking. PI: Dr. Kristopher Kyle. Language Learning Early Career Grant ($9,977)
PI (2018-2020). A linguistic analysis of the communication demands in typical technology-mediated learning environments. PI: Dr. Kristopher Kyle. Co-PIs: Dr. Geoffrey LaFlair & Dr. Nicole Ziegler. Grant sponsored by TOEFL Committee of Examiners ($100,000)
Journal articles
in press
Kyle, K., Crossley, S. A., & Jarvis, S. (in press). Assessing the validity of lexical diversity using direct judgements. Language Assessment Quarterly.
Kyle, K., Crossley, S., & Verspoor, M. (in press). Measuring longitudinal writing development using indices of syntactic complexity and sophistication. Studies in Second Language Acquisition. https://doi.org/10.1017/S0272263120000546
Zenker, F., Kyle, K. (in press). Investigating minimum text lengths for lexical diversity indices. Assessing Writing 47. https://doi.org/10.1016/j.asw.2020.100505
2020
Eguchi, M. & Kyle, K. (2020). Continuing to explore the multidimensional nature of lexical sophistication: The case of oral proficiency interviews. The Modern Language Journal 104(2), pp. 381-400. https://doi.org/10.1111/modl.12637
Garner, J., Crossley, S. A., & Kyle, K. (2020). Beginning and intermediate L2 writer’s use of N-grams: An association measures study. International Review of Applied Linguistics in Language Teaching (IRAL) 58(1), pp. 51-74. https://doi.org/10.1515/iral-2017-0089
Kyle, K. (2020). The relationship between features of source text use and integrated writing quality. Assessing Writing 45. https://doi.org/10.1016/j.asw.2020.100467
Monteiro, K., Crossley, S. A., & Kyle, K. (2020). In search of new benchmarks: Using L2 lexical frequency and contextual diversity indices to assess second language writing. Applied Linguistics 41(2), pp. 280-300. https://doi.org/10.1093/applin/amy056
Smith, G. F., Kyle, K., Crossley, S. A. (2020). Word lists and the role of academic vocabulary use in high stakes speaking assessments. International Journal of Learner Corpus Research 6(2), pp. 194-220.
2019
Berger, C. M., Crossley, S. A., & Kyle, K. (2019). Using Native-Speaker Psycholinguistic Norms to Predict Lexical Proficiency and Development in Second Language Production. Applied Linguistics 40(1), pp. 22-42. https://doi.org/10.1093/applin/amx005
Crossley, S.A., Kyle, K. & Dascalu, M. (2019). The Tool for the Automatic Analysis of Cohesion 2.0: Integrating semantic similarity and text overlap. Behavior Research Methods 51(1), pp. 14-27. https://doi.org/10.3758/s13428-018-1142-4
Crossley, S.A., Skalicky, S., Kyle, K., & Monteiro, K. (2019). Absolute frequency effects in second language lexical acquisition. Studies in Second Language Acquisition 41(4), pp. 721-744. https://doi.org/10.1017/S0272263118000268
Garner, J., Crossley, S., & Kyle, K. (2019). N-gram measures and L2 writing proficiency. System 80, pp. 176-187. https://doi.org/10.1016/j.system.2018.12.001.
2018
Crossley, S. A., & Kyle, K. (2018). Assessing writing with the tool for the automatic analysis of lexical sophistication (TAALES). Assessing Writing 38, pp. 46-50. https://doi.org/10.1016/j.asw.2018.06.004
Kim, M., Crossley, S. A., & Kyle, K. (2018). Lexical sophistication as a multidimensional phenomenon: Relations to second language lexical proficiency, development, and writing quality. The Modern Language Journal 102(1), pp. 120-141.
Kyle, K. & Crossley, S. A. (2018). Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices. Modern Language Journal 102(2), pp. 333-349.
Kyle, K., Crossley, S. A., & Berger, C. (2018). The tool for the analysis of lexical sophistication (TAALES): Version 2.0. Behavior Research Methods 50(3) , pp. 1030-1046. article
2017
Berger, C. M., Crossley, S., & Kyle, K. (2017). Using novel word context measures to predict human ratings of lexical proficiency. Educational Technology & Society 20(2), pp. 201-212.
Crossley, S. A., Kyle, K., & McNamara, D. S. (2017). Sentiment analysis and social cognition engine (SEANCE): An automatic tool for sentiment, social cognition, and social order analysis. Behavior Research Methods 49(3), pp. 803-821. doi:10.3758/s13428-016-0743-z. article
Crossley, S. A., Russell, D. R., Kyle, K., & Römer, U. (2017). Applying natural language processing tools to a student academic writing corpus: How large are disciplinary differences across science and engineering fields? Journal of Writing Analytics 1, pp. 48 - 81. article
Crossley, S. A., Skalicky, S., Dascalu, M., McNamara, D. S., & Kyle, K. (2017). Predicting text comprehension, processing, and familiarity in adult readers: New approaches to readability formulas. Discourse Processes 54(5-6), 340-359. http://doi.org/10.1080/0163853X.2017.1296264 article
Kyle, K. & Crossley, S. A. (2017). Assessing syntactic sophistication in L2 writing: A usage-based approach. Language Testing 34(4), pp. 513-535. doi: 10.1177/0265532217712554 article
2016
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The development and use of cohesive devices in L2 writing and their relations to judgments of essay quality. Journal of Second Language Writing 32(2), pp. 1-16. doi:10.1016/j.jslw.2016.01.003 article
Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods 48(4), pp. 1227-1237. doi:10.3758/s13428-015-0651-7 article
Crossley, S. A., Kyle, K., & Salsbury, T. (2016), A usage-based investigation of L2 lexical acquisition: The role of input and output. The Modern Language Journal 100(3), pp. 702–715. doi:10.1111/modl.12344 article
Kyle, K. & Crossley, S. A. (2016). The relationship between lexical sophistication and independent and source-based writing. Journal of Second Language Writing 34(4), pp. 12-24. doi:10.1016/j.jslw.2016.10.003 article
Kyle, K., Crossley, S. A., McNamara, D. S. (2016). Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing. Language Testing 33 (3), pp. 319-340: doi:10.1177/0265532215587391 article
2015
Crossley, S. A., Kyle, K., & McNamara, D. S. (2015). To aggregate or not? Linguistic features in automatic essay scoring and feedback systems. Journal of Writing Assessment 8(1). article
Kyle, K. & Crossley, S. A. (2015). Automatically assessing lexical sophistication: Indices, tools, findings, and application. TESOL Quarterly 49(4), pp. 757-786. doi: 10.1002/tesq.194 article
Kyle, K., Crossley, S.A., & Kim, Y. J. (2015). Native Language Identification and Writing Proficiency. International Journal of Learner Corpus Research 1(2), pp. 187-209. doi: 10.1075/ijlcr.1.2.01kyl. article
2014
Crossley, S. A., Kyle, K., Allen, L., Gou, L., & McNamara, D. S. (2014). Linguistic microfeatures to predict L2 writing proficiency: A case study in automated writing evaluation. Journal of Writing Assessment 7(1). article
Crossley, S. A., Varner, L. K., Kyle, K., & McNamara, D.S. (2014). Analyzing discourse processing using a simple natural language processing tool (SiNLP). Discourse Processes, 51(5-6), pp. 511-534. doi: 10.1080/0163853X.2014.910723 article
Refereed book chapters
in press
Kyle, K. (in press). Lexis. In N. Tracy-Ventura & M. Paquot (Eds.). Handbook of SLA and Corpora. New York: Routledge.
Kyle, K. & Eguchi, M. (in press) Automatically assessing lexical sophistication using word, bigram, and dependency indices. In S. Granger (Ed.). Perspectives on the Second Language Phrasicon: The View from Learner Corpora. Bristol: Multilingual Matters.
2020
Kyle, K. (2020). Measuring lexical richness. In S.Webb (Ed.). The Routledge Handbook of Vocabulary Studies(pp. 454-476). New York: Routledge.
2019
Crossley, S. A., Kyle, K., & Römer (2019). Lexical and cohesion differences in discipline specific writing: What a multi-dimensional approach tells us. In T. B. Sardinha & M. C. Pinto (Eds.). Multidimensional analysis: Research methods and current issues.New York: Bloomsbury.
2018
Crossley, S. A., & Kyle, K. (2018). Analyzing spoken and written discourse: A role for natural language processing tools. In A Phakiti, P. De Costa, L. Plonsky, & S. Starfield (Eds.). The Palgrave Handbook of Applied Linguistics Research Methodology (pp. 567-594). London: Palgrave Macmillan.
Kim, Y. J., Crossley, S. A., Jung, Y. J., Kyle, K., & Kang, S. H. (2018). The effects of task repetition and task complexity on L2 lexicon use. In M. Bygate (Ed.). Learning language through task repetition (pp. 75 - 96). Amsterdam: John Benjamins.
Conference proceedings and other publications
Kyle, K., Choe, A. T., Eguchi, M., LaFlair, G. T., & Ziegler, N. (in press). A comparison of spoken and written language use in traditional and technology mediated learning environments. ETS Research Report Series.
Kyle, K. (2017). Modelling quality in source-based writing tasks. In E. Snow (Ed.), Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.
Peffer, M. E. & Kyle, K. (2017). Assessment of language in authentic science inquiry reveals putative differences in epistemology. In M. Hatala (Ed.), Proceedings of the Seventh International Learning Analytics & Knowledge (LAK) Conference (pp. 138-142).
Crossley, S. A, Kyle, K., Davenport, J., & McNamara, D. S. (2016). Automatic assessment of constructed response data in a chemistry tutor. In T. Barnes, M. Chi, & M. Feng (Eds.), Proceedings of the 9th International Educational Data Mining (EDM) Society Conference (pp. 336-340). article
Crossley, S. A., Kyle, K., Allen, L, & McNamara, D. S. (2014). How important are grammar and mechanics in writing assessment and instruction? Evidence from essay analyses. Stamper, J., Pardos, Z., Mavrikis, M., & McLaren, B.M. (Eds.). Proceedings of the 7th Educational Data Mining (EDM) Conference. (pp. 300-303). Heidelberg, Berlin, Germany: Springer. article
Crossley, S. A., Defore, C., Kyle, K, Dai, J., & McNamara, D. S. (2013). Paragraph Specific N-Gram Approaches to Automatically Assessing Essay Quality. Proceedings of the Educational Data Mining (EDM) Conference. article
Kyle, K., Crossley, S.A., Dai, J., & McNamara, D.S. (2013). Native language identification: A key ngrams approach. In Proceedings of the 8th Workshop on Innovative Use of NLP for Building Educational Applications. Atlanta, GA. article
Invited Talks and Workshops
Kyle, K. (September, 2019). Using learner corpora to study SLA. Invited workshop at the 2019 Second Language Research Forum (SLRF 2019). East Lansing, MI.
Kyle, K. (July, 2019). A framework for measuring productive lexical proficiency as a multidimensional construct.Invited colloquium presentation at the Vocab@Leuven conference. Leuven, Belgium.
Kyle, K. (March, 2019). Automatically assessing multiple features of lexical sophistication with TAALES.Invited colloquium presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019).
Kyle, K. (January, 2019). Measuring lexical (and lexicogrammatical) proficiency from a multivariate perspective.Keynote presentation at the 32nd Cheongram Curriculum and Instruction Forum International Conference. Korea National University of Education, Cheongju, South Korea.
Crossley, S. A. & Kyle, K. (September, 2018). An introduction to natural language processing tools: The curious case of the lexicon. Invited workshop at the 14thAmerican Association for Corpus Linguistics Conference (AACL 2018). Atlanta, GA.
Kyle, K. (March, 2017). A scalable approach to the extraction of constructions: Replicable (semi-) automatic techniques for analyzing linguistic patterns. Invited workshop given at the University of Basel. Basel, Switzerland.
Crossley, S. A. & Kyle, K. (October, 2015). Natural language processing tools and second language research. Invited workshop at the 34thSecond Language Research Forum. Atlanta, GA.
Presentations (main presenter):
Kyle, K. & Eguchi, M. (July, 2019). Measuring productive lexical proficiency using dependency-based collocations. Presentation at the Vocab@Leuven Conference. Leuven, Belgium.
Kyle, K. & Zenker, F. (March, 2019). Development of text length guidelines for the measurement of lexical sophistication. Presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019). Atlanta, GA.
Kyle, K., LaFlair, G., & Ziegler, N. (September, 2018). The TMLE-Corpus project: Academic language in technology-mediated contexts. Presentation at the 14th American Association for Corpus Linguistics Conference (AACL 2018). Atlanta, GA.
Kyle, K. (March, 2018). The relationship between automatic indices of source text use and holistic scores of TOEFL integrated writing responses. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Kyle, K. (February, 2018). Measuring verb-argument construction use: A comprehensive, automated approach. Presentation at the 3rdConstructionist Approaches to Language Pedagogy (CALP) Conference. Austin, TX.
Kyle, K. (May, 2017). Using corpus derived indices related to words, n-grams, and verb argument constructions to predict L2 writing quality. Presentation at the 38th International Computer Archive of Modern and Medieval English (ICAME) Conference. Prague, Czech Republic.
Kyle, K. & Crossley, S. A. (April, 2017). Measuring longitudinal writing development: A usage based perspective. Presentation at the first Learner Corpus based approaches to Second Language Acquisition workshop. Utrecht, Netherlands.
Kyle, K. (March, 2017). A scalable approach to the extraction of constructions: Replicable (semi-) automatic techniques for analyzing linguistic patterns. Invited workshop given at the University of Basel. Basel, Switzerland.
Kyle, K. & Crossley, S. A. (March, 2017). Measuring longitudinal writing development: A usage based perspective. Presentation at the 2017 Association of American Applied Linguistics Conference (AAAL 2017). Portland, OR.
Kyle, K. (January, 2017). Classroom testing, evaluation, and assessment. Invited talk given at the 121st Workshop for Teachers of English by the Center for Asia-Pacific Exchange (CAPE). Honolulu, HI.
Kyle, K. & Crossley, S. A. (September, 2016). Measuring longitudinal writing development: A usage based perspective. Presentation at the 35th Second Language Research Forum. New York, NY.
Kyle, K. & Crossley, S. A. (April, 2016). Assessing written L2 lexical proficiency: The varying roles of word frequency, n-gram frequency, and n-gram association strength. Presentation at the 2016 Association of American Applied Linguistics Conference (AAAL 2016). Orlando, FL.
Crossley, S. A. & Kyle, K. (October, 2015). Natural language processing tools and second language research. Workshop at the 34th Second Language Research Forum. Atlanta, GA.
Kyle, K. & Crossley, S. A. (October, 2015). Predicting holistic scores of TOEFL essays using indices of syntactic development: New Perspectives. Presentation at the 34th Second Language Research Forum. Atlanta, GA.
Kyle, K., Crossley, S. A. (June, 2015). Writing task performance: A usage based perspective. Presentation at the second Thinking, Doing, Learning conference. Groningen, Netherlands.
Kyle, K., Crossley, S. A. (May, 2015). Measuring syntactic development in longitudinal learner corpora from a usage-based perspective. Poster presentation at the 36th International Computer Archive of Modern and Medieval English (ICAME) Conference. Trier, Germany.
Kyle, K., Crossley, S. A. (March, 2015). Automatically assessing syntactic complexity: Traditional, revised, & new measures. Presentation at the Annual American Association for Applied Linguistics Conference, Toronto, Canada.
Crossley, S.A., & Kyle, K. (March 2015). Automatically assessing lexical proficiency using TAALES: Applications for assessment. Roundtable presentation at the Annual American Association for Applied Linguistics Conference, Toronto, Canada.
Murphy, C. M., Kostenko, O., Kyle, K., & Skalicky, S. (October, 2014). Differential rater functioning in L2 writing performance assessment: Language sub-scales and multi-word units. Presentation at the 33rd Second Language Research Forum, Columbia, South Carolina.
Kyle, K., Crossley, S. A., & McNamara, D.S. (March, 2014). Construct validity of TOEFL iBT spoken assessment tasks: Insights from natural language processing. Presentation at the Annual American Association for Applied Linguistics Conference, Portland, OR.
Kyle, K., Crossley, S.A. (October, 2013). The effects of proficiency on crosslinguistic influence. Presentation at the 32nd Annual Second Language Research Forum, Provo, UT.
Kyle, K., Crossley, S.A., Dai, J., & McNamara, D.S. (June, 2013). Native language identification: A key ngrams approach. Presentation at the Annual Conference of the North American Association for Computational Linguistics, Atlanta, GA.
Kyle, K. (September, 2012). Objective measures of ESL/EFL writing quality. Presentation at the Symposium on Second Language Writing 2012, West Lafayette, IN.
Ehlers-Zavala, F., Kyle, K., Novak, J., Thorson, L., Correa-Dominguez, M., & Flahive, D. (March, 2012). Teachers' current views on bilingual/L2 reading research and their professional practices. Presentation at the American Association for Applied Linguistics (AAAL) Conference 2012, Boston, MA.
Kyle, K. (October, 2011). Helping ESL writers. Presentation given at the Colorado State University Writing Center, Fort Collins, CO.
Kyle, J., & Kyle, K. (November, 2011). Vocabulary Selection: What, why, and how. Presentation at the 35th Colorado Affiliate of Teachers of English to Speakers of Other Languages Conference, Denver, CO.
Presentations (not main presenter):
Zenker, F. & Kyle, K. (March, 2019). Investigating Minimum Text Lengths for Lexical Diversity Indices. Presentation at the 2019 Association of American Applied Linguistics Conference (AAAL 2019). Atlanta, GA.
Crossley, S. A., Skalicky, S., & Kyle, K. (March, 2018). What’s the frequency in it? A longitudinal analysis of second language lexical development. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Monteiro, K., Crossley, S. A., & Kyle, K. (March, 2018). In search of new benchmarks: Using non-native lexical frequency and contextual diversity indices to assess language learning. Presentation at the 2018 Association of American Applied Linguistics Conference (AAAL 2018). Chicago, IL.
Garner, J. G., Crossley, S. A., & Kyle, K. (March, 2017). N-gram measures and L2 writing quality. Presentation at the 2017 Association of American Applied Linguistics Conference (AAAL 2017). Portland, OR.
Berger, C. M., Crossley, S. A., Kyle, K. (September, 2016). Using native-speaker word recognition norms to assess spoken lexical proficiency in L2 learners. Presentation at the 35th Second Language Research Forum. New York, NY.
Crossley, S. A., Kyle, K., & Berger, C. M. (April, 2016). Assessing lexical proficiency using the English Lexicon Project and a bit more. Paper presentation at the 2016 American Association for Applied Linguistics (AAAL) Conference. Orlando, Florida, USA.
Crossley, S. A., Kyle, K., & Salsbury, T. (October, 2015). A usage‐based investigation of L2 lexical acquisition: The role of input and output. Presentation at the 34th Second Language Research Forum. Atlanta, GA.
Crossley, S. A., Kyle, K., Varner, L, & McNamara, D. S. (July, 2014). How important are grammar and mechanics in writing assessment and instruction? Evidence from essay analyses. Presentation at the 7th Educational Data Mining (EDM) Conference. Heidelberg, Berlin, Germany: Springer.
Crossley, S. A., Defore, C., Kyle, K., Dai, J., & McNamara, D. S. (July, 2013). Paragraph specific n-gram approaches to automatically assessing essay quality. Presentation at the Sixth International Conference on Educational Data Mining, Memphis, TN.
Book reviews:
Kyle, K. (2013). [Review of the book Research methods in second language acquisition: A Practical Guide by Alison Mackey and Susan M. Gass (Eds.)]. System.
Master’s thesis:
Kyle, K. (2011). Objective measures of writing quality. (Colorado State University). ProQuest Dissertations and Theses, 98.
Doctoral dissertation:
Kyle, K. (2016). Measuring syntactic development in L2 writing: Fine grained indices of syntactic complexity and usage-based indices of syntactic sophistication (Doctoral Dissertation). Retrieved from http://scholarworks.gsu.edu/alesl_diss/35.