Skip to content
2018
Volume 77, Issue 1
  • ISSN: 0010-096X
  • E-ISSN: 1939-9006

Abstract

The integration of generative artificial intelligence (AI) into academic writing has raised questions about the syntactic complexity of AI-generated texts compared to human-authored essays. While studies have explored syntactic complexity in human writing, limited research has compared AI-generated argumentative and narrative texts, particularly in isolating cognitive overload and proficiency factors. This study addressed this gap by examining genre-specific syntactic patterns in AI-generated essays. Using the L2 Syntactic Complexity Analyzer, the study analyzed four hundred AI-generated essays (two hundred argumentative and two hundred narrative) and employed paired T-tests and Pearson correlation coefficients to identify differences and relationships among syntactic measures. Results showed that argumentative essays demonstrated higher syntactic complexity than narrative essays, especially in production unit length, coordination, and phrasal sophistication, while subordination measures remained similar. Correlation analysis revealed that argumentative essays compartmentalized ideas through coordinated and nominally complex structures, while narrative essays integrated descriptive richness through longer sentences and embedded clauses. The findings suggest that genre-specific rhetorical demands shape syntactic complexity in AI-generated writing. Implications for teaching and learning writing and future studies are discussed.

Loading

Article metrics loading...

/content/journals/10.58680/ccc2025771148
2025-09-01
2026-06-09
Loading full text...

Full text loading...

References

  1. Bae Jiyoung, and Min Sangmin. “GenreBased Analysis of Syntactic Complexity in L2 College Students’ Writing: Pedagogic Scope and Directions.” Journal of Asia TEFL, vol. 17, no. 3 2020, pp 937–53.
    [Google Scholar]
  2. Barrot Jessie. “Using ChatGPT for Second Language Writing: Pitfalls and Potentials.” Assessing Writing, vol. 57 2023, 100745.
    [Google Scholar]
  3. Barrot Jessie, and Agdeppa Joan. “Complexity, Accuracy, and Fluency as Indices of College-Level L2 Writers’ Proficiency.” Assessing Writing, vol. 47 2021, 100510.
    [Google Scholar]
  4. Beers Scott F., and Nagy William E.. “Syntactic Complexity as a Predictor of Adolescent Writing Quality: Which Measures? Which Genre?” Reading and Writing, vol. 22 2009, pp 185–200.
    [Google Scholar]
  5. Biber Douglas, et al. “Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development?” TESOL Quarterly, vol. 45, no. 1 2011, pp 5–35.
    [Google Scholar]
  6. Bulte Bram, and Housen Alex. “Conceptualizing and Measuring Short-Term Changes in L2 Writing Complexity.” Journal of Second Language Writing, vol. 26 2014, pp 42–65.
    [Google Scholar]
  7. Casal Joseph E., and Lee Jared J.. “Syntactic Complexity and Writing Quality in Assessed First-Year L2 Writing.” Journal of Second Language Writing, vol. 44 2019, pp 51–62.
    [Google Scholar]
  8. Fludernik Monika. “Genres, Text Types, or Discourse Modes? Narrative Modalities and Generic Categorization.” Style, vol. 34, no. 2 2000, pp 274–92.
    [Google Scholar]
  9. Frear Matthew W., and Bitchener John. “The Effects of Cognitive Task Complexity on Writing Complexity.” Journal of Second Language Writing, vol. 30 2015, pp 45–57.
    [Google Scholar]
  10. Hwang Hyun-Bin, and Polio Charlene. “Text Length Effects on the Reliability of Syntactic Complexity Indices.” Research Methods in Applied Linguistics, vol. 2, no. 3 2023, 100085.
    [Google Scholar]
  11. Jagaiah Thirupathi, et al. “Syntactic Complexity Measures: Variation by Genre, Grade-Level, Students’ Writing Abilities, and Writing Quality.” Reading and Writing, vol. 33 2020, pp 2577–638.
    [Google Scholar]
  12. Johnson Matthew D. “Cognitive Task Complexity and L2 Written Syntactic Complexity, Accuracy, Lexical Complexity, and Fluency: A Research Synthesis and Meta-Analysis.” Journal of Second Language Writing, vol. 37 2017, pp 13–38.
    [Google Scholar]
  13. Khushik Ghulam Ali. “Is the Variation in Syntactic Complexity Features Observed in Argumentative Essays Produced by B1 Level EFL Learners in Finland and Pakistan Attributable Exclusively to Their L1?” Assessing Writing, vol. 60 2024, 100839.
    [Google Scholar]
  14. Kyle Kristopher, and Crossley Scott A.. “Measuring Syntactic Complexity in L2 Writing Using Fine-Grained Clausal and Phrasal Indices.” The Modern Language Journal, vol. 102, no. 2 2018, pp 333–49.
    [Google Scholar]
  15. Lahuerta Martinez Ana C. “Analysis of Syntactic Complexity in Secondary Education EFL Writers at Different Proficiency Levels.” Assessing Writing, vol. 35 2018, pp 1–11.
    [Google Scholar]
  16. Lu Xiaofei. “A Corpus-Based Evaluation of Syntactic Complexity Measures as Indices of College-Level ESL Writers’ Language Development.” TESOL Quarterly, vol. 45, no. 1 2011, pp 36–62.
    [Google Scholar]
  17. Mays Chris. “Writing Complexity, One Stability at a Time: Teaching Writing as a Complex System.” College Composition & Communication, vol. 68, no. 3 2017, pp 559–85.
    [Google Scholar]
  18. Mizumoto Atsushi, et al. “Identifying ChatGPT-Generated Texts in EFL Students’ Writing: Through Comparative Analysis of Linguistic Fingerprints.” Applied Corpus Linguistics, vol. 4, no. 3 2024, 100106.
    [Google Scholar]
  19. Ng Alex L., and Ong Jason. “ChatGPT vs Bard: Which Is a Better Writer?” 2024 IEEE Conference on Artificial Intelligence (CAI), IEEE, June 2024, pp 307–12.
    [Google Scholar]
  20. Nkhobo Thabang, and Chaka Clement. “Student-Written versus ChatGPT-Generated Discursive Essays: A Comparative Coh-Metrix Analysis of Lexical Diversity, Syntactic Complexity, and Referential Cohesion.” International Journal of Education and Development Using Information and Communication Technology, vol. 19, no. 3 2023, pp 69–84.
    [Google Scholar]
  21. Ortega Lourdes. “Syntactic Complexity in L2 Writing: Progress and Expansion.” Journal of Second Language Writing, vol. 29 2015, pp 82–94.
    [Google Scholar]
  22. Ortega Lourdes. “Syntactic Complexity Measures and Their Relationship to L2 Proficiency: A Research Synthesis of College-Level L2 Writing.” Applied Linguistics, vol. 24, no. 4 2003, pp 492–518.
    [Google Scholar]
  23. Pu Lin, et al. “The Effects of Genre on the Syntactic Complexity of Argumentative and Expository Writing by Chinese EFL Learners.” Frontiers in Psychology, vol. 13 2022, 1047117.
    [Google Scholar]
  24. Qin Weiping, and Uccelli Paola. “Same Language, Different Functions: A Cross-Genre Analysis of Chinese EFL Learners’ Writing Performance.” Journal of Second Language Writing, vol. 33 2016, pp 3–17.
    [Google Scholar]
  25. Rokoszewska Katarzyna J. “The Dynamics of Monthly Growth Rates in the Emergence of Complexity, Accuracy, and Fluency in L2 English Writing at Secondary School-A Learner Corpus Analysis.” System, vol. 106 2022, 102775.
    [Google Scholar]
  26. Skehan Peter. A Cognitive Approach to Language Learning. Oxford UP 1998.
    [Google Scholar]
  27. Su Yuchun, et al. “Collaborating with ChatGPT in Argumentative Writing Classrooms.” Assessing Writing, vol. 57 2023, 100752.
    [Google Scholar]
  28. Wolfe-Quintero Kate, et al.Second Language Development in Writing: Measures of Fluency, Accuracy, and Complexity. U of Hawaii P 1998.
    [Google Scholar]
  29. Yang Wenjing, and Kim Yongjin. “The Effect of Topic Familiarity on the Complexity, Accuracy, and Fluency of Second Language Writing.” Applied Linguistics Review, vol. 11, no. 1 2020, pp 79–108.
    [Google Scholar]
  30. Yang Wenjing, et al. “Different Topics, Different Discourse: Relationships among Writing Topic, Measures of Syntactic Complexity, and Judgments of Writing Quality.” Journal of Second Language Writing, vol. 28 2015, pp 53–67.
    [Google Scholar]
  31. Yoon Hyun-Ju, and Polio Charlene. “The Linguistic Development of Students of English as a Second Language in Two Written Genres.” TESOL Quarterly, vol. 51, no. 2 2017, pp 275–301.
    [Google Scholar]
  32. Zheng Yan, and Barrot Jessie. “Syntactic Complexity in Second Language (L2) Writing: Comparing Students’ Narrative and Argumentative Essays.” System, vol. 123 2024, 103342.
    [Google Scholar]
  33. Zindela Ntombifikile. “Comparing Measures of Syntactic and Lexical Complexity in Artificial Intelligence and L2 Human-Generated Argumentative Essays.” International Journal of Education and Development Using Information and Communication Technology, vol. 19, no. 3 2023, pp 50–68.
    [Google Scholar]
/content/journals/10.58680/ccc2025771148
Loading
/content/journals/10.58680/ccc2025771148
Loading

Data & Media loading...

  • Article Type: Research Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test