# Research ideas ### Mills et al. (2025) Post-intervention survey with 25 French students, looking at correlations between: - Student perceptions of the chatbot and writing platform - Anthropomorphism - Enjoyment of Lee - Teaching presence - Reported writing anxiety - Self-efficacy for self regulation - Reported writing self concept - Reported perceived value of French - Reported enjoyment of learning French - Reported writing self-efficacy ### Suggestions #### Additional variables to measure: - Attitudes toward technology/ AI - Value orientation: - Material benefits, self-transcendental goals ([Huang & Katz, 2025](https://www.mdpi.com/2504-2289/9/4/78)) - + (potentially) human-centered learning, value alignment with learner identity ([Huang, 2025](https://www.proquest.com/docview/3240875025?pq-origsite=gscholar&fromopenview=true&sourcetype=Dissertations%20&%20Theses)) - Revise "teaching presence" - Learning outcomes: - Perceived learning / Affective learning - Writing assessment scales (grammatical/textual features - type-token ratio, discourse markers, error frequency) #### Statistics: - Mixed models - Linear mixed-effects model (mode as fixed effect, individuals & time as the random effects; a method used in my recent presentation [Huang, 2025](https://gauchocast.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=98518e35-69f9-40f1-98e1-b2cf003fc423)) - Mediation/Moderation analysis #### Study design: - Pre- & post-test design - Pre-test at the beginning of the semester - Post-test every time they interact with the chatbot/ paper-based assignment - Within subjects design - Split the students groups, half do paper-based assignment first, half do AI-based assignment first, to counterbalance the order effect - Taking into account engagement with 3 steps - Quantifying time spent in each step to consider as a variable - Control by making all students spend the same amount of time in each stage #### Questions for Nicole: - How many students will there be to participate in the study? Approximately 40 - How many times in the semester will the intervention take place? - How long will the intervention take, and how long do you want the survey to be? - What was your previous experience getting IRB approval for these interventions like? - Is the paper version in Frrench or English? ### Timeline For Fall 2025: - Survey design (& hopefully some Bok internal testing with experiments for some items) - Obtaining IRB approval (ideally by early Dec) For Spring 2026: - Pre-survey sent before the beginning of class - Collect pre-intervention writing samples from students