---
# System prepended metadata

title: mills-ai-research

---

# Research ideas
### Mills et al. (2025)
Post-intervention survey with 25 French students, looking at correlations between:
- Student perceptions of the chatbot and writing platform
    - Anthropomorphism
    - Enjoyment of Lee
    - Teaching presence
- Reported writing anxiety
- Self-efficacy for self regulation
- Reported writing self concept
- Reported perceived value of French
- Reported enjoyment of learning French
- Reported writing self-efficacy

### Suggestions
#### Additional variables to measure:
- Attitudes toward technology/ AI
- Value orientation: 
    - Material benefits, self-transcendental goals ([Huang & Katz, 2025](https://www.mdpi.com/2504-2289/9/4/78))
    - + (potentially) human-centered learning, value alignment with learner identity ([Huang, 2025](https://www.proquest.com/docview/3240875025?pq-origsite=gscholar&fromopenview=true&sourcetype=Dissertations%20&%20Theses))
    - Revise "teaching presence"
- Learning outcomes:
    - Perceived learning / Affective learning
    - Writing assessment scales (grammatical/textual features - type-token ratio, discourse markers, error frequency)

#### Statistics:
- Mixed models
    - Linear mixed-effects model (mode as fixed effect, individuals & time as the random effects; a method used in my recent presentation [Huang, 2025](https://gauchocast.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=98518e35-69f9-40f1-98e1-b2cf003fc423))
- Mediation/Moderation analysis

#### Study design:
- Pre- & post-test design
    - Pre-test at the beginning of the semester
    - Post-test every time they interact with the chatbot/ paper-based assignment
- Within subjects design
    - Split the students groups, half do paper-based assignment first, half do AI-based assignment first, to counterbalance the order effect
- Taking into account engagement with 3 steps
    - Quantifying time spent in each step to consider as a variable
    - Control by making all students spend the same amount of time in each stage

#### Questions for Nicole:
- How many students will there be to participate in the study? Approximately 40
- How many times in the semester will the intervention take place?
    - How long will the intervention take, and how long do you want the survey to be? 
- What was your previous experience getting IRB approval for these interventions like? 
- Is the paper version in Frrench or English?

### Timeline
For Fall 2025:
- Survey design (& hopefully some Bok internal testing with experiments for some items)
- Obtaining IRB approval (ideally by early Dec)

For Spring 2026:
- Pre-survey sent before the beginning of class
- Collect pre-intervention writing samples from students