Chapter 3: The Effect of Artificial Intelligence on Academic Writing Among Grade 11 Cookery Students
A comprehensive methodological framework examining AI’s impact on student writing
Key Insights
- Mixed-Methods Design: Combining quantitative and qualitative approaches to capture diverse insights.
- Targeted Participants: Focus on Grade 11 cookery students using purposive sampling for relevant experience.
- Robust Data Collection: Utilizing surveys, interviews, writing samples, and AI usage logs for comprehensive analysis.
Research Design
The study employs a mixed-methods research design, integrating both quantitative and qualitative approaches. This combination is particularly effective for understanding not only numerical changes in academic writing but also the nuanced experiences and perceptions of Grade 11 cookery students using artificial intelligence (AI) tools. The quantitative component is geared toward measuring improvements and differences in writing quality, while the qualitative component delves into the students’ personal experiences, challenges, and attitudes toward AI-assisted writing. Such an integrative approach provides a holistic picture of AI’s influence on academic performance.
Quantitative Aspect
Quantitative research involves structured research instruments, such as surveys and pre-defined rubrics for grading writing assignments. Tools like descriptive statistical analysis, paired t-tests, and correlation measures (e.g., Pearson r) are employed to determine the degree to which AI tools might impact the clarity, coherence, and overall quality of the students' academic writing. Additionally, by collecting writing samples before and after the introduction of AI tools, the study can assess measurable improvements and compare both datasets statistically.
Qualitative Aspect
The qualitative part is essential for understanding in-depth student experiences with AI tools. Semi-structured interviews, focus groups, and thematic analysis are used to extract common themes, challenges, and perceptions. This method helps identify not only the benefits but also possible drawbacks or difficulties faced by students when integrating AI into their writing process. The triangulation of qualitative data with quantitative findings further strengthens the reliability of the study’s conclusions.
Participants of the Study
The target population for this study consists of Grade 11 cookery students from a selected high school. An emphasis is placed on ensuring that the selected participants have had exposure to AI tools in their academic writing process. A purposive sampling strategy is adopted to deliberately select students who exhibit certain characteristics relevant to the study: a level of familiarity with AI technologies and active involvement in academic writing tasks.
Sample Size and Sampling Technique
The sample size is determined based on the total number of Grade 11 cookery students available, with an anticipated range of 30 to 50 students. This range is deemed sufficient for capturing a wide array of experiences while allowing comprehensive statistical analysis. Efforts are made to ensure that both male and female students are included to mitigate any gender biases.
Instrument of the Study
Multiple instruments are employed to gather a broad spectrum of data. Here is an outline of the key instruments used:
| Instrument | Purpose | Method of Implementation |
|---|---|---|
| Survey Questionnaire | Collect quantitative data on students' use of AI, perceptions of its effectiveness, and self-assessment on writing proficiency. | Online or paper-based distribution ensuring informed consent and anonymity. |
| Interview Guides | Gather qualitative insights into student experiences, challenges, and feedback regarding AI use in writing. | Semi-structured interviews conducted in person or virtually. |
| Writing Samples | Assess writing quality before and after the AI intervention using predefined rubrics. | Collection of assignment samples with and without AI assistance. |
| AI Usage Logs | Track frequency and extent of AI tool usage in academic writing. | Digital logging systems provided by the AI tool platform. |
The instruments are designed to be valid and reliable, with pilot testing ensuring that each tool accurately captures the intended data. Expert validation is sought to guarantee that survey questions, interview protocols, and writing assessment rubrics measure relevant constructs effectively.
Data Gathering Procedure
The study follows a systematic, phased approach to data collection. Multiple steps are taken to ensure data reliability and ethical compliance throughout the process.
Phase 1: Pre-Study Preparation
Before the main investigation, a preliminary survey is distributed to collect baseline data on the participants’ current writing skills and their initial exposure to AI tools. Informed consent forms are also gathered to ensure ethical compliance.
Phase 2: AI Tool Introduction
Participants are introduced to selected AI writing tools through a guided tutorial. This phase ensures that all students have a basic understanding of how to use the AI tools effectively in their writing tasks.
Phase 3: Active Data Collection
In this phase, several writing assignments are assigned to the students over a defined period. Students are encouraged to use AI tools where necessary. Alongside the assignments, students complete:
- A detailed survey regarding their experiences and perceived benefits of using AI tools.
- Participation in focus groups or individual interviews aimed at capturing qualitative data.
- Submission of writing samples created before and after AI intervention.
Phase 4: Post-Study Feedback
Following the assignment period, a second round of surveys and interviews is conducted to evaluate improvements and gather additional insights about AI’s influence on academic writing. The collected data from this phase is compared against the baseline data to determine any significant changes.
Data Analysis Procedure
The data analysis in this study is conducted using a balanced approach combining both quantitative and qualitative techniques. This ensures that numerical trends are supported by contextual and experiential data.
Quantitative Analysis
Descriptive statistics are used to summarize survey responses and demographic characteristics. This includes calculating means, percentages, and frequencies related to students' usage patterns and AI tool satisfaction ratings. Inferential statistics – including paired t-tests – are applied to compare writing samples before and after AI intervention. The use of software such as SPSS or Excel facilitates this analysis.
Additionally, correlation analyses (e.g., Pearson \(\(r\)\)) are performed to examine relationships between the frequency of AI tool usage and improvements in specific aspects of writing, such as grammar, clarity, and coherence.
Qualitative Analysis
Thematic analysis is employed to analyze data from interviews and focus groups. Researchers transcribe recorded sessions and code the data to identify recurring patterns, themes, and sub-themes. This approach helps in capturing the nuanced experiences of participants, such as their perception of AI as a supportive aid in writing or as a potential hindrance.
Content analysis is also utilized to quantitatively assess the improvement in writing artefacts. Writing samples are systematically analyzed using predefined rubrics, evaluating elements like structure, grammar, coherence, and creativity.
Triangulation
Combining quantitative data from surveys and writing samples with qualitative insights from interviews ensures triangulation, which increases the validity of the study. This method allows the integration of diverse data sources to establish comprehensive conclusions regarding AI's impact on academic writing.
References
- Research Design - Scribbr
- Nursing Research Design - University of Pittsburgh
- Research Outline - Course Hero
- Educators' Perspectives on AI and Writing - ResearchGate
- Impact of AI on Academic Writing - Taylor & Francis Online
Recommended Related Queries
Last updated March 11, 2025