Mapping GenAI Literacy: Disciplinary Differences, Latent Profiles, and Perceptions Among EMI Undergraduates

Aim/Purpose
This study aims to explore the Generative AI (GenAI) literacy of Chinese English-medium instruction (EMI) undergraduates, investigating disciplinary variations across engineering, mathematics, and humanities and social sciences, and identifying distinct literacy profiles among engineering and non-engineering students. It also seeks to understand students' self-perceptions of their GenAI literacy.

Background
The advent of GenAI tools has reshaped higher education, offering personalised academic support and aiding non-native English speakers. While traditionally focused on STEM fields, the widespread adoption of GenAI, alongside concerns about accuracy and ethics, emphasises the urgent need for GenAI literacy education across all disciplines. However, gaps remain in our understanding of how students' GenAI literacy varies across disciplines and how their underlying literacy profiles are shaped, particularly in EMI contexts, where non-native English-speaking students face additional linguistic challenges.

Methodology
Utilising a mixed-methods approach, the research assesses five critical dimensions of GenAI literacy: basic technical proficiency, communication proficiency, creative application, critical evaluation, and ethical competence. The quantitative phase, which included 347 questionnaire participants recruited via convenience sampling, employed the Kruskal-Wallis test to examine disciplinary differences in GenAI competencies. Further, a multigroup latent profile analysis was conducted to identify distinct literacy profiles. To complement the quantitative findings, follow-up semi-structured interviews were carried out with 24 students to collect in-depth qualitative data. These interviewees were drawn from the questionnaire participants using a nested sampling strategy. Reflexive thematic analysis was then applied to uncover key themes related to students' perceived GenAI literacy.

Contribution
This study provides empirical evidence on GenAI literacy by highlighting disciplinary disparities and identifying distinct learner profiles within an EMI university context. Leveraging a mixed-methods design, it allowed for the collection of qualitative interview data on students' self-perceptions to explain the quantitative findings. This work offers a foundation for designing equitable and targeted strategies to develop students' AI literacy across all disciplines, a pressing need in EMI contexts where learners navigate additional linguistic challenges.

Findings
The Kruskal-Wallis test results indicated that, with the exception of ethical competence, engineering students outperformed their peers in mathematics and humanities and social sciences across four dimensions of GenAI literacy: basic technical proficiency, communication proficiency, creative application, and critical evaluation. Additionally, the multigroup latent profile analysis identified three distinct literacy profiles among both engineering and non-engineering students: Foundational Learners, Balanced Practitioners, and Proficient Achievers. Complementary qualitative insights from interviews corroborated these findings and provided nuanced explanations of the underlying patterns.

Recommendations for Practitioners
Synthesising these insights, we propose evidence-based pedagogical recommendations: the integration of AI literacy courses across all disciplines to foster foundational competencies and equitable access, and the implementation of profile-specific educational strategies to enhance personalised learning.

Recommendations for Researchers
Researchers should continue refining the theoretical framework of GenAI literacy while developing rigorous methods to measure it effectively.

Impact on Society
The insights from this study into GenAI literacy and its disciplinary variations will enable universities to develop more responsive and inclusive educational strategies, ultimately fostering a more AI-literate society. This will ensure that graduates across all disciplines are better prepared to effectively and critically engage with AI technologies in their future careers and daily lives.
Future Research Future research should consider stratified sampling across multiple institutions, regions, and cross-national contexts to capture a more representative picture of GenAI engagement and facilitate meaningful comparisons across educational systems. In addition, while the study focused on undergraduates, postgraduate students and academic staff are also critical stakeholders in the AI literacy agenda. Investigating how these groups engage with GenAI could provide valuable comparative insights. More importantly, the identification of learner profiles also raises new questions about movement between profiles over time and the kinds of interventions that support such transitions. Longitudinal studies and action research involving instructional design experiments could help clarify how GenAI literacy evolves and what pedagogical strategies are most effective for supporting growth.