Purpose: This study aimed to compare ChatGPT-4 and Gemini 2.5 Pro in meeting the information needs of doctoral students in Persian. The focus was to examine how accurately, relevantly, clearly, practically, diversely, and effectively each model supports academic, specialized, and Persian-language information-seeking needs.
Method: The study used a mixed-methods approach. The participants included 36 doctoral students from the Faculty of Psychology and Educational Sciences at Kharazmi University during the 2024–2025 academic year, selected through purposive sampling. An initial questionnaire and a comparative questionnaire were used, and the students evaluated the relevant indicators after direct interaction with both models. In the qualitative phase, think-aloud protocols, semi-structured interviews, and observation of the interaction process using Morae software were employed. Quantitative data were analyzed using the Wilcoxon signed-rank test, while qualitative data were analyzed through coding in MAXQDA.
Findings: The findings showed that the superiority of the two models does not follow a uniform pattern. ChatGPT-4 was rated significantly higher in overall performance, and users found it more effective in initiating searches, organizing interaction, formulating the initial problem, and enhancing information-seeking confidence. In contrast, Gemini 2.5 Pro showed significant superiority in the accuracy of scientific and specialized responses, the diversity of information, the coverage of different aspects of the topic, and the practical usefulness of responses. No significant difference was found between the two models in terms of comprehensibility. The qualitative findings also indicated that Gemini 2.5 Pro was more strongly associated with content depth, comprehensiveness, and support for research work, whereas ChatGPT-4 was mainly described in terms of conversational fluency, response organization, and user reassurance.
Conclusion: The results indicate that the two models are complementary tools. ChatGPT-4 is better suited to initiating searches and organizing users’ thinking, while Gemini 2.5 Pro is more useful for specialized, research-oriented questions. However, neither model can replace academic databases, expert judgment, or the researcher’s critical evaluation.
