Academic Journal

Evaluating GPT-4V’s performance in the Japanese national dental examination: A challenge explored

التفاصيل البيبلوغرافية
العنوان: Evaluating GPT-4V’s performance in the Japanese national dental examination: A challenge explored
المؤلفون: Masaki Morishita, Hikaru Fukuda, Kosuke Muraoka, Taiji Nakamura, Masanari Hayashi, Izumi Yoshioka, Kentaro Ono, Shuji Awano
المصدر: Journal of Dental Sciences, Vol 19, Iss 3, Pp 1595-1600 (2024)
بيانات النشر: Elsevier, 2024.
سنة النشر: 2024
المجموعة: LCC:Dentistry
مصطلحات موضوعية: ChatGPT-4V, Image recognition, National dental examination, Medical image analysis, Dentistry, RK1-715
الوصف: Background/purpose: Rapid advancements in AI technology have led to significant interest in its application across various fields, including medicine and dentistry. This study aimed to assess the capabilities of ChatGPT-4V with image recognition in answering image-based questions from the Japanese National Dental Examination (JNDE) to explore its potential as an educational support tool for dental students. Materials and methods: The dataset used questions from the JNDE, which was conducted in January 2023, with a focus on image-related queries. ChatGPT-4V was utilized, and standardized prompts, question texts, and images were input. Data and statistical analyses were conducted using Qlik Sense® and GraphPad Prism. Results: The overall correct response rate of ChatGPT-4V for image-based JNDE questions was 35.0 %. The correct response rates were 57.1 % for compulsory questions, 43.6 % for general questions, and 28.6 % for clinical practical questions. In specialties like Dental Anesthesiology and Endodontics, ChatGPT-4V achieved correct response rates above 70 %, while response rates for Orthodontics and Oral Surgery were lower. A higher number of images in questions was correlated with lower accuracy, suggesting an impact of the number of images on correct and incorrect responses. Conclusion: While innovative, ChatGPT-4V’s image recognition feature exhibited limitations, especially in handling image-intensive and complex clinical practical questions, and is not yet fully suitable as an educational support tool for dental students at its current stage. Further technological refinement and re-evaluation with a broader dataset are recommended.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 1991-7902
Relation: http://www.sciencedirect.com/science/article/pii/S1991790223003999; https://doaj.org/toc/1991-7902
DOI: 10.1016/j.jds.2023.12.007
URL الوصول: https://doaj.org/article/1aab5840951f435aa8da0a2a4c2abb00
رقم الانضمام: edsdoj.1aab5840951f435aa8da0a2a4c2abb00
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:19917902
DOI:10.1016/j.jds.2023.12.007