Generative AI vs. Traditional Databases: Insights from Industrial Engineering Applications
This study evaluates the efficiency and accuracy of Generative AI (GAI) tools, specifically ChatGPT and Gemini, in comparison with traditional academic databases for industrial engineering research. It was conducted in two phases. First, a survey was administered to 101 students to assess their fami...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-03-01
|
| Series: | Publications |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2304-6775/13/2/14 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | This study evaluates the efficiency and accuracy of Generative AI (GAI) tools, specifically ChatGPT and Gemini, in comparison with traditional academic databases for industrial engineering research. It was conducted in two phases. First, a survey was administered to 101 students to assess their familiarity with GAIs and the most commonly used tools in their academic field. Second, an assessment of the quality of the information provided by GAIs was carried out, in which 11 industrial engineering professors participated as evaluators. The study focuses on the query process, response times, and information accuracy, using a structured methodology that includes predefined prompts, expert validation, and statistical analysis. A comparative assessment was conducted through standardized search workflows developed using the Bizagi tool, ensuring consistency in the evaluation of both approaches. Results demonstrate that GAIs significantly reduce query response times compared to conventional databases, although the accuracy and completeness of responses require careful validation. A Chi-Square analysis was performed to statistically assess accuracy differences, revealing no significant disparities between the two AI tools. While GAIs offer efficiency advantages, conventional databases remain essential for in-depth literature searches requiring high levels of precision. These findings highlight the potential and limitations of GAIs in academic research, providing insights into their optimal application in industrial engineering education. |
|---|---|
| ISSN: | 2304-6775 |