New approach for classifying unstructured data to understand the influence of new technologies in future ERP development

english

2025

volume 16, issue 2

Enterprise resource planning (ERP) systems   generative artificial intelligence (GenAI)   text classification

GEA College
(Obvezni izvod spletne publikacije)

The rapid development of emerging technologies is changing the business world every day. Process automation, artificial intelligence (AI) consultants, mobile devices, cloud technologies, no-code programming, and many more are influencing the requirements for business systems. The current study aims to compare human experts and generative AI (GenAI) in classifying unstructured text to identify the emerging technologies that will have the greatest impact on the future development of enterprise resource planning systems. The basis for the comparison is statistical indicators such as the average Jaccard index and Krippendorff’s alpha, which validate the classification from both approaches.The results indicate that GenAI holds potential for process automation, whereas human classification is more closely aligned with statistical indicators. GenAI has difficulties with contextual nuances and specific categories. Hence, a four-step funnel-based framework for the efficient classification of unstructured text was developed, which integrates GenAI for initial structuring and training while emphasizing the indispensable role of human supervision for quality assurance to leverage automation while maintaining the validity of the results. This approach significantly reduces manual effort while maintaining reliable analysis

02.07.2026