Revisiting Data Analysis with Pre-trained Foundation Models

التفاصيل البيبلوغرافية
العنوان: Revisiting Data Analysis with Pre-trained Foundation Models
المؤلفون: Liang, Chen, Yang, Donghua, Liang, Zheng, Liang, Zhiyu, Zhang, Tianle, Xiao, Boyu, Yang, Yuqing, Wang, Wenqi, Wang, Hongzhi
سنة النشر: 2025
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Databases
الوصف: Data analysis focuses on harnessing advanced statistics, programming, and machine learning techniques to extract valuable insights from vast datasets. An increasing volume and variety of research emerged, addressing datasets of diverse modalities, formats, scales, and resolutions across various industries. However, experienced data analysts often find themselves overwhelmed by intricate details in ad-hoc solutions or attempts to extract the semantics of grounded data properly. This makes it difficult to maintain and scale to more complex systems. Pre-trained foundation models (PFMs), grounded with a large amount of grounded data that previous data analysis methods can not fully understand, leverage complete statistics that combine reasoning of an admissible subset of results and statistical approximations by surprising engineering effects, to automate and enhance the analysis process. It pushes us to revisit data analysis to make better sense of data with PFMs. This paper provides a comprehensive review of systematic approaches to optimizing data analysis through the power of PFMs, while critically identifying the limitations of PFMs, to establish a roadmap for their future application in data analysis.
Comment: 22 pages, 7 figures
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2501.01631
رقم الانضمام: edsarx.2501.01631
قاعدة البيانات: arXiv