التفاصيل البيبلوغرافية
| العنوان: |
Large Language Model-Driven Structured Output: A Comprehensive Benchmark and Spatial Data Generation Framework |
| المؤلفون: |
Diya Li, Yue Zhao, Zhifang Wang, Calvin Jung, Zhe Zhang |
| المصدر: |
ISPRS International Journal of Geo-Information, Vol 13, Iss 11, p 405 (2024) |
| بيانات النشر: |
MDPI AG, 2024. |
| سنة النشر: |
2024 |
| المجموعة: |
LCC:Geography (General) |
| مصطلحات موضوعية: |
spaital R-tree, large language model, generative pretrained transformer, GeoJSON, structured data, Geography (General), G1-922 |
| الوصف: |
Large language models (LLMs) have demonstrated remarkable capabilities in document processing, data analysis, and code generation. However, the generation of spatial information in a structured and unified format remains a challenge, limiting their integration into production environments. In this paper, we introduce a benchmark for generating structured and formatted spatial outputs from LLMs with a focus on enhancing spatial information generation. We present a multi-step workflow designed to improve the accuracy and efficiency of spatial data generation. The steps include generating spatial data (e.g., GeoJSON) and implementing a novel method for indexing R-tree structures. In addition, we explore and compare a series of methods commonly used by developers and researchers to enable LLMs to produce structured outputs, including fine-tuning, prompt engineering, and retrieval-augmented generation (RAG). We propose new metrics and datasets along with a new method for evaluating the quality and consistency of these outputs. Our findings offer valuable insights into the strengths and limitations of each approach, guiding practitioners in selecting the most suitable method for their specific use cases. This work advances the field of LLM-based structured spatial data output generation and supports the seamless integration of LLMs into real-world applications. |
| نوع الوثيقة: |
article |
| وصف الملف: |
electronic resource |
| اللغة: |
English |
| تدمد: |
2220-9964 |
| Relation: |
https://www.mdpi.com/2220-9964/13/11/405; https://doaj.org/toc/2220-9964 |
| DOI: |
10.3390/ijgi13110405 |
| URL الوصول: |
https://doaj.org/article/0df2df9fc4304fea8d24d648d383e62d |
| رقم الانضمام: |
edsdoj.0df2df9fc4304fea8d24d648d383e62d |
| قاعدة البيانات: |
Directory of Open Access Journals |
Full Text Finder