sqpe.devContribute
← Back to research
2025 / Benchmark

UDA-Bench

Unstructured Data Analysis using LLMs: A Comprehensive Benchmark

What it contributes

Evaluates unstructured-document analysis against manually annotated relational views. The arXiv v1 workload contains five datasets and 240 queries covering extraction, filtering, aggregation, joins, and combinations of operators.

How to read the evidence

Ground truth is defined over selected schema attributes, so coverage does not extend to arbitrary open-ended document questions. Dataset counts differ between the cited arXiv version and repository descriptions; specify the artifact version when reporting results.

Publication record and benchmark-construction sections reviewed. The workload evaluates accuracy, model cost, and latency. No experiments were rerun.

Source materials

Explore the connections

DocumentsRelational ground truthEnd-to-end