Open catalog.

Semantic Operators: A Declarative Model for Rich, AI-based Data Processing

Liana Patel, Siddharth Jha, Parth Asawa, Melissa Pan, Carlos Guestrin, Matei Zaharia. 2024.

Natural-language specifications for filtering, joining, sorting and aggregation, with optimized implementations evaluated against a reference algorithm.

UQE: A Query Engine for Unstructured Databases

Hanjun Dai, Bethany Yixin Wang, Xingchen Wan, Bo Dai, Sherry Yang, Azade Nova, Pengcheng Yin, Phitchaya Mangpo Phothilimthana, Charles Sutton, Dale Schuurmans. 2024.

A SQL-like language for reasoning over images, conversations and reviews, combining foundation models with sampling and execution optimization.

A Declarative System for Optimizing AI Workloads

Chunwei Liu, Matthew Russo, Michael Cafarella, Lei Cao, Peter Baille Chen, Zui Chen, Michael Franklin, Tim Kraska, Samuel Madden, Gerardo Vitagliano. 2024.

Turns declarative AI analytics into executable plans that trade off output quality, runtime and model cost.

DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing

Shreya Shankar, Tristan Chambers, Tarak Shah, Aditya G. Parameswaran, Eugene Wu. 2024.

Rewrites complex document workflows by decomposing tasks and data, using agents to propose and evaluate better execution plans.

SUQL: Conversational Search over Structured and Unstructured Data with Large Language Models

Shicheng Liu et al. 2023.

Composes structured queries with free-text answering and summarization, supporting conversational access to hybrid knowledge sources.

SemBench: A Benchmark for Semantic Query Processing Engines

Jiale Lao et al. 2025.

Evaluates semantic engines across text, image and audio scenarios using filters, joins, mappings, ranking and classification.

Large Language Model-Enhanced Relational Operators: Taxonomy, Benchmark, and Analysis

Yunxiang Su, Tianjing Zeng, Zhongjun Ding, Yin Lin, Rong Zhu, Zhewei Wei, Bolin Ding, Jingren Zhou. 2026.

Organizes Select, Match, Impute, Cluster and Order operators into single-operator and multi-operator workloads over relational databases.

Sema: A High-performance System for LLM-based Semantic Query Processing

Kangkang Qi et al. 2026.

Integrates semantic expressions into SQL and combines logical rewrites with adaptive reordering, fusion and prompt batching.

NousDB - A Fast Query Engine for Semantic Analytics

Christos Tsapelas, Georgia Koutrika, Yannis Ioannidis. arXiv:2610.28551, 2026. Version 1 requested; v2 was posted October 21, 2026.

A DataFusion-based engine using semantic algebra, token histograms and context-aware batching to optimize AI analytics.

Prune First, Decide Fast: Scalable Semantic Query Processing with JEVDB

Zhengle Wang, Hanxu Yan, Fuheng Zhao, Chunwei Liu. arXiv:2610.02046, 2026.

Uses decision models for semantic operations, escalates uncertain cases to generative models and prunes semantic-join candidates.

Semantic Views: Certified Reuse of LLM Labels Across Semantic Queries

Oktie Hassanzadeh, Dharmashankar Subramanian. arXiv:2610.12768, 2026. Code/data.

Reuses prior query labels as ranking signals and applies fresh stratified oracle sampling to certify filter precision and recall.

Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing

Oktie Hassanzadeh, Dharmashankar Subramanian. arXiv:2610.13823, 2026. Code/data.

Studies how repeated model decisions propagate into changing query answers and proposes reporting practices for reproducible evaluation.

From Interpretation to Compilation: A Compilation-Based Execution Engine for Semantic Operator Systems

Wenkai Dong, Yifan Wang. arXiv:2608.06677, 2026. Code.

Compiles suitable semantic operations into local Python functions, routing between compiled and native execution using cost estimates.

Kalypso: Relational LLM Serving

Hojae Son, Md Ashraful Islam, Huy Gia Cao, Hui Guan, Marco Serafini. 2026.

Makes model serving aware of semantic operator dependencies, pipelining tuples to reuse KV-cache state under memory constraints.

Beyond Quacking: Deep Integration of Language Models and RAG into DuckDB

Anas Dorbani, Sunny Yasser, Jimmy Lin, Amine Mhedhbi. 2025.

Adds model-backed scalar and aggregate functions, with PROMPT and MODEL schema objects plus batching and caching optimizations.

iPDB -- Optimizing Semantic SQL Queries

Udesh Kumarasinghe, Tyler Liu, Chunwei Liu, Walid G. Aref. 2026.

Supports in-database ML and LLM inference through a relational predict operator and optimizations across semantic SQL operations.

PLOP: Cost-Based Placement of Semantic Operators in Hybrid Query Plans

Qiuyang Mang et al. 2026.

Balances model-call cost against relational processing cost when choosing semantic operator placement in mixed query plans.

Optimizing LLM Queries in Relational Data Analytics Workloads

Shu Liu et al. 2024.

Reorders table rows and fields to increase shared prompt prefixes and improve KV-cache reuse during batch model inference.

Access Paths for Efficient Ordering with Large Language Models

Fuheng Zhao, Jiayue Chen, Yiming Pan, Tahseen Rabbani, Sohaib, Divyakant Agrawal, Amr El Abbadi, Paritosh Aggarwal, Anupam Datta, Dimitris Tsirogiannis. 2025/2026.

Studies physical implementations of semantic ordering and a budget-aware optimizer that chooses among ranking access paths.

Larch: Learned Query Optimization for Semantic Predicates

Fuheng Zhao, Pawel Liskowski, Zihan Li, Benjamin Han, Puxuan Yu, Varich Boonsanong, Dimitris Tsirogiannis, Anupam Datta. 2026.

Learns per-row evaluation orders for semantic predicates, using either a sequential decision policy or predicted selectivities.

Fast LLM-Based Semantic Filtering: From a Unified Framework to an Adaptive Two-Phase Method

Kyoungmin Kim, Martin Catheland, Anastasia Ailamaki. 2026.

Combines clustering and learned proxies adaptively, using token-aware representations and oracle confidence to reduce expensive filtering calls.

SemJoin: Semantic Join Optimization

Christopher Gou, Aditya Banerjee, Jiaxuan Wang, Chunwei Liu. VLDB 2026 Workshop: NOVAS / arXiv 2026.

Uses an LLM advisor to route joins between clustering-based candidate pruning and classification into a shared label space.

Unstructured Data Analysis using LLMs: A Comprehensive Benchmark

Qiyan Deng et al. PVLDB 2026; preprint arXiv:2510.27119. Code.

Evaluates unstructured-document analysis against manually annotated relational views. The arXiv v1 workload contains five datasets and 240 queries covering extraction, filtering, aggregation, joins, and combinations of operators.

Prune First, Decide Fast: Scalable Semantic Query Processing with JEVDB

Extends TPC-DS-derived relations with return reports, issue bulletins, and release notes to study semantic-join scaling. The JEVDB paper evaluates five queries at XS, S, and M tiers.

Spider 2.0-AIFunc: Extending Real-World Text-to-SQL to AI-Native SQL Workflows

Tianyang Liu, Canwen Xu, Fangyu Lei, Nikki Lijing Kuang, Jixuan Chen, Tao Yu, Julian McAuley, Zhewei Yao, Yuxiong He. 2026.

Tests whether models generate Snowflake SQL that composes relational operations with AI functions for classification, filtering, sentiment analysis, extraction, similarity, and aggregation.

Text2VectorSQL: Towards a Unified Interface for Vector Search and SQL Queries

Benchmarks generation of queries combining relational operations and vector search, spanning three database backends and four source collections. Examines result omissions when SQL filters interact with vector retrieval.

Benchmarking Hybrid Deep Research Across Database Querying and Web Search

Ruofan Wu, Peiran Xu, Xiaolong Li, Fan Shu, Soyoung Yoon, Yite Wang, Xiaodong Yu, Boyi Liu, Feng Yan, Debiao Li, Yuxiong He, Zhewei Yao. 2026.

Evaluates agents on 380 tasks requiring both database queries and web evidence. Tasks exercise database-to-search, search-to-database, and parallel reasoning, with an emphasis on preserving constraints across tools.

The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators

Tarfah Alrashed, Fatma Ozcan, Per Jacobsson, Tal Neiman, Xianshun Chen. 2026.

Studies failures of exact-result scoring for SQL with stochastic AI operators. Proposes evaluating relational logic and semantic operations separately, with experiments on BigQuery and ThalamusDB.

BigQuery generative AI functions

Managed AI functions bring generation, filtering, classification and scoring into SQL over structured and unstructured data.

Snowflake Cortex AI Functions / AISQL

SQL-callable AI functions support classification, filtering, extraction, summarization and aggregation inside the Snowflake platform.

Databricks ai_query

The ai_query function invokes a model-serving endpoint from SQL and parses the response for real-time or batch inference workflows.

Demo of SemWeave: Semantic Common Expressions for LLM-powered Query Processing

Md. Tareq Mahmood, Venkatesh Emani, Hangdong Zhao, Shivaram Venkataraman. SIGMOD Companion, 2026.

100x Cost & Latency Reduction: Performance Analysis of AI Query Approximation using Lightweight Proxy Models

Yeounoh Chung, Rushabh Desai, Jian He, Yu Xiao, Thibaud Hottelier, Yves-Laurent Kom Samo, Pushkar Khadilkar, Xianshun Chen, Sam Idicula, Fatma Özcan, Alon Halevy, Yannis Papakonstantinou. Proc. ACM Manag. Data / SIGMOD 2026. See also arXiv:2603.15970.

Cortex AISQL: A Production SQL Engine for Unstructured Data

Paritosh Aggarwal et al. 2025.

Meta Engine: A Unified Semantic Query Engine on Heterogeneous LLM-Based Query Systems

Ruyu Li et al. 2026.

CADENZA: Compiling Natural-Language Intent into Task-Specific Operator DAGs for Semantic Query Processing

Jaehyun Ha, Yongjoo Park, Wook-Shin Han. SIGMOD 2027 / arXiv 2026.

Featurized-Decomposition Join: Low-Cost Semantic Joins with Guarantees

Sepanta Zeighami, Shreya Shankar, Aditya Parameswaran. 2025.

Accelerating Approximate Analytical Join Queries over Unstructured Data with Statistical Guarantees

Yuxuan Zhu, Tengjun Jin, Chenghao Mo, Daniel Kang. Proc. ACM Manag. Data / SIGMOD 2026.

ListK: Semantic ORDER BY and LIMIT K with Listwise Prompting

Jason Shin, Jiwon Chang, Fatemeh Nargesian. 2026.

Approximating Opaque Top-k Queries

Jiwon Chang, Fatemeh Nargesian. Proc. ACM Manag. Data 2025.

RankLLM: A Framework for Ranking with Large Language Models

Shervin Sharifymoghaddam et al. 2025.

RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!

Ronak Pradeep, Sahel Sharifymoghaddam, Jimmy Lin. 2023.

Query-Centric Optimization of AI Workflows via Approximate Query Processing and Proxy Models

Huayi Wang, Jun Xu, Gromit Yeuk-Yin Chan. 2026.

Aero/Hydro: Adaptive Query Processing of ML Queries

Gaurav Tarlok Kakkar, Jiashen Cao, Aubhro Sengupta, Joy Arulraj, Hyesoon Kim. 2024/2025.

Extending Relational Query Processing with ML Inference

Konstantinos Karanasos, Matteo Interlandi, Doris Xin, Fotis Psallidas, Rathijit Sen, Kwanghyun Park, Ivan Popivanov, Supun Nakandal, Subru Krishnan, Markus Weimer, Yuan Yu, Raghu Ramakrishnan, Carlo Curino. CIDR 2020.

The Duck's Brain: Training and Inference of Neural Networks in Modern Database Engines

Maximilian E. Schule, Thomas Neumann, Alfons Kemper. 2023/2024.

MADlib: The MADlib Analytics Library, or MAD Skills, the SQL

Joseph M. Hellerstein, Christopher Re, Florian Schoppmann, Daisy Zhe Wang, Eugene Fratkin, Aleksander Gorajek, Kee Siong Ng, Caleb Welton, Xixuan Feng, Kun Li, Arun Kumar. PVLDB 2012.

DuckDB: an Embeddable Analytical Database

Mark Raasveldt, Hannes Mühleisen. SIGMOD 2019.

MonetDB/X100: Hyper-Pipelining Query Execution

Peter Boncz, Marcin Zukowski, Niels Nes. CIDR 2005.

BioDEX: Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilance

Karel D'Oosterlinck et al. Findings of EMNLP 2023.

Implementing Semantic Join Operators Efficiently

Immanuel Trummer. 2025. Also referred to above as the Adaptive Block Join / ABJ line of work.

Abacus: A Cost-Based Optimizer for Semantic Operator Systems

Konstantinos Chasialis, Yannis Foufoulas, Alkis Simitsis, Yannis Ioannidis, Samuel Madden, Michael Cafarella. 2025.

Quest: Query Optimization in Unstructured Document Analysis

Zhaoze Sun, Qiyan Deng, Chengliang Chai, Kaisen Jin, Xinyu Guo, Han Han, Ye Yuan, Guoren Wang, Lei Cao. 2025.

ScaleDoc: Scaling LLM-based Predicates over Large Document Collections

Hengrui Zhang, Yulong Hui, Yihao Liu, Huanchen Zhang. 2025.

Beyond Linear LLM Invocation: An Efficient and Effective Semantic Filter Paradigm

Nan Hou, Kangfei Zhao, Jiadong Xie, Jeffrey Xu Yu. 2026.

Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees

Sepanta Zeighami, Shreya Shankar, Aditya Parameswaran. Proc. ACM Manag. Data 3(6), 2025. Cited in semantic filtering and join papers as BARGAIN-style cascade work.

KEN: An Execution Engine for Unstructured Database Systems

Ferdinand Kossmann, Ziniu Wu, Alex Turk, Nesime Tatbul, Lei Cao, Samuel Madden. PVLDB 2026.

Making Prompts First-Class Citizens for Adaptive LLM Pipelines

Ugur Cetintemel, Shu Chen, Alexander W. Lee, Deepti Raghavan. 2025.

Streaming Model Cascades for Semantic SQL

Pawel Liskowski, Kyle Schmaus. 2026.

BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational Algebra

Parker Glenn, Parag Pravin Dakle, Liang Wang, Preethi Raghavan. 2024.

Hybrid Querying Over Relational Databases and Large Language Models

Fuheng Zhao, Divyakant Agrawal, Amr El Abbadi. 2024.

Logical and Physical Optimizations for SQL Query Execution over Large Language Models

Dario Satriani, Enzo Veltri, Donatello Santoro, Sara Rosato, Simone Varriale, Paolo Papotti. Proc. ACM Manag. Data / SIGMOD 2025.

ThalamusDB: Approximate Query Processing on Multi-Modal Data

Saehan Jo, Immanuel Trummer. Proc. ACM Manag. Data 2024.

Primary source link awaiting verification.

Approximate Selection with Guarantees using Proxies

Daniel Kang, Edward Gan, Peter Bailis, Tatsunori Hashimoto, Matei Zaharia. PVLDB 2020.

Accelerating Approximate Aggregation Queries with Expensive Predicates

Daniel Kang, John Guibas, Peter Bailis, Tatsunori Hashimoto, Yi Sun, Matei Zaharia. PVLDB 2021.

Accelerating Machine Learning Inference with Probabilistic Predicates

Yao Lu, Aakanksha Chowdhery, Srikanth Kandula, Surajit Chaudhuri. SIGMOD 2018.

Wander Join: Online Aggregation for Joins

Feifei Li, Bin Wu, Ke Yi, Zhuoyue Zhao. SIGMOD 2016.

Eddies: Continuously Adaptive Query Processing

Ron Avnur, Joseph M. Hellerstein. SIGMOD 2000.

BlazeIt: Optimizing Declarative Aggregation and Limit Queries for Neural Network-Based Video Analytics

Daniel Kang, Peter Bailis, Matei Zaharia. PVLDB 2019.

NoScope: Optimizing Neural Network Queries over Video at Scale

Daniel Kang, John Emmons, Firas Abuzaid, Peter Bailis, Matei Zaharia. PVLDB 2017.

The Design of an LLM-powered Unstructured Analytics System (Aryn/Sycamore)

Eric Anderson et al. CIDR 2025. A closely related declarative-document architecture discussed by NousDB.

Apache DataFusion: A Fast, Extensible Query Engine for Building High-Quality Data-Centric Systems

Query-engine substrate used by NousDB.

Efficiently Linking Unstructured Data for Multi-step Reasoning

Jiaming Liang, Haydn Jones, Jacob R. Gardner, Mark Yatskar, Zachary Ives. 2026.

Factorized and Vectorized Execution: Optimizing Analytical and Semantic Queries over Relations

Sunny Yasser, Anas Dorbani, Amine Mhedhbi. Proc. ACM Manag. Data 4(3), Article 178, 2026.

vLLM: Efficient Memory Management for Large Language Model Serving with PagedAttention

Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, Ion Stoica. SOSP 2023.

SGLang: Efficient Execution of Structured Language Model Programs

Lianmin Zheng et al. 2024.

Orca: A Distributed Serving System for Transformer-Based Generative Models

Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, Byung-Gon Chun. OSDI 2022.

Sarathi-Serve: Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve

Amey Agrawal et al. OSDI 2024.

DistServe: Disaggregating Prefill and Decoding for Goodput-Optimized Large Language Model Serving

Yinmin Zhong et al. OSDI 2024.

Llumnix: Dynamic Scheduling for Large Language Model Serving

Biao Sun et al. OSDI 2024.

Prompt Cache: Modular Attention Reuse for Low-Latency Inference

In Gim et al. MLSys 2024.

Continuous Prompts: LLM-Augmented Pipeline Processing over Unstructured Streams

Shu Chen, Deepti Raghavan, Uğur Çetintemel. 2025.

SemPipes: Optimizable Semantic Data Operators for Tabular Machine Learning Pipelines

Olga Ovcharenko, Matthias Boehm, Sebastian Schelter. 2026.

Task Cascades for Efficient Unstructured Data Processing

Shreya Shankar, Sepanta Zeighami, Aditya Parameswaran. 2026.

Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analytics

Matthew Russo, Tim Kraska. 2025.

Text2SQL is Not Enough: Unifying AI and Databases with TAG

A. Biswal et al. 2024.

C3: Zero-shot Text-to-SQL with ChatGPT

X. Dong et al. 2023. Relevant to schema-linking-as-LRO framing.

In-depth Analysis of LLM-Based Schema Linking

G. Katsogiannis-Meimarakis, K. Mirylenka, P. Scotton, F. Fusco, A. Labbi. EDBT 2026.

Primary source link awaiting verification.

Can Foundation Models Wrangle Your Data?

Avanika Narayan, Ines Chami, Laurel Orr, Christopher Re. PVLDB 2022.

Booster: Leveraging Large Language Models for Enhancing Entity Resolution

H. Li, S. Li, F. Hao, C. Zhang, Y. Song, L. Chen. WWW Companion 2024.

Primary source link awaiting verification.

Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching

T. Wang et al. COLING 2025.

Primary source link awaiting verification.

Entity Matching Using Large Language Models

R. Peeters, A. Steiner, C. Bizer. EDBT 2025.

Primary source link awaiting verification.

Fine-Tuning Large Language Models for Entity Matching

A. Steiner, R. Peeters, C. Bizer. ICDEW 2025.

Primary source link awaiting verification.

UniDM: A Unified Framework for Data Manipulation with Large Language Models

Y. Qian et al. MLSys 2024.

LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputation

X. He et al. ACL Findings 2025.

Primary source link awaiting verification.

Large Language Models as Data Preprocessors

H. Zhang, Y. Dong, C. Xiao, M. Oyamada. VLDB Workshops 2024.

Primary source link awaiting verification.

LLMs with User-Defined Prompts as Generic Data Operators for Reliable Data Processing / LLM-GDO

L. Ma et al. IEEE Big Data 2023.

Primary source link awaiting verification.

Relationalizing Tables with Large Language Models: The Promise and Challenges

Z. Huang, E. Wu. ICDEW 2024.

Primary source link awaiting verification.

Table-GPT: Table Fine-Tuned GPT for Diverse Table Tasks

P. Li et al. Proc. ACM Manag. Data 2024.

SANTOS: Relationship-Based Semantic Table Union Search

A. Khatiwada et al. Proc. ACM Manag. Data 2023.

NextiaJD: Towards Scalable Data Discovery

J. Flores, S. Nadal, O. Romero. EDBT 2021.

Primary source link awaiting verification.

The Magellan Data Repository

S. Das, A. Doan, P. Konda, et al. Data repository for entity-matching benchmarks.

Primary source link awaiting verification.

BEAVER: An Enterprise Benchmark for Text-to-SQL

P. B. Chen et al. 2024.

ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines

T. Jin, Y. Zhu, D. Kang. 2025.

CAESURA: Language Models as Multi-Modal Query Planners

M. Urban, C. Binnig. CIDR 2024.

Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

Fangyu Lei et al. 2025.

BIRD: A Big Bench for Large-Scale Database Grounded Text-to-SQLs

Jinyang Li et al. 2023.

KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Chia-Hsuan Lee, Oleksandr Polozov, Matthew Richardson. 2021.

SQUALL: On the Potential of Lexico-Logical Alignments for Semantic Parsing to SQL Queries

Tianze Shi, Chen Zhao, Jordan Boyd-Graber, Hal Daume III, Lillian Lee. 2020.

Multilingual Text-to-SQL: Benchmarking the Limits of Language Models with Collaborative Language Agents

Khanh Trinh Pham et al. 2025.

Agent Bain vs. Agent McKinsey: A New Text-to-SQL Benchmark for the Business Domain / CORGI

Yue Li et al. 2026.

AutoLink: Autonomous Schema Exploration and Expansion for Scalable Schema Linking in Text-to-SQL at Scale

Ziyang Wang et al. 2025.

ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration

Minghang Deng et al. 2025.

Text-to-SQL as Dual-State Reasoning / DSR-SQL

Zhifeng Hao, Qibin Song, Ruichu Cai, Boyan Xu. 2025.

APEX-SQL: Talking to the Data via Agentic Exploration for Text-to-SQL

Bowen Cao, Weibin Liao, Yushi Sun, Dong Fang, Haitao Li, Wai Lam. 2026.

Non-determinism of "Deterministic" LLM Settings

Berk Atil et al. 2025.

Binding Language Models in Symbolic Languages

Zhoujun Cheng et al. 2022.

dIR: Discrete Information Retrieval

Pablo M. Rodriguez Bertorello, Jean Rodmond Junior Laguerre. 2023.

Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes

Simran Arora et al. 2023.

GenSQL: A Probabilistic Programming System for Querying Generative Models of Database Tables

Mathieu Huot et al. 2024.

BigQuery ML introduction

BigQuery ML remote model tutorial

BigQuery ML.GENERATE_TEXT syntax

BigQuery object tables

BigQuery vector search

Snowflake Cortex

Snowflake Cortex LLM functions

Snowflake Cortex Search

Snowflake AI_FUNCTION_EVALUATION

Snowflake AI_FUNCTION_OPTIMIZATION

Databricks Mosaic AI Model Serving

Databricks Vector Search