[Paper] TableCache: Primary Foreign Key Guided KV Cache Precomputation for Low Latency Text-to-SQL
In Text-to-SQL tasks, existing LLM-based methods often include extensive database schemas in prompts, leading to long context lengths and increased prefilling l...