FIELD NOTES TOPIC
language model performance
2 notes, newest first.
Spider 2.0-AIFunc: Extending Real-World Text-to-SQL to AI-Native SQL Workflows
Researchers introduce a new benchmark called Spider 2.0-AIFunc to test the ability of language models to generate AI-native SQL queries on large cloud data platforms. The benchmark includes 465 verified instances…
Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMs
The paper discusses a new approach called Reinforcement Learning with Metacognitive Feedback (RLMF) to improve Language Model's (LLM) metacognitive abilities. The RLMF aims to help LLMs better monitor and regulate…
