My LLM Query Optimizer Demoed in a Week. Making it honest however took Months
i built an llm that recommends fixes for slow database queries in a week. this is the story of the months of evals, validators and cluster probes it took to make its advice honest.