LLM training data mixture optimization breaks when training pools shift — every prior proxy experiment becomes stale.
“I get asked all the time what I think about training versus inference – I'm telling you all to stop talking about training versus inference.” So declared OpenAI VP Peter Hoeschele at Oracle’s AI ...