While data, compute, and model size have driven recent advances, Fei-Fei Li stresses that continued breakthroughs require fresh ideas--especially in world modeling, embodied intelligence, and multimodal reasoning.
“Scaling data, compute, and model size alone will hit diminishing returns without new algorithmic ideas”