The Sensorimotor Gap: What LLMs Can't Learn from Text
What LLMs can’t learn from text — and why human-like understanding may require bodies, not bigger models. The Fundamental Limitation Large Language Models (LLMs) have achieved remarkable success by learning from text. But there’s a fundamental gap: they lack sensorimotor experience. What is the Sensorimotor Gap? The sensorimotor gap refers to the difference between: Textual knowledge: What can be learned from reading Embodied knowledge: What requires physical interaction Examples Text can teach: ...