This piece is in response to the interview between Dwarkesh Patel & Richard Sutton. In it, I challenge Sutton’s claim that LLMs cannot form world models and therefore cannot be goal-seeking agents, but acknowledge the significance of a deep training set for eliciting LLM capabilities. Language as a representational medium for world modelling Sutton claims…