Artificial intelligence can do remarkable things, but how much does it actually understand about the world? Researchers have found that surprisingly specific information can be extracted from the inner workings of large language models (LLMs) like ChatGPT. Using mathematical tools to probe a model's internal activity, they can identify where a city is located on a map, when a historical figure lived or what emotion a character feels, even detecting descriptions of pain.
