We have identified how millions of concepts are represented inside Claude Sonnet, one of our deployed large language models. This is the first ever detailed look inside a modern, production-grade large language model.

I often see a lot of people with outdated understanding of modern LLMs.

This is probably the best interpretability research to date, by the leading interpretability research team.

It’s worth a read if you want a peek behind the curtain on modern models.

  • Richard@lemmy.worldEnglish
    62·
    7 months ago

    Yes, but people forget that our brains, and therefore our minds, are also “simply” statistics, albeit very complex.