• @Hexarei@programming.dev
    link
    fedilink
    21 month ago

    Analysis. It uses it, but not by “matching it”. The training data is not included in the final model. No GPT can access its training data at runtime.

    Training analyzes the contents of the training data and creates a statistical model representing the likelihoods of various tokens based on a complex series of mathematical transformations that encode various attributes of the tokens making up the training data.

    3Blue1Brown has a great series on the actual math behind it, I would highly recommend educating yourself on what GPTs actually do. It’s way more interesting than simple matching.

      • @Hexarei@programming.dev
        link
        fedilink
        01 month ago

        Simpler language is fine when it’s accurate.

        Your simplification is inaccurate and could mislead people into thinking GPTs are just advanced regex matching engines.

        They are not. They are closer to autocorrect on steroids.