If you feed a chatbot the sentences, “Bananas are a good source of potassium. Bananas are not a good source of protein.” There is a good chance it will spit out the phrase, “Bananas are a good source of protein.” because the phrase “good source of protein” is in the original data it was fed. There will always be a significant chance of spitting out this phrase.
No matter how much you improve the AI, because it uses probabilistic generation, it will always be cobbling together sentences without any regard for what the overall sentence means. An intern will eventually learn case law, an AI agent will never be trustworthy. When you ask an AI agent a question, it will always lie to you about being certain of its answer because its answer is built upon a roll of the dice.
If you feed a chatbot the sentences, “Bananas are a good source of potassium. Bananas are not a good source of protein.” There is a good chance it will spit out the phrase, “Bananas are a good source of protein.” because the phrase “good source of protein” is in the original data it was fed. There will always be a significant chance of spitting out this phrase.
No matter how much you improve the AI, because it uses probabilistic generation, it will always be cobbling together sentences without any regard for what the overall sentence means. An intern will eventually learn case law, an AI agent will never be trustworthy. When you ask an AI agent a question, it will always lie to you about being certain of its answer because its answer is built upon a roll of the dice.