I believe ChatGPT generally gives accurate answers to most questions. Certainly: it produces answers that are more reliably true than a random average person. Obviously it cannot yet do advanced programming tasks: but generally it answers questions accurately.
Prove my position wrong.
What can I ask it that will produce factually incorrect answers?
As a side quest, a much easier one, what can I ask it that would cause it to produce extremely biased answers that fail to do justice to the truth of things?
I’m pretty sure LLM are deterministic in design.
The fact it doesn’t give the same output for the same prompt is just a choice of the programmers to add randomness so it feels more natural.
But you can totally setup some LLMs to be perfectly deterministic.
Got any sources to back up that claim?
A good start is this :
https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/
While it’s hard to get perfect determinism you can still get very close. But really I think it’s accurate to say that LLM are random because they are configured to be.