Idiots thinking a new thing is magic that will solve all the worlds problems doesn’t mean the thing doesn’t have merit. Someone calling themselves an exper carpenter because they have a nailgun doesn’t make nailguns any less useful.
If you see a person doing a data entry job, do you walk over to them, crack their head open and say “aww man, it’s not magic, it’s just a blob of fat capable of reading and understanding a document, and to then plot the values into a spreadsheet”?
It’s not magic, it’s not a super intelligence that will solve everything, it’s the first tool we’ve been able to make that can be told what to do in human language, and able to then perform tasks with a degree of intelligence and critical thinking, something that normally would require either a human or potentially years of development to automate programmatically. That alone makes it very useful
Prompt:
Answer:
Are there biases due to the training data? Yes
Does that mean it is totally incapable of reason? No why would it?
And the models aren’t trying to act like a specific person, but humans in general, so variations in writing styles in the data is quite irrelevant, as we’ve already seen it’ll usually adopt the writing style of the prompt, much like a writer will usually stick to their writing style throughout a book.
Memories are not required for intelligence, and letting a model ramble to itself will just cause the entropy of the output to increase until it’s spewing gibberish, akin fo a human locked in solitary for long enough.