TBF, if your goal is to generate the most valid sentence that directly answers the question, it’s only one minor abstract noun that’s broken here.
Edit: I wouldn’t be surprised if there’s a substantial drop in the probability of a digit being listed after the leading 9 (3.14159…), even, so it is “last” in a sense.
Edit again: Man, Baader-Meinhof so hard. Somehow pi to 5 digits came up more than once in 24 hours, so yes.
There’s probably some finetuning at play for Amazon’s thing which makes it tend to always give a straight answer, instead of stepping outside of the box and doing something like correcting an implicit assumption.
It works. Well, it works about as well as your average LLM
That’s a very interesting use of the word “ends”.
It’s like how they called the fourth Friday the 13th movie “The Final Chapter”.
The Rolling Stones doing their final concert for about a hundred and fifty years now.
True but I think the Fast & the Furious franchise has a better shot at giving Pi a run for it’s money.
TBF, if your goal is to generate the most valid sentence that directly answers the question, it’s only one minor abstract noun that’s broken here.
Edit: I wouldn’t be surprised if there’s a substantial drop in the probability of a digit being listed after the leading 9 (3.14159…), even, so it is “last” in a sense.
Edit again: Man, Baader-Meinhof so hard. Somehow pi to 5 digits came up more than once in 24 hours, so yes.
In other words, it doesn’t work.
I mean, it depends on what you’re doing. Supervision always required, though.
GPT-4 gives a correct answer to the question.
It’s 4, isn’t it?
No clue what Amazon is using. The one I have access to gave a sane answer.
There’s probably some finetuning at play for Amazon’s thing which makes it tend to always give a straight answer, instead of stepping outside of the box and doing something like correcting an implicit assumption.