Not quite as good as I hoped.
#1
by
DonaldSeibert
- opened
- it did not successfully answer the question “how many examples of w show up in this sentence.” It appeared to understand the question but got confused on the answer
- it also failed on the parity problem. It wrote some good python code, but it thought ‘1111’ had an even number of ones.
- it did get a historical question correct, that a lot of.models get wrong (I ask if Ferdinand Porsche was a nazi, and it answered correctly that he was. (I believe that because a lot of the information on Porsche official or fan sites is evasive on this topic, the models that ingest the data tend to be similarly evasive.)
but it thought ‘1111’ had an even number of ones
Can you please double check this one? This is indeed an even number (4).
Quite right, looks like I reversed the error. It first said there was an odd number of ones, and when I asked it to check changed its mind. Same with 1001.