Facepalm: Apple’s much-hyped Siri integration with ChatGPT might have added a ton of helpful performance, however it’s apparently executed little to enhance the digital assistant’s data of sports activities. A damning report highlights simply how abysmally Siri performs at recalling easy details like previous Tremendous Bowl winners.
In line with the report from One Foot Tsunami’s Paul Kafasis, when requested “Who gained Tremendous Bowl?” for every quantity from 1 by 60, Siri accurately offered the winner for less than 20 out of the 58 Tremendous Bowls which were performed thus far. That interprets to a hit charge of simply 34%.
The main points get much more embarrassing. Kafasis discovered that at its worst, Siri missed an unimaginable 15 Tremendous Bowl winners in a row from Tremendous Bowl XVII by XXXII. And in a baffling mishap, it erroneously credited the Philadelphia Eagles with a whopping 33 non-existent Tremendous Bowl wins.
Kafasis documented each single one among Siri’s incorrect solutions in a downloadable spreadsheet, which you will discover on his weblog.
One other report by Daring Fireball’s John Gruber corroborated these findings. It discovered that AI assistants and search engines like google from Google, Anthropic, and DuckDuckGo fared much better when requested comparable Tremendous Bowl trivia questions. Gruber even discovered they may all deal with not simply previous outcomes, however well dodge trick questions on future Tremendous Bowls that have not occurred but.
Siri’s poor efficiency would not cease at sports activities trivia both. Daring Fireball posed a extra obscure query – “Who gained the 2004 North Dakota highschool boys’ state basketball championship?” Extremely, each Kagi and ChatGPT offered the absolutely appropriate reply, with the latter incomes bonus factors for together with a hyperlink to video of the championship recreation. In the meantime, Siri as soon as once more bought it incorrect.
What makes all this notably damning is that Siri’s primarily powered by the identical ChatGPT that fares completely advantageous when used with out Siri.
The weblog additionally factors out that the outdated pre-AI variations of Siri not less than acknowledged limitations on such queries and offered related net hyperlinks. However new Siri powered by Apple Intelligence with ChatGPT integration lies with confidence – a hallmark of unrefined AI – making it worse than its predecessor.
Each blogs conclude that Apple has extra work to do on this space. As Gruber bluntly states, Siri with ChatGPT is presently “an enormous regression” over the outdated Siri with regards to dealing with easy factual prompts.
