Robots Provide ‘Trash’ Answers for Voting and Elections Questions
A number of major AI services performed poorly in a test of their ability to address questions and concerns about voting and elections.
Their concern was that AI models will, as their proprietors have urged and sometimes forced, replace ordinary searches and references for common questions.
They submitted these questions via API to five well-known models: Claude, Gemini, GPT-4, Llama 2 and Mixtral.
The AI model responses ranged from 1,110 characters (Claude) to 2,015 characters, (Mixtral), and all of the AI models provided lengthy responses detailing between four and six steps to register to vote.
GPT-4 came out best, with only approximately one in five of its answers having a problem, pulling ahead by punting on “where do I vote” questions.