AI Chatbot ChatGPT Fails UPSC Prelims Exam: Report

Since its debut, ChatGPT, an AI chatbot, has gained popularity for completing various assignments, including writing work emails with specific tones, styles, and instructions. People have become addicted to this new craze. Analytics India Magazine recently tested the chatbot’s performance on one of the toughest exams, UPSC. However, the chatbot only answered 54 out of 100 questions from Question Paper 1, Set A, of the UPSC Prelims 2022. The magazine noted that the chatbot failed to clear the 87.54% cutoff of 2021 for general category students. The questions covered geography, economics, history, ecology, science, current affairs, social development, and polity.

When asked if it was capable of passing the UPSC prelim exam, ChatGPT could not give a definite answer. It explained that while it possesses vast knowledge and information about the UPSC exam and related topics, passing the exam requires critical thinking skills, application abilities, and time management skills. Therefore, it could not say for sure if it could pass the exam.

Analytics India Magazine proceeded to ask ChatGPT all 100 questions from the question paper. However, the chatbot named incorrect answers for some questions and presented an “Option E” as an answer choice in some cases, despite there being only four options. The magazine noted that ChatGPT’s knowledge is limited to September 2021, so it cannot answer questions on current events. However, it provided incorrect answers for topics such as economy and geography, which are not necessarily time-specific.