The performance of two AI chatbots in the ophthalmology board examination.
By Dr. Sushama R. Chaphalkar, PhD.Apr 16 2024Reviewed by Lily Ramsey, LLM In a recent study published in the journal Eye , researchers from Canada evaluated the performance of two artificial intelligence chatbots, Google Gemini and Bard, in the ophthalmology board examination.
While ChatGPT-3.5's accuracy was up to 64% in steps one and two of the AMBOSS and NBME exams, newer versions like ChatGPT-4 showed improved performance. Related StoriesThe portal provides practice questions for various exams, including the Ophthalmic Knowledge Assessment Program , national board exams such as the American Board of Ophthalmology exam, as well as certain postgraduate exams.
Results and discussion Bard and Gemini responded promptly and consistently to all 150 questions without experiencing high demand. In the primary analysis using the US versions, Bard took 7.1 ± 2.7 seconds to respond, while Gemini responded in 7.1 ± 2.8 seconds, with a longer average response length. With Gemini from Vietnam, 74% of questions were answered correctly, similar to the US version, but there were differences in answer choices for 15% of questions compared to the US version. In both cases, some questions answered incorrectly by the US versions were answered correctly by the Vietnam versions, and vice versa.
Artificial Intelligence Eye Glaucoma Plastic Surgery Research Surgery
日本 最新ニュース, 日本 見出し
Similar News:他のニュース ソースから収集した、これに似たニュース記事を読むこともできます。
Sorry, Siri: Apple may be eyeing Google Gemini for future iPhonesFamous for keeping everything in-house, Apple may be carving AI-shaped door in its garden wall
続きを読む »
Russell Grant's Horoscopes as Sagittarius work increases and Gemini get a breakAries have to make a choice, Taurus don't want to socialise, and Cancer stick to what's familiar.
続きを読む »
Russell Grant's Horoscopes as Gemini told they will have challenges to overcomeLeo told talking to others calmly will prove to be the best way for you to handle a delicate situation.
続きを読む »
Russell Grant's Horoscopes as Gemini's told to always look on the bright sideToday's horoscopes are brought to you by Russell Grant.
続きを読む »
Russell Grant's horoscopes say Gemini can learn a lot by listeningToday's stars say those with the Virgo sign should be flexible to stop them getting in a rut.
続きを読む »
Google Allegedly Trained AI on YouTube Videos Despite PoliciesA new exposé claims that Google trained its AI, Gemini, on YouTube videos, despite it contravening YouTube's own policies on unauthorised content scraping. The report suggests that Google was aware of the practice but did not intervene, as the company itself was doing the same thing. This raises concerns about ethics and copyright in the AI industry.
続きを読む »