GPT-4 Outperformed Junior & Trainee Eye Doctors on a Mock Exam

  • 📰 gizmochina
  • ⏱ Reading Time:
  • 38 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 18%
  • Publisher: 53%

Malaysia Headlines News

Malaysia Latest News,Malaysia Headlines

GPT-4 fell short of the average score achieved by expert ophthalmologists (66.4). Other LLMs, like PaLM 2 and GPT-3.5 were less capable.

may have a future in ophthalmology, but limitations and risks remain. Researchers from Cambridge University tested GPT-4, along with other LLMs, against human ophthalmologists on a mock exam.The results were intriguing. GPT-4 answered 60 out of 87 questions correctly, exceeding the performance of trainee doctors and junior doctors . However, it fell short of the average score achieved by expert ophthalmologists .

While these findings hint at potential benefits, researchers highlight significant risks. The study’s limited question pool raises concerns about generalizability. More importantly, LLMs are prone to “hallucinating,” fabricating information that could lead to misdiagnosis of serious conditions like cataracts or cancer. Additionally, the lack of nuance inherent in LLMs could exacerbate inaccuracies.

The study clearly emphasizes the need for further research and development before LLMs can be considered reliable tools for medical diagnosis. Since there is a lot of risk involved in anything concerning medical diagnoses, we might have to wait for a long time before LLMs are incorporated in mainstream medical situations.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 18. in MY

Malaysia Latest News, Malaysia Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

GPT-5 will Likely Come out in June, Red Team Testing Invites are being Sent OutA security breach in GPT-5 could have serious repercussions, damaging both public trust and OpenAI's bottom line.
Source: gizmochina - 🏆 18. / 53 Read more »

S'porean Joye Cai, 15, takes up K-pop trainee contract offer after Fifty Fifty auditionGoogle no longer displays the currency exchange widget involving the Malaysian Ringgit (MYR) in its search results page following two incidents where it displayed inaccurate conversion rates.
Source: staronline - 🏆 4. / 75 Read more »

Two staff members of drug rehab centre plead guilty to causing grievous hurt to traineeTHEY came and they conquered – but the invaders have now become the hunted.
Source: staronline - 🏆 4. / 75 Read more »

Former Tabs trainee playing in the Irish Premier LeagueKota Kinabalu: Another former Tabs Safa Bandaraya trainee is doing well in foreign countries.
Source: DailyExpress_MY - 🏆 3. / 83 Read more »

Brazil's Dorival Junior starts reign with 1-0 win against EnglandBrazil's new boss Dorival Junior started his bid to revive the five-time world champions with a 1-0 win against England as teenage sensation Endrick bagged his first international goal in Saturday's friendly at Wembley.
Source: DailyExpress_MY - 🏆 3. / 83 Read more »

Super Junior Returning To Malaysia & Singapore For New Asia Tour 2024The K-pop concert announcements keep coming because idol group Super Junior (슈퍼주니어) just announced their new Asia tour with Kuala Lumpur as one of the stops!
Source: HypeMY - 🏆 10. / 63 Read more »