Health

  • Home
  • Business
    • Internet
    • Market
    • Stock
  • Parent Category
    • Child Category 1
      • Sub Child Category 1
      • Sub Child Category 2
      • Sub Child Category 3
    • Child Category 2
    • Child Category 3
    • Child Category 4
  • Featured
  • Health
    • Childcare
    • Doctors
  • Home
  • Business
    • Internet
    • Market
    • Stock
  • Downloads
    • Dvd
    • Games
    • Software
      • Office
  • Parent Category
    • Child Category 1
      • Sub Child Category 1
      • Sub Child Category 2
      • Sub Child Category 3
    • Child Category 2
    • Child Category 3
    • Child Category 4
  • Featured
  • Health
    • Childcare
    • Doctors
  • Uncategorized

Wednesday, May 24, 2023

Latest version of ChatGPT passes radiology board-style exam, highlights AI's ‘growing potential,' study finds

 May 24, 2023     Health, Health News Today on Fox News     No comments   

The latest version of ChatGPT, the artificial intelligence chatbot from OpenAI, is smart enough to pass a radiology board-style exam, a new study from the University of Toronto found.

GPT-4, which launched officially on March 13, 2023, correctly answered 81% of the 150 multiple-choice questions on the exam.

Despite the chatbot’s high accuracy, the study — published in Radiology, a journal of the Radiological Society of North America (RSNA) — also detected some concerning inaccuracies.

CHATGPT FOUND TO GIVE BETTER MEDICAL ADVICE THAN REAL DOCTORS IN BLIND STUDY: ‘THIS WILL BE A GAME CHANGER’

"A radiologist is doing three things when interpreting medical images: looking for findings, using advanced reasoning to understand the meaning of the findings, and then communicating those findings to patients and other physicians," explained lead author Rajesh Bhayana, M.D., an abdominal radiologist and technology lead at University Medical Imaging Toronto, Toronto General Hospital in Toronto, Canada, in a statement to Fox News Digital.

"Most AI research in radiology has focused on computer vision, but language models like ChatGPT are essentially performing steps two and three (the advanced reasoning and language tasks)," she went on.

"Our research provides insight into ChatGPT’s performance in a radiology context, highlighting the incredible potential of large language models, along with the current limitations that make it unreliable."

CHATGPT FOR HEALTH CARE PROVIDERS: CAN THE AI CHATBOT MAKE THE PROFESSIONALS' JOBS EASIER?

The researchers created the questions in a way that mirrored the style, content and difficulty of the Canadian Royal College and American Board of Radiology exams, according to a discussion of the study in the medical journal.

(Because ChatGPT doesn’t yet accept images, the researchers were limited to text-based questions.)

The questions were then posed to two different versions of ChatGPT: GPT-3.5 and the newer GPT-4.

The GPT-3.5 version of ChatGPT answered 69% of questions correctly (104 of 150), near the passing grade of 70% used by the Royal College in Canada, according to the study findings. 

It struggled the most with questions involving "higher-order thinking," such as describing imaging findings.

As for GPT-4, it answered 81% (121 of 150) of the same questions correctly — exceeding the passing threshold of 70%.

The newer version did much better at answering the higher-order thinking questions.

"The purpose of the study was to see how ChatGPT performed in the context of radiology — both in advanced reasoning and basic knowledge," Bhayana said. 

"GPT-4 performed very well in both areas, and demonstrated improved understanding of the context of radiology-specific language — which is critical to enable the more advanced tools that radiology physicians can use to be more efficient and effective," she added.

The researchers were surprised by GPT-4's "marked improvement" in advanced reasoning capabilities over GPT-3.5.

"Our findings highlight the growing potential of these models in radiology, but also in other areas of medicine," said Bhayana.

Dr. Harvey Castro, a Dallas, Texas-based board-certified emergency medicine physician and national speaker on artificial intelligence in health care, was not involved in the study but reviewed the findings.

"The leap in performance from GPT-3.5 to GPT-4 can be attributed to a more extensive training dataset and an increased emphasis on human reinforcement learning," he told Fox News Digital.

"This expanded training enables GPT-4 to interpret, understand and utilize embedded knowledge more effectively," he added.

CHATGPT AND HEALTH CARE: COULD THE AI CHATBOT CHANGE THE PATIENT EXPERIENCE?

Getting a higher score on a standardized test, however, doesn't necessarily equate to a more profound understanding of a medical subject such as radiology, Castro pointed out. 

"It shows that GPT-4 is better at pattern recognition based on the vast amount of information it has been trained on," he said.

Many health technology experts, including Bhayana, believe that large language models (LLMs) like GPT-4 will change the way people interact with technology in general — and more specifically in medicine.

"They are already being incorporated into search engines like Google, electronic medical records like Epic, and medical dictation software like Nuance," she told Fox News Digital. 

"But there are many more advanced applications of these tools that will transform health care even further."

In the future, Bhayana believes these models could answer patient questions accurately, help physicians make diagnoses and guide treatment decisions. 

Honing in on radiology, she predicted that LLMs could help augment radiologists’ abilities and make them more efficient and effective.

"We are not yet quite there yet — the models are not yet reliable enough to use for clinical practice — but we are quickly moving in the right direction," she added.

Perhaps the biggest limitation of LLMs in radiology is their inability to interpret visual data, which is a critical aspect of radiology, Castro said.

Large language models (LLMs) like ChatGPT are also known for their tendency to "hallucinate," which is when they provide inaccurate information in a confident-sounding way, Bhayana pointed out.

"These hallucinations decreased in GPT-4 compared to 3.5, but it still occurs too frequently to be relied on in clinical practice," she said.

"Physicians and patients should be aware of the strengths and limitations of these models, including knowing that they cannot be relied on as a sole source of information at present," Bhayana added.

Castro agreed that while LLMs may have enough knowledge to pass tests, they can’t rival human physicians when it comes to determining patients’ diagnoses and creating treatment plans.

"Standardized exams, including those in radiology, often focus on 'textbook' cases," he said. 

"But in clinical practice, patients rarely present with textbook symptoms."

Every patient has unique symptoms, histories and personal factors that may diverge from "standard" cases, said Castro. 

"This complexity often requires nuanced judgment and decision-making, a capacity that AI — including advanced models like GPT-4 — currently lacks."

CLICK HERE TO SIGN UP FOR OUR HEALTH NEWSLETTER

While the improved scores of GPT-4 are promising, Castro said, "much work must be done to ensure that AI tools are accurate, safe and valuable in a real-world clinical setting."



from Health News Today on Fox News https://ift.tt/Bmpd5ea
  • Share This:  
  •  Facebook
  •  Twitter
  •  Google+
  •  Stumble
  •  Digg
Email ThisBlogThis!Share to XShare to Facebook
Newer Post Older Post Home

0 comments:

Post a Comment

Popular Posts

  • As King Charles III, at age 74, assumes British throne, here's what to know about his health
    On May 6, the Archbishop of Canterbury, Justin Welby, carefully placed the iconic St. Edward’s Crown atop King Charles III 's head as th...
  • FOX NEWS: Woman’s ‘baby bump’ turns out to be two ovarian tumors
    Woman’s ‘baby bump’ turns out to be two ovarian tumors A 49-year-old woman who struggled with fertility thought she might be pregnant w...
  • Mobile medical clinics bring health care directly to homeless veterans in 25 cities
    More than 35,000 veterans in America are homeless — and health care is not always their top priority.  The U.S. Department of Veterans Aff...

Recent Posts

Categories

  • Health News Today on Fox News
  • FOX NEWS
  • Fox News : Health
  • Health
  • Health News Today on Fox News
  • Healthy tips
  • NYT

Unordered List

Pages

  • Home

Text Widget

Blog Archive

  • August 2025 (73)
  • July 2025 (94)
  • June 2025 (75)
  • May 2025 (88)
  • April 2025 (84)
  • March 2025 (88)
  • February 2025 (70)
  • January 2025 (72)
  • December 2024 (81)
  • November 2024 (70)
  • October 2024 (82)
  • September 2024 (75)
  • August 2024 (82)
  • July 2024 (79)
  • June 2024 (74)
  • May 2024 (73)
  • April 2024 (78)
  • March 2024 (75)
  • February 2024 (78)
  • January 2024 (78)
  • December 2023 (60)
  • November 2023 (80)
  • October 2023 (74)
  • September 2023 (75)
  • August 2023 (85)
  • July 2023 (67)
  • June 2023 (58)
  • May 2023 (100)
  • April 2023 (105)
  • March 2023 (118)
  • February 2023 (84)
  • January 2023 (87)
  • December 2022 (69)
  • November 2022 (64)
  • October 2022 (78)
  • September 2022 (74)
  • August 2022 (110)
  • July 2022 (109)
  • June 2022 (127)
  • May 2022 (95)
  • April 2022 (109)
  • March 2022 (140)
  • February 2022 (138)
  • January 2022 (170)
  • December 2021 (182)
  • November 2021 (213)
  • October 2021 (506)
  • September 2021 (539)
  • August 2021 (564)
  • July 2021 (590)
  • June 2021 (556)
  • May 2021 (544)
  • April 2021 (310)
  • March 2021 (331)
  • February 2021 (301)
  • January 2021 (326)
  • December 2020 (521)
  • November 2020 (403)
  • October 2020 (537)
  • September 2020 (554)
  • August 2020 (431)
  • July 2020 (647)
  • June 2020 (610)
  • May 2020 (659)
  • April 2020 (681)
  • March 2020 (729)
  • February 2020 (564)
  • January 2020 (483)
  • December 2019 (396)
  • November 2019 (416)
  • October 2019 (526)
  • September 2019 (486)
  • August 2019 (441)
  • July 2019 (394)
  • June 2019 (381)
  • May 2019 (510)
  • April 2019 (471)
  • March 2019 (560)
  • February 2019 (403)
  • January 2019 (530)
  • December 2018 (382)
  • November 2018 (378)
  • October 2018 (510)
  • September 2018 (297)
Powered by Blogger.

Report Abuse

Formulir Kontak



Search This Blog

Find Us On Facebook

Labels

  • Health News Today on Fox News
  • FOX NEWS
  • Fox News : Health
  • Health
  • Health News Today on Fox News
  • Healthy tips
  • NYT

Flickr Images

Most Popular

  • As King Charles III, at age 74, assumes British throne, here's what to know about his health
    On May 6, the Archbishop of Canterbury, Justin Welby, carefully placed the iconic St. Edward’s Crown atop King Charles III 's head as th...
  • FOX NEWS: Woman’s ‘baby bump’ turns out to be two ovarian tumors
    Woman’s ‘baby bump’ turns out to be two ovarian tumors A 49-year-old woman who struggled with fertility thought she might be pregnant w...
  • Mobile medical clinics bring health care directly to homeless veterans in 25 cities
    More than 35,000 veterans in America are homeless — and health care is not always their top priority.  The U.S. Department of Veterans Aff...
  • FOX NEWS: Colorado teacher provides home to help foster child, 13, get kidney transplant
    Colorado teacher provides home to help foster child, 13, get kidney transplant When a Colorado boy in foster care was bumped off the li...
  • Omicron variant: Is it leading us closer to herd immunity against COVID-19?
    Is omicron leading us closer to herd immunity against COVID-19? from FOX News : Health https://ift.tt/Jb74Ani
  • Helping Stroke Patients Regain Movement in their Hands
    By BY PAM BELLUCK from NYT Health https://ift.tt/6uNPHMD
  • First documented case of monkeypox reported in Philippines
    The Philippines has reported its first case of the monkeypox virus, detected in a citizen who returned from abroad earlier this month, a hea...
  • CDC says an eye drop brand may be connected to drug-resistant bacterial infections
    A brand of over-the-counter eye drops may be linked to a bacterial infection that left one person dead and three others with permanent visi...
  • Common cooking ingredient could reduce dementia mortality risk, study suggests
    Infusing more olive oil into your diet could pay big dividends for cognitive health and longevity, a new study suggests. Researchers from ...
  • Ozempic ‘microdosing’ is the new weight-loss trend: Should you try it?
    A new trend gaining popularity among people trying to lose weight is microdosing the diabetes medication Ozempic. With approximately 70% of...

Sample Text

Copyright © Health | Powered by Blogger
Design by Hardeep Asrani | Blogger Theme by NewBloggerThemes.com | Distributed By Gooyaabi Templates