AI chatbots are supposed to improve health care, but research says some are perpetuating racism

Researchers caution that popular chatbots are perpetuating racist, debunked medical ideasto help summarize doctors’ notes and analyze health records, a new study led by Stanford School of Medicine researchers cautions that popular chatbots are perpetuating racist, debunked medical ideas, prompting concerns that the tools could worsen health disparities for Black patients.

“People will ask chatbots questions about their rashes or a new lesion, they will describe what they say is itchy or painful,” she said. “It's increasingly a concern that patients are using this." “I believe technology can really provide shared prosperity and I believe it can help to close the gaps we have in health care delivery,” Omiye said. “The first thing that came to mind when I saw that was ‘Oh, we are still far away from where we should be,' but I was grateful that we are finding this out very early.”

In a July research letter to the Journal of the American Medical Association, the Beth Israel researchers cautioned that the model is a “black box” and said future research “should investigate potential biases and diagnostic blind spots” of such models. “Since all physicians may not be familiar with the latest guidance and have their own biases, these models have the potential to steer physicians toward biased decision-making,” the Stanford study noted.

Source: Healthcare Press (healthcarepress.net)

United States Latest News, United States Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Is England doing enough to stop covid-19 spreading in hospitals?Up to 1 in 50 people admitted to hospital during England’s second covid-19 wave caught the coronavirus there. Are sufficient measures in place to prevent such infections as winter approaches this year?
Source: newscientist - 🏆 541. / 51 Read more »

Israel Defense Forces spokesperson: 'We do not target hospitals'A hospital blast in Gaza has sparked further controversy amid fighting between Israel and terrorist group Hamas.
Source: 10News - 🏆 732. / 50 Read more »

Israeli Health Ministry Asks Civilians with Gun Licenses to Serve as Security Guards at HospitalsSource of breaking news and analysis, insightful commentary and original reporting, curated and written specifically for the new generation of independent and conservative thinkers.
Source: BreitbartNews - 🏆 610. / 51 Read more »

3 Alabama hospitals to close maternity wardsThree Alabama hospitals will lose their maternity wards, forcing women to find another health care provider ahead of their deliveries.
Source: wsfa12news - 🏆 338. / 59 Read more »

3 Alabama hospitals to close maternity wardsThree Alabama hospitals will lose their maternity wards.
Source: wsfa12news - 🏆 338. / 59 Read more »

Pennsylvania Gov. Josh Shapiro to sign bill boosting Medicaid subsidies for hospitals, ambulancesA bill that would boost Medicaid subsidies for hospitals and ambulance services in Pennsylvania will head to Democratic Gov. Josh Shapiro.
Source: FoxNews - 🏆 9. / 87 Read more »