Senators Weigh Whether Health Care AI Needs a Leash
The Senate Finance Committee contemplated the future yesterday: artificial intelligence and its potential applications to health care.
And it turns out the future looks an awful lot like the past and present: Democrats want regulations. And the industry wants money.
鈥淭here are a lot of reasons to be optimistic,鈥 Finance Committee Chair Ron Wyden (D-Ore.) said. But, he warned, algorithms need regulation and accountability to make sure they aren鈥檛 producing bad or biased recommendations that deny care or lead to inappropriate care.
He expressed outrage at the results of led by Ziad Obermeyer, a University of California at Berkeley associate professor, who found that one commercial algorithm recommended less health care for Black patients based on historical cost data.
鈥How does such a flawed system make its way into general use?鈥 Wyden said. 鈥淣obody鈥檚 watching. No guardrails. No guardrails to protect the patients from flawed algorithms and AI systems.鈥
It鈥檚 unclear whether this algorithm is still being marketed, Obermeyer testified later.
The hearing marked Congress鈥檚 latest attempt to wrap its head around the newest AI systems, which can mimic some forms of human reasoning to make predictions and calculations, or generate text and images that look deceptively human-created.
Wyden touted his 鈥淎lgorithmic Accountability Act,鈥 a bill intended to force companies to assess their own products and require the Federal Trade Commission to collect and report data on AI systems. But Republicans indicated that they don鈥檛 want to move quickly on the emerging technology.
AI is already prevalent in health care; doctors use the systems to distill patient visits into clinical notes and to point out potentially cancerous lesions or polyps, for example. Accordingly, there鈥檚 big Washington muscle behind the algorithms: CNBC 鈥 from 158 to over 450 鈥 in the number of organizations lobbying on AI regulations.
Industry leaders 鈥 and the committee鈥檚 Republicans 鈥 didn鈥檛 explicitly refute the need for regulations at Thursday鈥檚 hearing. But their vision for it was more constrained and, in one instance, raised the question: Can tech watchmen watch the tech watchmen?
Take Sen. Bill Cassidy (R-La.), who mused at the end of the hearing that AI models could wind up rating AI models. Asking for responses from witnesses, he reminded them to 鈥減lease be tight with your answers鈥 鈥 and cut them off soon after most told him that humans needed to evaluate the models.
鈥淧ractically, that seems like that鈥檚 going to be incredibly cumbersome,鈥 he informed University of Chicago Provost Katherine Baicker. 鈥淭hat seems impossible,鈥 he told Mark Sendak, co-leader of Duke鈥檚 Health AI Partnership, about the researcher鈥檚 proposals on the need for local human oversight of algorithms.
The committee鈥檚 senior Republican, Sen. Mike Crapo (Idaho), acknowledged in a statement the importance of 鈥渢ransparency鈥 in AI systems. But he also decried the idea of quickly legislating on AI through 鈥渙ne-size-fits-all, overly rigid, and unduly bureaucratic laws.鈥
While proposals to regulate AI were contentious, one idea drew support from Republicans, the panel鈥檚 witnesses and even some Democrats: the need for industry to be paid for its innovations.
鈥淎s game-changing AI-enabled devices and other technologies emerge, Medicare coverage and payment policies must keep pace,鈥 Crapo said in his statement.
Sen. Bob Menendez (D-N.J.) noted that according to recent research, Medicare reimburses 鈥渇ewer than 20鈥 AI services, before asking whether more payments would be useful. Other senators also indicated support for more cash to the industry.
Peter Shen, head of digital and automation at Siemens Healthineers, proposed that tech manufacturers submit cost data to Medicare and receive five years of payments. Otherwise, the government鈥檚 鈥渋nconsistent, unpredictable鈥 approach would stifle innovation, he argued.
Sendak said health providers lack infrastructure and training to use AI, noting the billions of dollars the government spent to encourage them to adopt electronic health records. 鈥淲e need similarly bold action now,鈥 he said in written testimony.
This article is not available for syndication due to republishing restrictions. If you have questions about the availability of this or other content for republication, please contact NewsWeb@kff.org.