Claims of Microsoft’s ‘super-intelligent’ AI diagnosis agent miss the mark, say experts

Over the past few years, many researchers have tried to test large language models’ medical capabilities using questions from the U.S. medical licensure exam, or by feeding them clinical vignettes containing a set amount of information about a given case. Other researchers have called for an end to those exercises, saying that these examples are overly simplified and not characteristic of actual medical practice. 

At the end of June, Microsoft’s AI team released a study on a new way…