Artificial intelligence is on a par with human experts when it comes to making medical diagnoses based on images, a review has found.

The potential for artificial intelligence in healthcare has caused excitement, with advocates saying it will ease the strain on resources, free up time for doctor-patient interactions and even aid the development of tailored treatment. Last month the government announced £250m of funding for a new NHS artificial intelligence laboratory.

However, experts have warned the latest findings are based on a small number of studies, since the field is littered with poor-quality research.

One burgeoning application is the use of AI in interpreting medical images – a field that relies on deep learning, a sophisticated form of machine learning in which a series of labelled images are fed into algorithms that pick out features within them and learn how to classify similar images. This approach has shown promise in diagnosis of diseases from cancers to eye conditions.

However questions remain about how such deep learning systems measure up to human skills. Now researchers say they have conducted the first comprehensive review of published studies on the issue, and found humans and machines are on a par.

Prof Alastair Denniston, at the University Hospitals Birmingham NHS foundation trust and a co-author of the study, said the results were encouraging but the study was a reality check for some of the hype about AI.

Dr Xiaoxuan Liu, the lead author of the study and from the same NHS trust, agreed. “There are a lot of headlines about AI outperforming humans, but our message is that it can at best be equivalent,” she said.

Writing in the Lancet Digital Health, Denniston, Liu and colleagues reported how they focused on research papers published since 2012 – a pivotal year for deep learning.

An initial search turned up more than 20,000 relevant studies. However, only 14 studies – all based on human disease – reported good quality data, tested the deep learning system with images from a separate dataset to the one used to train it, and showed the same images to human experts.

The team pooled the most promising results from within each of the 14 studies to reveal that deep learning systems correctly detected a disease state 87% of the time – compared with 86% for healthcare professionals – and correctly gave the all-clear 93% of the time, compared with 91% for human experts.

However, the healthcare professionals in these scenarios were not given additional patient information they would have in the real world which could steer their diagnosis.

Prof David Spiegelhalter, the chair of the Winton centre for risk and evidence communication at the University of Cambridge, said the field was awash with poor research.

“This excellent review demonstrates that the massive hype over AI in medicine obscures the lamentable quality of almost all evaluation studies,” he said. “Deep learning can be a powerful and impressive technique, but clinicians and commissioners should be asking the crucial question: what does it actually add to clinical practice?”

However, Denniston remained optimistic about the potential of AI in healthcare, saying such deep learning systems could act as a diagnostic tool and help tackle the backlog of scans and images. What’s more, said Liu, they could prove useful in places which lack experts to interpret images.

Liu said it would be important to use deep learning systems in clinical trials to assess whether patient outcomes improved compared with current practices.

Dr Raj Jena, an oncologist at Addenbrooke’s hospital in Cambridge who was not involved in the study, said deep learning systems would be important in the future, but stressed they needed robust real-world testing. He also said it was important to understand why such systems sometimes make the wrong assessment.

“If you are a deep learning algorithm, when you fail you can often fail in a very unpredictable and spectacular way,” he said.

Since you’re here…

… we have a small favour to ask. More people are reading and supporting The Guardian’s independent, investigative journalism than ever before. And unlike many new organisations, we have chosen an approach that allows us to keep our journalism accessible to all, regardless of where they live or what they can afford. But we need your ongoing support to keep working as we do.

The Guardian will engage with the most critical issues of our time – from the escalating climate catastrophe to widespread inequality to the influence of big tech on our lives. At a time when factual information is a necessity, we believe that each of us, around the world, deserves access to accurate reporting with integrity at its heart.

Our editorial independence means we set our own agenda and voice our own opinions. Guardian journalism is free from commercial and political bias and not influenced by billionaire owners or shareholders. This means we can give a voice to those less heard, explore where others turn away, and rigorously challenge those in power.

We need your support to keep delivering quality journalism, to maintain our openness and to protect our precious independence. Every reader contribution, big or small, is so valuable.

The post AI equal with human experts in medical diagnosis, study finds appeared first on Artificial Intelligence.

We’ve all heard the dire predictions about robots coming to steal our jobs. As technologies such as machine learning, AI and automation advance by the day, workplaces everywhere are being transformed; naturally, some people fear that they will become redundant — depending on their job, some may be right.  In this age of AI and ML, ambivalence is ripe; but something ironic has emerged: when it comes to advancing these cutting-edge technologies, the lack of human skillsand knowledge is slowing innovation down.

In a new survey by Cloudera, the software firm, exploring the benefits and roadblocks of ML adoption across Europe, 51% of business leaders said that the skills shortage was holding them back from implementation. According to Cloudera, companies are eager to use ML — it’s second only to analytics as the key investment priority for businesses; ahead of other disciplines like IoT, artificial intelligence and data science.

“Although most IT buyers understand the benefits of machine learning, with 33% of respondents saying they have already seen tangible ROI from its use, many are still unsure about how to implement and how it will impact their businesses,” said Stephen Line, VP EMEA at Cloudera. “In what is still the early stages for many businesses in actually implementing ML, it’s unsurprising to learn that the skills gap and investment are key factors in preventing many companies from using it to improve efficiency and drive growth. That said, with the benefits of ML quite clear, the race is now on for businesses to overcome their barriers to deliver a better experience for their customers.”

The post Machine learning adoption thwarted by lack of human skills appeared first on Artificial Intelligence.