How AI will expand its footprint in medical imaging
Success will depend on clearly demonstrating clinical relevancy, clinical validation, workflow integration and return on investment.
At the recent annual conference of the European Society of Radiology, there were more than 25 independent software vendors, many of them start-ups, showcasing artificial intelligence solutions for medical imaging.
Additionally, with established imaging vendors making forays into the AI space, what was once hype is now in the early stages of market maturity, and, it appears that AI, within medical imaging, is here to stay.
The question has now shifted to what clinical value AI solutions can provide, rather than if AI is suitable for medical imaging. Radiologists are no longer apprehensive AI will remove them from their jobs and are now in the driving seat in terms of dictating what they want from such solutions.
However, there was little variation in the AI solutions at this show, with many vendors targeting the same clinical applications. With well over 100 companies developing AI solutions for medical imaging, some segments of this fledgling market are already looking crowded. The successful vendors will be those that are able to clearly demonstrate their ability to deliver value, in terms of clinical relevancy, clinical validation, workflow integration and return on investment.
Clinical relevancy
Remaining relevant in an ever-adapting environment is every company’s aspiration, and companies in the medical imaging AI field are no different. Key to this is companies developing AI solutions that are clinically relevant to healthcare providers.
One of the barriers to this is the lack of availability of well-annotated data to train the machine learning algorithm. Most of the public data sets are focused on high-volume routine cases—for example, lung nodules or breast anomalies that are indicative of breast cancer. As a result, most AI start-ups are targeting these high-volume clinical cases.
However, radiologists cover a large array of clinical cases throughout a typical workday. There are a small number of high-volume cases (such as lung nodules), but most clinical cases are yet to be addressed by AI solutions and are an untapped market for vendors. While there is certainly value in AI solutions targeted at these repetitive and time-consuming high-volume cases, for AI to realize its full potential in medical imaging, radiologists need a more comprehensive set of AI-enabled tools. Successful vendors will have innovative strategies for obtaining annotated data and that have secured multiple data-sharing partnership with health providers, enabling them to develop algorithms for a diverse range of clinical cases.
Early AI solutions were typically point solutions, developed for a specific pathology. Now, there is a trend to develop solutions that are more akin to AI diagnostic toolkits. Specifically, these solutions can detect more than one anomaly, ideally within a body area in its entirety, and in some cases across multiple organs.
Not only do these more comprehensive solutions provide a greater level of diagnostic support, they also simplify the process of integrating AI in the clinical workflow (offering one solution instead of many individual algorithms) and are likely to be more cost effective. Although the robustness and thoroughness of these solutions varies between vendors, the consensus seems to indicate this will be a key development trend in the future.
This leads to the value of medical imaging AI solutions beyond anomaly detection. The ability of AI solutions to quantify features of a scan enhances the value of radiology reports for referring physicians and can ultimately improve clinical outcomes. AI solutions that take this a step further, and support or offer a differential diagnosis remain the pinnacle, for both AI developers and radiologists alike. At this show, it was evident that vendors are making progress in this respect, with several showing solutions that give a probability score for the likelihood of malignancy for a nodule or lesion.
Further, AI has a wider role to play within medical imaging beyond image analysis. Image analysis is the main state of play in today’s market, but image acquisition (pre-phase), and reporting and treatment planning (post-phase) will become increasingly important in the coming years.
Image acquisition appears to be the next major use-case for AI in medical imaging, with a three-fold benefit for healthcare providers. First, the time to undergo a scan will be much reduced, providing benefit to the patient in terms of quality of care, and to the provider, in terms of maximizing the number of scans delivered per day. Second, the use of machine learning during image reconstruction can enhance the quality of low-dose CT scans to that of normal dose CT scans, reducing patient radiation exposure. Finally, AI can be utilized to reduce noise and artefacts from scan images (especially if low-quality), to improve the radiologist’s diagnostic confidence and potentially reduce rescans.
Workflow integration
For AI to become mainstream, it must be seamlessly integrated into radiology workflows, either at the point of image acquisition or in the PACS environment. Although AI solutions may be integrated into the scanner itself, both for image acquisition and for image analysis, this is a more difficult market to address by the independent software vendors, because it’s more tightly regulated environment.
There were very few embedded AI solutions at the most recent show, suggesting that the modality vendors are taking a cautious approach to integrating AI. The embedded image analysis solutions on show were a mix of native applications developed by the modality vendors and third-party applications, while the AI-enabled image acquisition solutions were home-grown applications. We expect to see activity for embedded AI solutions gradually ramp-up during 2019.
The demand on a radiologist’s time is typically very high, and workflow efficiency is key. Radiologists’ uptake of AI solutions will be driven by how effectively and seamlessly they integrate with their current workflow. AI solutions that are tightly integrated into the primary diagnostic viewer, such as PACS, and do not require radiologists to open a dedicated AI viewer are likely to gain most traction. Regardless of whether AI solutions offer an effective user interface, transitioning from the PACS environment increases the radiologist’s time spent reading the scan, or the risk of software malfunctioning. This will likely lead to radiologists accessing the AI solution less, or not at all.
PACS and enterprise imaging vendors are ramping-up their AI activities and are typically following similar implementation strategies—a dedicated AI platform to act as a container for native and third party AI algorithms that are tightly integrated into the diagnostic viewing platform, coupled with a supplementary cloud-based marketplace of third party AI applications.
Some vendors are proposing on-premise and cloud variants for their AI platforms, with others offering cloud only. Over the longer term, we expect cloud platforms will become the preferred solution, but at this early stage of the AI market and the transition to cloud in medical imaging, there is certainly room for both approaches. There is a strong argument that as AI becomes more commonplace, it will help to accelerate the acceptance of cloud in medical imaging.
In much the same way that the modality vendors are taking a cautious approach to third-party applications, the imaging IT vendors are being very selective about partnering with AI solution vendors for their AI platforms, typically putting solutions through extensive in-house testing and validation to ensure the robustness and clinical value before committing to integrations. Additional applications can then be offered through a marketplace, but typically less tightly integrated with the diagnostic viewer.
Although most AI ISVs are initially selling direct to providers, gaining traction and upscaling will eventually become difficult, not to mention the expense of building an international direct sales team. An increasing number of ISVs have chosen to partner with AI marketplaces, often to gain access to an established customer base.
At this early stage of the market development, it is unclear if AI marketplaces will be successful and whether customers will prefer to use a marketplace from their main imaging vendor or an independent marketplace. The AI solution vendors appear to be hedging their bets and partnering with both.
Although many of the incumbents have been seemingly slow to react to the adoption of AI in medical imaging, we believe the modality and imaging IT vendors will have the greatest influence over the longer-term scope and future direction of the market, due to their influence and pivotal role in integrating AI in the radiology workflow. As such, it is essential that AI ISVs form partnerships with the incumbent imaging vendors.
Return on investment
With healthcare budgets under pressure globally, AI vendors must clearly articulate a tangible ROI for healthcare providers, to justify the significant investment in software and the supporting IT infrastructure required to support AI deployments. This can be realized in a various way, as outlined below.
In countries where the demand on a radiologist’s time is high, typically due to a shortage of radiologists, for example the National Health Service in the UK, the incentive of increased productivity is a key value proposition for AI and arguably the strongest driver of ROI. AI solutions that can triage cases (determine the urgent cases from the non-urgent cases) and decrease the time needed to read scans are key. Similar, for private radiology groups the incentive of increased productivity will be a key driver for the uptake of AI.
However, in countries with an ample supply of radiologists, such as the Nordic countries, the demand on a radiologist’s time may be less of a factor, and diagnostic quality will be the primary driver of ROI from AI solutions, alongside productivity.
Another avenue for ROI, which a small number of AI solution vendors have managed to target, is to improve the effectiveness, both cost and clinical, of the diagnostic pathway. For example, fractional flow reserve-computed tomography (FFR-CT) enabled by AI image analysis is increasingly being used as an alternative to interventional angiography. This lowers cost for the provider and reduces the risk of infection for the patient, justifying the investment in AI. There is also the potential to reduce the number of biopsies in a range of clinical applications, although this is more likely to be the driver in single payer markets as biopsies are often considered to be a revenue stream by private hospitals and clinics.
ROI for AI solutions is influencing the treatment pathway by accelerating the use of quantitative imaging in routine clinical practice, automating the time-consuming task of manually taking measurements. Clinically validated imaging biomarkers can help to improve diagnostic accuracy, to determine prognosis and to predict therapeutic response, leading to more personalized, data-driven treatment planning for individual patients. Moreover, AI will play a key role in treatment planning decision support, by leveraging past patient data to inform decision making. This will lead to shorter treatment planning cycles and potentially eliminate the need for treatment planning iterations, saving costs and improving treatment outcomes
Validation
Developing an AI algorithm that can address the points above is all well and good, but without proper clinical validation, it is unlikely to be trusted, and hence used, by clinicians.
Supervised training of algorithms in a development environment requires access to a large volume of curated medical images. These images ought to have variability in terms of clinical presentation of a case, as well as the demography of patients and the variety of scanners that captured the images to develop a truly robust algorithm suitable for the global market. It is why most solutions have focused on pulmonology and the breast, as there is a wealth of publicly available data to develop such algorithms. To gain acceptance with commercial partners and health providers, AI ISVs need to demonstrate that they have developed their systems using diverse data sets.
The key driver of clinical validation in the long term will be the ability of AI ISVs to partner with healthcare providers to conduct prospective clinical studies to test the robustness of their solutions in real-world clinical settings. The results of the study will then need to be published in a respected peer-reviewed journal. Such studies are time-consuming and expensive as they require a large amount of de-identified, well labelled (clinically) data, and the clinical environment to run the study.
However, the benefits of this will far outweigh the initial investment, giving credibility to the solution and helping to win the trust of potential partners and customers. Although some companies have started to conduct such studies, to date very few have published results. Robust clinical validation is a strong differentiator for AI ISVs. The increased availability of peer-reviewed clinical validation of AI solutions will be a major catalyst for their uptake in clinical practice.
Additionally, with established imaging vendors making forays into the AI space, what was once hype is now in the early stages of market maturity, and, it appears that AI, within medical imaging, is here to stay.
The question has now shifted to what clinical value AI solutions can provide, rather than if AI is suitable for medical imaging. Radiologists are no longer apprehensive AI will remove them from their jobs and are now in the driving seat in terms of dictating what they want from such solutions.
However, there was little variation in the AI solutions at this show, with many vendors targeting the same clinical applications. With well over 100 companies developing AI solutions for medical imaging, some segments of this fledgling market are already looking crowded. The successful vendors will be those that are able to clearly demonstrate their ability to deliver value, in terms of clinical relevancy, clinical validation, workflow integration and return on investment.
Clinical relevancy
Remaining relevant in an ever-adapting environment is every company’s aspiration, and companies in the medical imaging AI field are no different. Key to this is companies developing AI solutions that are clinically relevant to healthcare providers.
One of the barriers to this is the lack of availability of well-annotated data to train the machine learning algorithm. Most of the public data sets are focused on high-volume routine cases—for example, lung nodules or breast anomalies that are indicative of breast cancer. As a result, most AI start-ups are targeting these high-volume clinical cases.
However, radiologists cover a large array of clinical cases throughout a typical workday. There are a small number of high-volume cases (such as lung nodules), but most clinical cases are yet to be addressed by AI solutions and are an untapped market for vendors. While there is certainly value in AI solutions targeted at these repetitive and time-consuming high-volume cases, for AI to realize its full potential in medical imaging, radiologists need a more comprehensive set of AI-enabled tools. Successful vendors will have innovative strategies for obtaining annotated data and that have secured multiple data-sharing partnership with health providers, enabling them to develop algorithms for a diverse range of clinical cases.
Early AI solutions were typically point solutions, developed for a specific pathology. Now, there is a trend to develop solutions that are more akin to AI diagnostic toolkits. Specifically, these solutions can detect more than one anomaly, ideally within a body area in its entirety, and in some cases across multiple organs.
Not only do these more comprehensive solutions provide a greater level of diagnostic support, they also simplify the process of integrating AI in the clinical workflow (offering one solution instead of many individual algorithms) and are likely to be more cost effective. Although the robustness and thoroughness of these solutions varies between vendors, the consensus seems to indicate this will be a key development trend in the future.
This leads to the value of medical imaging AI solutions beyond anomaly detection. The ability of AI solutions to quantify features of a scan enhances the value of radiology reports for referring physicians and can ultimately improve clinical outcomes. AI solutions that take this a step further, and support or offer a differential diagnosis remain the pinnacle, for both AI developers and radiologists alike. At this show, it was evident that vendors are making progress in this respect, with several showing solutions that give a probability score for the likelihood of malignancy for a nodule or lesion.
Further, AI has a wider role to play within medical imaging beyond image analysis. Image analysis is the main state of play in today’s market, but image acquisition (pre-phase), and reporting and treatment planning (post-phase) will become increasingly important in the coming years.
Image acquisition appears to be the next major use-case for AI in medical imaging, with a three-fold benefit for healthcare providers. First, the time to undergo a scan will be much reduced, providing benefit to the patient in terms of quality of care, and to the provider, in terms of maximizing the number of scans delivered per day. Second, the use of machine learning during image reconstruction can enhance the quality of low-dose CT scans to that of normal dose CT scans, reducing patient radiation exposure. Finally, AI can be utilized to reduce noise and artefacts from scan images (especially if low-quality), to improve the radiologist’s diagnostic confidence and potentially reduce rescans.
Workflow integration
For AI to become mainstream, it must be seamlessly integrated into radiology workflows, either at the point of image acquisition or in the PACS environment. Although AI solutions may be integrated into the scanner itself, both for image acquisition and for image analysis, this is a more difficult market to address by the independent software vendors, because it’s more tightly regulated environment.
There were very few embedded AI solutions at the most recent show, suggesting that the modality vendors are taking a cautious approach to integrating AI. The embedded image analysis solutions on show were a mix of native applications developed by the modality vendors and third-party applications, while the AI-enabled image acquisition solutions were home-grown applications. We expect to see activity for embedded AI solutions gradually ramp-up during 2019.
The demand on a radiologist’s time is typically very high, and workflow efficiency is key. Radiologists’ uptake of AI solutions will be driven by how effectively and seamlessly they integrate with their current workflow. AI solutions that are tightly integrated into the primary diagnostic viewer, such as PACS, and do not require radiologists to open a dedicated AI viewer are likely to gain most traction. Regardless of whether AI solutions offer an effective user interface, transitioning from the PACS environment increases the radiologist’s time spent reading the scan, or the risk of software malfunctioning. This will likely lead to radiologists accessing the AI solution less, or not at all.
PACS and enterprise imaging vendors are ramping-up their AI activities and are typically following similar implementation strategies—a dedicated AI platform to act as a container for native and third party AI algorithms that are tightly integrated into the diagnostic viewing platform, coupled with a supplementary cloud-based marketplace of third party AI applications.
Some vendors are proposing on-premise and cloud variants for their AI platforms, with others offering cloud only. Over the longer term, we expect cloud platforms will become the preferred solution, but at this early stage of the AI market and the transition to cloud in medical imaging, there is certainly room for both approaches. There is a strong argument that as AI becomes more commonplace, it will help to accelerate the acceptance of cloud in medical imaging.
In much the same way that the modality vendors are taking a cautious approach to third-party applications, the imaging IT vendors are being very selective about partnering with AI solution vendors for their AI platforms, typically putting solutions through extensive in-house testing and validation to ensure the robustness and clinical value before committing to integrations. Additional applications can then be offered through a marketplace, but typically less tightly integrated with the diagnostic viewer.
Although most AI ISVs are initially selling direct to providers, gaining traction and upscaling will eventually become difficult, not to mention the expense of building an international direct sales team. An increasing number of ISVs have chosen to partner with AI marketplaces, often to gain access to an established customer base.
At this early stage of the market development, it is unclear if AI marketplaces will be successful and whether customers will prefer to use a marketplace from their main imaging vendor or an independent marketplace. The AI solution vendors appear to be hedging their bets and partnering with both.
Although many of the incumbents have been seemingly slow to react to the adoption of AI in medical imaging, we believe the modality and imaging IT vendors will have the greatest influence over the longer-term scope and future direction of the market, due to their influence and pivotal role in integrating AI in the radiology workflow. As such, it is essential that AI ISVs form partnerships with the incumbent imaging vendors.
Return on investment
With healthcare budgets under pressure globally, AI vendors must clearly articulate a tangible ROI for healthcare providers, to justify the significant investment in software and the supporting IT infrastructure required to support AI deployments. This can be realized in a various way, as outlined below.
In countries where the demand on a radiologist’s time is high, typically due to a shortage of radiologists, for example the National Health Service in the UK, the incentive of increased productivity is a key value proposition for AI and arguably the strongest driver of ROI. AI solutions that can triage cases (determine the urgent cases from the non-urgent cases) and decrease the time needed to read scans are key. Similar, for private radiology groups the incentive of increased productivity will be a key driver for the uptake of AI.
However, in countries with an ample supply of radiologists, such as the Nordic countries, the demand on a radiologist’s time may be less of a factor, and diagnostic quality will be the primary driver of ROI from AI solutions, alongside productivity.
Another avenue for ROI, which a small number of AI solution vendors have managed to target, is to improve the effectiveness, both cost and clinical, of the diagnostic pathway. For example, fractional flow reserve-computed tomography (FFR-CT) enabled by AI image analysis is increasingly being used as an alternative to interventional angiography. This lowers cost for the provider and reduces the risk of infection for the patient, justifying the investment in AI. There is also the potential to reduce the number of biopsies in a range of clinical applications, although this is more likely to be the driver in single payer markets as biopsies are often considered to be a revenue stream by private hospitals and clinics.
ROI for AI solutions is influencing the treatment pathway by accelerating the use of quantitative imaging in routine clinical practice, automating the time-consuming task of manually taking measurements. Clinically validated imaging biomarkers can help to improve diagnostic accuracy, to determine prognosis and to predict therapeutic response, leading to more personalized, data-driven treatment planning for individual patients. Moreover, AI will play a key role in treatment planning decision support, by leveraging past patient data to inform decision making. This will lead to shorter treatment planning cycles and potentially eliminate the need for treatment planning iterations, saving costs and improving treatment outcomes
Validation
Developing an AI algorithm that can address the points above is all well and good, but without proper clinical validation, it is unlikely to be trusted, and hence used, by clinicians.
Supervised training of algorithms in a development environment requires access to a large volume of curated medical images. These images ought to have variability in terms of clinical presentation of a case, as well as the demography of patients and the variety of scanners that captured the images to develop a truly robust algorithm suitable for the global market. It is why most solutions have focused on pulmonology and the breast, as there is a wealth of publicly available data to develop such algorithms. To gain acceptance with commercial partners and health providers, AI ISVs need to demonstrate that they have developed their systems using diverse data sets.
The key driver of clinical validation in the long term will be the ability of AI ISVs to partner with healthcare providers to conduct prospective clinical studies to test the robustness of their solutions in real-world clinical settings. The results of the study will then need to be published in a respected peer-reviewed journal. Such studies are time-consuming and expensive as they require a large amount of de-identified, well labelled (clinically) data, and the clinical environment to run the study.
However, the benefits of this will far outweigh the initial investment, giving credibility to the solution and helping to win the trust of potential partners and customers. Although some companies have started to conduct such studies, to date very few have published results. Robust clinical validation is a strong differentiator for AI ISVs. The increased availability of peer-reviewed clinical validation of AI solutions will be a major catalyst for their uptake in clinical practice.
More for you
Loading data for hdm_tax_topic #better-outcomes...