Hospital-based laboratories and doctors at the front line of the COVID-19 pandemic might soon add artificial intelligence to their testing toolkit. A recent study conducted with collaborators from the University of Vermont and Cedars-Sinai describes the performance of Biocogniv’s new AI-COVID™ software.
The team found high
accuracy in predicting the probability of COVID-19 infection using routine
blood tests, which can help hospitals reduce the number of patients referred
for scarce PCR testing.
“Nine months into
this pandemic, we now have a better understanding of how to care for patients
with COVID-19,” says lead author and University of Vermont Assistant Professor
Timothy Plante, M.D., M.H.S., “but there’s still a big bottleneck in COVID-19
diagnosis with PCR testing.”
PCR testing is the
current standard diagnostic for COVID-19, and requires specific sampling, like
a nasal swab, and specialized laboratory equipment to run.
Biocogniv Chief
Operating Officer Tanya Kanigan, Ph.D., says, “According to data from over 100
US hospitals, the national average turnaround time for COVID-19 tests ordered
in emergency rooms is above 24 hours, far from the targeted one-hour
turnaround.”
Complete Blood
Count and Complete Metabolic Panels are common laboratory tests ordered by
emergency departments and have a rapid turnaround time. These tests provide
insight into the immune system, electrolytes, kidney, and liver. The
researchers were able to train a model that analyzes changes in these routine
tests and assigns a probability of the patient being COVID-19 negative with
high accuracy.
“AI-COVID takes
seconds to generate its informative result once these blood tests return, which
can then be incorporated by the laboratory into its own test interpretation,”
says Jennifer Joe, M.D., an emergency physician in Boston, Mass. and
Biocogniv’s Chief Medical Officer. “In an efficient emergency department that
prioritizes these routine blood tests, the door-to-result time could be under
an hour.”
Cedars-Sinai
pulmonary and internal medicine specialist Victor Tapson, M.D., says such
assistive tools that help physicians rule out possible diagnoses are familiar
in emergency medicine. “For example, a low D-dimer blood test can help us rule
out clots in certain patients, allowing providers to skip expensive, often
time-consuming diagnostics such as chest CT scans,” says Tapson.
The Biocogniv team
believes a secondary benefit of laboratories incorporating AI-COVID might be
reduced time for traditional PCR results. “With the help of AI-COVID,
laboratories might relieve some of the testing bottleneck by helping providers
better allocate rapid PCR testing for patients who really need it,” says Joe.
The AI-COVID model
was validated on real world data from Cedars-Sinai as well as on data from
geographically and demographically diverse patient encounters from 22 U.S.
hospitals, achieving an area under the curve (or AUC) of 0.91 out of 1.00.
“This enables the
model to achieve a high sensitivity of 95% while maintaining moderate
specificity of 49%, which is very similar to the performance of other commonly
used rule-out tests,” says Biocogniv Chief Scientific Officer George Hauser,
MD, a pathologist.
Biocogniv CEO Artur
Adib, Ph.D., says, “I’m honored to have such an impressive team of medical
scientists from the University of Vermont and Cedars-Sinai as collaborators in
validating this timely model. AI has progressed considerably; the time is now
to leverage this powerful tool for new healthcare breakthroughs, and we’re glad
to direct it to help hospital laboratories and providers combat the current
COVID-19 crisis.”