A framework for evaluating clinical artificial intelligence systems without ground-truth annotations

A framework for evaluating clinical artificial intelligence systems without ground-truth annotations

Description of datasets

Stanford diverse dermatology images

The Stanford diverse dermatology images (DDI) dataset consists of dermatology images collected in the Stanford Clinics between 2010 and 2020. These images (n: 656) reflect either a benign or malignant skin lesion from patients with three distinct skin tones (Fitzpatrick I-II, III-IV, V-VI). For further details, we refer interested readers to the original publication14. We chose this as the data in the wild due to a recent study reporting the degradation of several models’ performance when deployed on the DDI dataset. These models (see Description of models) were trained on the HAM10000 dataset, which we treated as the source dataset.

HAM10000 dataset

The HAM10000 dataset consists of dermatology images collected over 20 years from the Medical University of Vienna and the practice of Cliff Rosendahl16. These images (n: 10015) reflect a wide range of skin conditions ranging from Bowen’s disease and basal cell carcinoma to melanoma. In line with a recent study14, and to remain consistent with the labels of the Stanford DDI dataset, we map these skin conditions to a binary benign or malignant condition. We randomly split this model into a training and held-out set using a 80: 20 ratio. We did not use a validation set as publicly-available models were already available and therefore did not need to be trained from scratch.

Camelyon17-WILDS dataset

The Camelyon17-WILDS dataset consists of histopathology patches from 50 whole slide images collected from 5 different hospitals29. These images (n: 450, 000) depict lymph node tissue with or without the presence of a tumour. We use the exact same training (n: 302, 436), validation (n: 33, 560), and test (n: 85, 054) splits constructed by the

Read More

The uses and benefits of artificial intelligence in clinical trials

The uses and benefits of artificial intelligence in clinical trials

The need for new drugs and medical treatment has been greater than ever. However, drug development is a complex and time-consuming process. Despite the lightning speed at which COVID-19 vaccines were developed, it often takes 10 to 12 years to bring a new drug to market, and the clinical trial phase averages five to seven years.

Even reaching the trial phase gives no guarantee that the drug will get the US Food and Drug Administration (FDA) approval, as the vast majority of R&D efforts fail to produce a market-worthy product, and only 12% of such drugs receive FDA approval.

So, to come up with a breakthrough drug, Pharma companies need to leverage AI capabilities that can reliably enhance the FDA approval rate while ensuring drug effectiveness and safety.

Let’s discover more about the various use cases, benefits, and limitations of using artificial intelligence in clinical trials.

Understanding the Role of Artificial Intelligence in Clinical Trials

Artificial intelligence (AI) in healthcare is becoming increasingly prevalent across the industry. According to Statista, the global healthcare AI market was worth around $11 billion in 2021 and is projected to be worth $188 billion by 2030, increasing at a CAGR of 37% from 2022 to 2030.

AI in Healthcare Market

AI is set to be the most disruptive technology in drug development, enabling automation, unlocking advanced analytics, and increasing speed across the phases of the clinical trial.

Today’s clinical trials value chain is shaped by macro trends that include climate pressure, geopolitical uncertainty, and the COVID-19 pandemic. Furthermore, the increasing demand for personalized treatment and advancements in adaptive design have made clinical trials more complex than ever. AI offers optimization opportunities across every aspect of the clinical trial process, including data analysis, pattern recognition, and early identification of potential problems.

Also Read: How AI Expedites Medical Diagnosis?

Read More



ADELAIDE, Australia and RALEIGH, N.C., Sept. 21, 2023 /PRNewswire/ — Avance Clinical, the award-successful Australian and North American sector-main CRO for biotechs, announces two important appointments in the US to help its ongoing worldwide development.

Kevin Leach joins as Senior Vice President of Scientific and Regulatory Affairs, based in Massachusetts, Usa. Kevin has a history in the biopharma sector with encounter in early and late-stage drug discovery and growth.

Madison Esely-Kohlman has joined as a Director of Enterprise Progress centered in Salt Lake Metropolis, Utah and is centered on partnering with biotech businesses on their Stage I-III medical trials.

In welcoming both Kevin and Madison, CEO, Yvonne Lungershausen stated they bring considerable knowledge that will assist Avance Clinical’s expanding US and Australian operations as perfectly as our global progress programs.

“We are looking at growing desire for our biotech-distinct providers such as ClinicReady and GlobalReady which are built for pre-clinical, early period and afterwards section scientific enhancement. GlobalReady is a exclusive presenting enabling biotechs to commence fast and cost efficiently with Avance Medical in Australia and changeover with our staff in the US for later on stage trials, with all the rewards of retaining the one particular CRO,” she claimed.

Kevin Leach PhD, DAB: Senior Vice President, Scientific and Regulatory Affairs

Kevin Leach has a lot more than 20 years of experience doing the job in drug discovery and enhancement in the pharmaceutical sector and will present extraordinary knowledge and experience to Avance Clinical’s biotech clientele. He has a PhD in biochemistry and molecular biophysics at Healthcare School of Virginia and finished his Submit Doctoral Fellowship in Organic Engineering at Massachusetts Institute of Technological innovation.

“Previously, I was on the client-aspect doing work with Avance

Read More