Responsible digital solutions and AI

Responsible digital solutions and AI

Stream C — The institutionalization of RIH

Over the past decade, digital health solutions and those relying on artificial intelligence (hereafter called “D/AI solutions”) have exponentially grown and expanded research and health care practices in ways that were previously unthinkable. As health care providers and health systems worldwide will be on the frontline tackling the health effects of climate change and growing social and economic disparities, our team aimed to develop a rigorous tool that can measure the degree of responsibility of D/AI solutions by adapting the multidimensional and already validated Responsible Innovation in Health (RIH) Tool.

To do so, we conducted a three-phase mixed method study:

  1. In Phase 1, we performed a scoping review of practice-oriented tools (n=57) developed since 2015 to support the development and use of responsible and ethical D/AI solutions. We extracted from these tools up to 40 principles that were mapped against the RIH Tool to identify issues that are specific to D/AI solutions and were not covered in the RIH Tool. This mapping process led to a preliminary version of the ‘Responsible D/AI Solutions Assessment Tool.’
  2. In Phase 2, an international two-round e-Delphi expert panel rated on a five-level scale the importance, clarity, and appropriateness of the new Tool’s components (i.e., its premises, screening criteria, and assessment attributes).
  3. In Phase 3, two raters independently applied the revised Tool to a sample of D/AI solutions (n=25), interrater reliability was measured, and final minor changes were brought to the Tool.

The results of the scoping review were published (see below) and confirmed the need for a comprehensive, valid, and reliable tool to assess the degree of responsibility of D/AI health solutions. Because regulation remains limited in this rapidly evolving field, we believe that the new tool we developed has the potential to change practice towards more equitable as well as economically and environmentally sustainable digital health care.

Publications of interest to this project:

Project Team Members: Lysanne Rivard

Robson Rocha de Oliveira

Hassane Alami

Pascale Lehoux