Continuously Learning Systems (CLS) Working Team
To increase the assurance of our product quality by becoming a predictive organization through the power of AI to provide more robust information to make more informed decisions than we can today.
Call for AI Experts
If you are an AI Expert, the Continuously Learning Team would like you to join a new phase of their work (see Phase I listed further below).
Background: One of the challenges with systems that continuously learn, is that since they continuously evolve, we can’t validate them in the traditional way our industry is used to validating processes. So how can we evaluate those systems in a way that industry and regulators can be comfortable with the credibility and reliability of the outcome?
Phase II of our Work: AI experts are needed, because we are going to:
- Solve some of the Questions for Consideration that the current team is developing, such that we can establish Good machine Learning Practices (GmLP) for evaluating systems that continuously learn.
- Develop Good Explainabilty Practices (GEP) that establish a process to assess the credibility of the inputs, and keep the inputs linked to the outputs such that there is credibility and confidence in the outcomes to support Augmented Human Decisions through AI.
If you are an AI Expert and are interested in joining this effort, please contact Marla Phillips at: firstname.lastname@example.org or 513-745-3073.
Full list of working team members are listed at the bottom of page.
- Berkman Sahiner, Senior Biomedical Research Scientist, FDA
- Mohammed Wahab, Senior Manager, Informatics and Analytics, Abbott
Mac McKeen, Fellow, Regulatory Science, Boston Scientific
Mentor from Xavier AI Core Team
Walt Mullikin, Head of Enterprise Analytics, Shire
AI Expert from Xavier AI Core Team
Kumar Madurai, Principal Consultant, CTG
Problem Statement to Address
Continuously learning systems bear the risks of unanticipated outcomes due to a lack of human involvement in the changes, unintended (and undetected) degradation in time, confusion for users, and incompatibility of results with other software that may use the output of the evolving algorithm.
- There is already an existing body of literature concerning the validation of locked algorithms in medicine. The current thinking is therefore to limit the scope of the working team to continuously learning algorithms, although the experience from locked algorithms will be helpful.
- The working team should leverage the experience gained in other industry sectors as much as possible. However, considering the focus of the summit attendees, the emphasis should be on medical applications. The group should discuss whether any medical application is within the scope, or whether to focus on only algorithms within the purview of the FDA.
- The technical needs for validation both before the algorithm is deployed as well as after the algorithm starts evolving in the field should be considered.
Problem Solving Process
- Identify the current landscape of continuously-learning algorithms as it relates to this work group.
- Develop a hierarchy of continuously learning algorithms, from the simplest (closest to the locked algorithms) to the most advanced.
- Start with what we think we know: Scientific needs for validation of locked algorithms.
- Identify important components of continuously-learning algorithms and potential ways to evaluate them.
- Role Reversal Experiment: think of yourself as a customer of a continuously-learning algorithm.
- Validation needs may be different depending on various factors, such as the risk of the algorithm, where it is deployed, whether the algorithm is considered a medical device or not, etc. Need a good framework to address multiple factors. Alternatively, narrow the focus.
- This is a very quickly changing field. Need to think comprehensively about the field so that the output does not become quickly obsolete.
- May need some time at the beginning to get all team members on the same page, speaking the same language (terminology issues).
- Limited hands-on experience with continuously learning algorithms may be an impediment to our reasoning process in figuring out what the evaluation needs are. There is a need to be resourceful and use analogies to other industry sectors, while keeping in mind that risks in the medical field are sometimes unique.
- Detailed examples of continuously-learning algorithms currently used in medicine
- A list of continuously-learning algorithm applications in medicine that we might likely encounter in the near future
- Preparation and conduct of a survey on the current landscape of continuously-learning algorithms in medicine
- Identification at a high level as to what scientific and technical information is important to know about a continuously-learning algorithm to have confidence in its safety and effectiveness:
a. Before the algorithm is deployed
b. After the algorithm starts to evolve while it is in use
CLS Working Team Members
- Eileen Alexander, Asst. Professor, Xavier University
- Pat Baird, Head of Global Software Standards, Philips
- Robert Banta, Quality Consultant, Eli Lilly and Company
- Rick Chapman, Sanofi
- John Daley, Vice President, IBM
- Tom Doyle, Director, Data Science, Janssen Research & Development, LLC
- Bruce Friedman, GE Healthcare
- Lacey Harbour, Ken Block Consulting
- Lan Herrington, Director, Regulatory Affairs, Sotera Wireless, Inc.
- Cynthia Ipach, President, Compliance Insight
- Paul Kostoff, Co-Founder, Cincy-Data
- Andrew Langsner, Co-Founder, Cincy-Data
- Robert Kruth, Manager, IT Regulatory Compliance, Johnson & Johnson
- Cindi Linville, Director of Quality, Best Sanitizers
- Deepa Mahajan, Scientist, BSC
- Stuart Merdian, AD - Corporate, QAP&G
- Eda Ross Montgomery, Head of Commercial Prod and Technical Knowledge, Shire Pharmaceutical
- Dave Moore, Director, IT Regulatory Compliance, Johnson & Johnson
- Rohit Nayak, Principal, Start Up
- Juan Perez, Principal Consultant, Infosys
- Gregory Pierce, CEO, EngiLifeSciences
- Gary Ritchie, GER Compliance
- Zach Rothstein, AVP, AdvaMed
- Scott Thiel, Director, Navigant
- Leonardo Valentin, Medical Imaging Alliance Manager, NVIDIA
- Gregor Woodard, Biomedical Engineer, Ken Block Consulting
- Krista Woodley, Sr Director Quality Healthcare Texhnology, Johnson and Johnson
- Gerald Zemble, Sr. Quality Specialist III, Purdue Pharma L.P.
- Hui Zhao, Associate Professor of Supply Chain Management, Penn State