Lecture: 'Improving Decision Making with Machine Learning, Provably'

Decision support systems for classification tasks are predominantly designed to predict the value of the ground truth labels. However, these systems also need to make human experts understand when and how to use these predictions to update their own predictions. Unfortunately, this has been proven challenging. In this talk, I will introduce an alternative type of decision support systems  that circumvent this challenge by design. Rather than providing a single label prediction, these systems provide a set of label prediction values, namely a prediction set, and ask experts to predict a label value from the prediction set. Moreover, I will discuss how to use conformal prediction, online learning and counterfactual inference to efficiently construct prediction sets that optimize experts’ performance,  provably. Further, I will present the results of a large-scale human subject study, which show that, for decision support systems based on prediction sets, limiting experts level of agency leads to greater performance than allowing experts to always exercise their own agency.

About the speaker

Manuel Gomez Rodriguez is a tenured faculty at the Max Planck Institute for Software Systems (MPI-SWS). His research interests lie in the development of human-centric machine learning models and algorithms. He has co-authored over 50 publications in top-tier conferences (NeurIPS, ICML, UAI, AISTATS, AAAI, KDD, WWW) and journals (PNAS, Nature Communications, Management Science, JMLR, TMLR). Manuel is an ELLIS Fellow and has received several recognitions for his research, including an ERC Consolidator Grant, an ERC Starting Grant, an outstanding Paper Award at NeurIPS and a Best Research Paper Honorable Mention at KDD and WWW. Manuel holds a M.S. and a Ph.D. in Electrical Engineering from Stanford University (2009 and 2013) and a B.S. in Electrical Engineering from University Carlos III in Madrid, Spain (2006).