Humans are the final decision makers in critical tasks that involve ethical and legal concerns, ranging from recidivism prediction, to medical diagnosis, to fighting against fake news. Although machine learning models can sometimes achieve impressive performance in these tasks, these tasks are not amenable to full automation. To realize the potential of machine learning for improving human decisions, it is important to understand how assistance from machine learning models affect human performance and human agency.

We use deception detection as a testbed and investigate how we can harness explanations and predictions of machine learning models to improve human performance while retaining human agency. We propose a spectrum between full human agency and full automation, and develop varying levels of machine assistance along the spectrum that gradually increase the influence of machine predictions.

For more details on our project, check out our paper here. Our dataset is also available for download here.

We're a group of researchers at the University of Colorado Boulder, working on Human-centered Machine Learning, Natural Language Processing and Computational Social Sciences. This research is led by Vivian Lai and Chenhao Tan.