When more information may not lead to better decisions

Understanding how people use new information to make decisions could lead to ways of helping them make better choices.KatarzynaBialasiewicz / iStock / Getty Images Plus

Every day we use information about cause and effect to help make decisions. With advances in machine learning, computers are now able to turn data into sophisticated models of causation. These models have the potential to help inform the choices that people make in their daily lives. However, it’s unclear how well people can use such models to make real-world decisions.

A research team led by Dr. Samantha Kleinberg of the Stevens Institute of Technology studied how people use causal information in decisions about diet, health, and personal finance. The research was supported in part by NIH’s National Library of Medicine (NLM). Results appeared on February 13, 2020, in Cognitive Research: Principles and Implications.

About 4,000 people completed online surveys through Amazon’s crowdsourcing website Mechanical Turk. Participants were given hypothetical scenarios and asked to respond to multiple-choice questions.

The researchers were interested in understanding how people combine new information with existing knowledge and beliefs. Some of the scenarios involved familiar topics like weight management or saving for retirement. Others were completely novel—involving, for example, mind-reading aliens and musical robots.

The surveys showed that additional information can actually lead to worse decision-making. In a real-world scenario about body weight, a topic on which participants would have experience, “Jane” was trying to avoid gaining weight during her first year of college. Some of the participants were given additional information (e.g., “30 minutes of exercise three times a week is recommended to maintain a healthy weight”) either as text or a diagram. Others received no additional information.

When asked how Jane should avoid weight gain, the people who were given no new information were more likely to make the correct choice. It seemed that familiarity with a topic might influence whether additional information hurt or helped their decision-making.

To test this idea, the team posed a question about diabetes management to a group of people, some of whom had personal experience with the disease. Those with experience did worse on a question about controlling diabetes if given a diagram about maintaining healthy blood sugar than if given no information.

The researchers hypothesized that new information affected the confidence of people with existing knowledge on the topic. This caused them to second-guess themselves and make incorrect decisions. More surveys confirmed that people became less confident in their knowledge when given causal information about a familiar area. The opposite was true of a novel topic, where additional information increased confidence.

The authors note that more causal information isn't bad in itself but needs to be tailored to the individual. More work will be needed to better understand how to personalize this information to guide people to better decisions.

"People hold a certain set of beliefs about disease and treatment, finances, and retirement,” says Kleinberg. “So more information, even with explicit causal relationships, may not be enough to steer people to make the best decisions. It’s how we tailor that information to this existing set of beliefs that will yield the best results.”

—by Erin Bryant