In 1907, a statistician named Francis Galton recorded the entries from a weight-judging competition as people guessed the weight of an ox. Galton analyzed hundreds of estimates and found that while individual guesses varied wildly, the median of the entries was surprisingly accurate and within one percent of the ox’s real weight. When Galton published his results, he ushered the theory of collective intelligence, or the “wisdom of crowds,” into the public conscience.
Collective wisdom has its limits, though. In a new study published in the Journal of the Royal Society Interface, incoming Omidyar Fellow Albert Kao (Harvard University), Omidyar Fellow Andrew Berdahl, and their colleagues examined just how accurate our collective intelligence is and how individual bias and information sharing skew aggregate estimates. Using their findings, they developed a mathematical correction that takes into account bias and social information to generate an improved crowd estimate. In the study, their corrected measures were more accurate than the mean, median, and other traditional statistics.
“There is growing evidence that the wisdom of crowds can be really powerful,” Kao says. “A lot of studies show that you can calculate the average of estimates and that average can be surprisingly good.”
“However,” adds Berdahl, “there is a great deal of evidence that people have strong biases in estimation and decision tasks.”
The researchers recruited over 800 volunteers to participate in the study and asked each participant to guess the number of gumballs in a jar, which ranged over several orders of magnitude from 54 to more than 27,000. Additionally, they quantified how individuals incorporate social information into their own opinion. To do so, the researchers offered participants fake details about other people’s guesses and allowed them to change their estimate in light of that information.
Kao’s team found that while estimates varied considerably, they were highly predictable. People tended to guess numbers smaller than the actual value and guessed a wider range of numbers for larger jars. Social information also plays a role in collective wisdom. For example, the simulated social information revealed that peer advice more strongly influenced an individual if the knowledge suggested the actual number of items was higher than the guesser’s initial estimate. Smaller guesses, even if more accurate, appear to be more frequently discounted.
The findings define a clear set of rules for collective estimation, which in turn provide insight into why we observe the wisdom of crowds. This understanding can improve group wisdom in a variety of settings. Whether guessing the weight of a fat ox or predicting the outcome of future elections, Kao and his colleagues have helped the crowd grow smarter.
Learn more: New study improves ‘crowd wisdom’ estimates
The Latest on: Crowd wisdom
via Google News
The Latest on: Crowd wisdom
- Joe Biden and the danger of a conventional wisdom foreign policyon November 27, 2020 at 7:00 am
Decades of ineffectual inaction regarding North Korea's and Iran's nuclear programs has transformed the problems into something far more dangerous.
- Posters to Reddit's Am I the Asshole forum claim harassment after sharing their storieson November 27, 2020 at 4:00 am
The Reddit community Am I the Asshole? describes itself as “a catharsis for the frustrated moral philosopher in all of us.” Every day, thousands of people detail situations in which they may or may ...
- The foreign-policy establishment strikes backon November 25, 2020 at 3:56 pm
Joe Biden’s team consists of Obama alumni who know how to behave. But while their manners will be impeccable, they seem unlikely to be able to learn from their past errors.
- Feast Day of Agia Aikaterini, the Great Martyr of Alexandriaon November 24, 2020 at 1:55 pm
On November 25, the Greek Orthodox Church commemorates the Feast Day of Agia Aikaterini the Great Martyr of Alexandria, who is also the protector of students ...
- Should the power of the crowd be used to solve our social problems?on November 20, 2020 at 3:05 am
According to new research from Nesta and The GovLab, the answer is yes. Which is why we need to encourage the growth of open source-powered ‘collective intelligence’ ...
- Heidi Stevens: COVID-19 took me to the hospital, and left me scared, angry and hopefulon November 18, 2020 at 3:40 am
I'm scared – about how many infections, hospitalizations, deaths lie ahead, about spikes across the country, about folks gathering for Thanksgiving.
- Kass: The 'Group Stink' Crowd Is Lining Upon November 17, 2020 at 10:06 am
Simple answers to a complicated market patchwork should not be satisfactory and acceptable anymore.
- ‘Lego Star Wars Holiday Special’ Review: A Warm And Fuzzy Crowd-Pleaseron November 17, 2020 at 1:30 am
Disney Plus’ ‘Lego Star Wars Holiday Special’ is here to wrap fans in the warm memories of Star Wars’ past. After all, 'tis the season to watch a Lego-style re-run of the film franchise's best moments ...
- Chicago outdoors: Jackson Park hassles, Cooper’s hawk, fall turkey harvest fall, outdoors wisdomon November 14, 2020 at 7:36 am
Hassling of anglers at Jackson Park, a Cooper’s hawk by a school, the mighty fall of Illinois’ fall turkey harvest and universal wisdom in a specific hunting report are among the notes from around ...
via Bing News