Millions of tweets analyzed to measure perceived trustworthiness
By scanning 66 million tweets linked to nearly 1,400 real-world events, Georgia Institute of Technology researchers have built a language model that identifies words and phrases that lead to strong or weak perceived levels of credibility on Twitter. Their findings suggest that the words of millions of people on social media have considerable information about an event’s credibility – even when an event is still ongoing.
“There have been many studies about social media credibility in recent years, but very little is known about what types of words or phrases create credibility perceptions during rapidly unfolding events,” said Tanushree Mitra, the Georgia Tech Ph.D. candidate who led the research.
The team looked at tweets surrounding events in 2014 and 2015, including the emergence of Ebola in West Africa, the Charlie Hebdo attack in Paris and the death of Eric Garner in New York City. They asked people to judge the posts on their credibility (from “certainly accurate” to “certainly inaccurate”). Then the team fed the words into a model that split them into 15 different linguistic categories. The classifications included positive and negative emotions, hedges and boosters, and anxiety.
The Georgia Tech computer then examined the words to judge if the tweets were credible or not. It matched the humans’ opinions about 68 percent of the time. That’s significantly higher than the random baseline of 25 percent.
“Tweets with booster words, such as ‘undeniable,’ and positive emotion terms, such as ‘eager’ and ‘terrific,’ were viewed as highly credible,” Mitra said. “Words indicating positive sentiment but mocking the impracticality of the event, such as ‘ha,’ ‘grins’ or ‘joking,’ were seen as less credible. So were hedge words, including ‘certain level’ and ‘suspects.’”
Higher numbers of retweets also correlated with lower credibility scores. Replies and retweets with longer message lengths were thought to be more credible.
“It could be that longer message lengths provide more information or reasoning, so they’re viewed as more trustworthy,” she said. “On the other hand, a higher number of retweets, which was scored lower on credibility, might represent an attempt to elicit collective reasoning during times of crisis or uncertainty.”
The system isn’t deployable yet, but the Georgia Tech team says it could eventually become an app that displays the perceived trustworthiness of an event as it unfolds on social media.
“When combined with other signals, such as event topics or structural information, our linguistic result could be an important building block of an automated system,” said Eric Gilbert, Mitra’s advisor and an assistant professor in Georgia Tech’s School of Interactive Computing. “Twitter is part of the problem with spreading untruthful news online. But it can also be part of the solution.”
The paper, “A Parsimonious Language Model of Social Media Credibility Across Disparate Events,” will be presented in February at the 20th ACM Conference on Computer-Supported Cooperative Work and Social Computing in Portland, Oregon.
Learn more: Finding Credibility Clues on Twitter
Receive an email update when we add a new PERCEIVED TRUSTWORTHINESS article.
The Latest on: Perceived trustworthiness
via Google News
The Latest on: Perceived trustworthiness
- No Trust in Government to Handle Drug and Alcohol Fuelled Crime, Survey Conducted by Ocean Recovery Centreon November 13, 2019 at 1:00 am
According to the survey conducted by Ocean Recovery Centre, crime is a major cause of alarm throughout the country and 84.6% of the people who took part in the survey said that they don't trust the ...
- Govt says unperturbed by perceived British wink at fired Zim doctorson November 12, 2019 at 9:49 pm
So I am requesting that the minister gives a ministerial statement on the issue.” NewZimbabwe.com – The Zimbabwe News You Trust is Zimbabwe’s leading online newspaper and published by New Zimbabwe ...
- Nicholas Thompson on low trust, in a high-trust environmenton November 12, 2019 at 9:13 am
In those conversations, Zuckerberg suggested increased criticism of Facebook focused on the company’s perceived motives, be they financial or political. “I think it’s tough to break down these ...
- Local News Beats National News for Truston November 6, 2019 at 6:10 am
Only eight percent said they consider national journalists “trustworthy” and only four percent see them as “caring ... may exist because Republicans may suspect a greater disconnect between their ...
- Sackler legacy is at stake in family's bid to reinvent Purdue Pharma as a public truston November 5, 2019 at 10:36 am
But some government officials and health care experts said the proposed public trust is at the core of an elaborate messaging campaign intended to inflate the perceived value of the settlement and to ...
- Why Bitcoin is a perceived threat to the US dollaron November 2, 2019 at 1:22 pm
Many argue it would be more stable and trustworthy than the US dollar. The main arguments against Bitcoin as ... it’s easy to imagine a future in which the US dollar isn’t the world’s sole reserve ...
- The Voices You Can Truston October 29, 2019 at 1:50 am
In a recent study, we investigated how men’s voice pitch is related to actual and perceived trustworthiness across domains. Specifically, we recorded the voices of 181 men (speakers) and assessed ...
- Can Facial Surgery Shape Men's Perceived Personalities?on July 11, 2019 at 2:10 pm
Interestingly, the present study showed men with face-lifts had improved perceived likeability and trustworthiness, but the prior study found women who underwent face-lifts had improved perceptions of ...
- Perceived change in trust in newspapers and magazines Malaysia 2019on July 3, 2019 at 5:00 pm
This statistic shows the result of a survey on the perceived change in trust in newspapers and magazines in Malaysia as of February 2019. According to data from Ipsos, 45 percent of Malaysian ...
via Bing News