Millions of tweets analyzed to measure perceived trustworthiness
By scanning 66 million tweets linked to nearly 1,400 real-world events, Georgia Institute of Technology researchers have built a language model that identifies words and phrases that lead to strong or weak perceived levels of credibility on Twitter. Their findings suggest that the words of millions of people on social media have considerable information about an event’s credibility – even when an event is still ongoing.
“There have been many studies about social media credibility in recent years, but very little is known about what types of words or phrases create credibility perceptions during rapidly unfolding events,” said Tanushree Mitra, the Georgia Tech Ph.D. candidate who led the research.
The team looked at tweets surrounding events in 2014 and 2015, including the emergence of Ebola in West Africa, the Charlie Hebdo attack in Paris and the death of Eric Garner in New York City. They asked people to judge the posts on their credibility (from “certainly accurate” to “certainly inaccurate”). Then the team fed the words into a model that split them into 15 different linguistic categories. The classifications included positive and negative emotions, hedges and boosters, and anxiety.
The Georgia Tech computer then examined the words to judge if the tweets were credible or not. It matched the humans’ opinions about 68 percent of the time. That’s significantly higher than the random baseline of 25 percent.
“Tweets with booster words, such as ‘undeniable,’ and positive emotion terms, such as ‘eager’ and ‘terrific,’ were viewed as highly credible,” Mitra said. “Words indicating positive sentiment but mocking the impracticality of the event, such as ‘ha,’ ‘grins’ or ‘joking,’ were seen as less credible. So were hedge words, including ‘certain level’ and ‘suspects.’”
Higher numbers of retweets also correlated with lower credibility scores. Replies and retweets with longer message lengths were thought to be more credible.
“It could be that longer message lengths provide more information or reasoning, so they’re viewed as more trustworthy,” she said. “On the other hand, a higher number of retweets, which was scored lower on credibility, might represent an attempt to elicit collective reasoning during times of crisis or uncertainty.”
The system isn’t deployable yet, but the Georgia Tech team says it could eventually become an app that displays the perceived trustworthiness of an event as it unfolds on social media.
“When combined with other signals, such as event topics or structural information, our linguistic result could be an important building block of an automated system,” said Eric Gilbert, Mitra’s advisor and an assistant professor in Georgia Tech’s School of Interactive Computing. “Twitter is part of the problem with spreading untruthful news online. But it can also be part of the solution.”
The paper, “A Parsimonious Language Model of Social Media Credibility Across Disparate Events,” will be presented in February at the 20th ACM Conference on Computer-Supported Cooperative Work and Social Computing in Portland, Oregon.
Learn more: Finding Credibility Clues on Twitter
Receive an email update when we add a new PERCEIVED TRUSTWORTHINESS article.
The Latest on: Perceived trustworthiness
via Google News
The Latest on: Perceived trustworthiness
- A battle for the soul of America on April 18, 2019 at 6:47 am
nationalism, fear, and perceived self-interest. When an electronic message can ... It is seen by our long-time friends and allies as a betrayal of the trust that has been so carefully built up by our ... […]
- Young children judge others based on facial features as much as adults do on April 18, 2019 at 6:11 am
The children and adults looked at pairs of computer-generated faces that were designed to be perceived as trustworthy or untrustworthy, dominant or submissive and competent or incompetent. ... […]
- How the crisis of trust is shaping tomorrow's brands on April 18, 2019 at 3:38 am
Alex Gordon of Sign Salad explores how a crisis of trust is feeding the trend and how some brands ... Between Donald Trump’s ascent to power, the prospect of a no-deal Brexit, and the perceived ... […]
- Nick Ferrari Lashes Out At Extinction Rebellion Trust Fund Children on April 17, 2019 at 11:46 pm
The capital's police have also come under criticism over their perceived lack of action ... and Tabitha and Quentin to dance around on the bridge because they're probably trust [fund] children so it ... […]
- Doctors’ foreign accent impacts patients’ trust: University of Alberta study on April 16, 2019 at 8:39 am
A new University of Alberta study suggests doctors with foreign accents are perceived as less competent than their peers. Lorelei Baquiran conducted the research as part of her Faculty of Science ... […]
- Third-Party-Created Trust May Be A Self-Settled Trust And Includable In Bankruptcy Estate In Cyr Case on April 15, 2019 at 12:07 pm
This rather clearly suggests that Section 548(e)(1) is intended to broadly address any perceived abuse whereby a debtor seeks to put his assets out of reach of creditors by transferring them to a ... […]
- Your Voice Is The Key To Building Brand Trust on April 15, 2019 at 5:37 am
You are the trust barometer for the company ... Being visible across many mediums helps you be perceived as a leader and advances the brand both regionally and globally. Consider repurposing videos of ... […]
- Young Lakers lost trust in LeBron James during Anthony Davis drama? on April 9, 2019 at 11:00 am
The fallout from the team’s dogged pursuit of the New Orleans Pelicans superstar, however, reportedly left LeBron James alienated from his younger teammates due to his perceived involvement. In a deep ... […]
- The Need for Trust amidst the “Zero Trust” Movement on April 8, 2019 at 6:57 am
Trust in our new “Zero Trust” world (to the Board ... I don’t want this to sound too harsh and again, I don’t want this to be perceived as finger-pointing either. I want this to be a rallying cry to ... […]
via Bing News