Millions of tweets analyzed to measure perceived trustworthiness
By scanning 66 million tweets linked to nearly 1,400 real-world events, Georgia Institute of Technology researchers have built a language model that identifies words and phrases that lead to strong or weak perceived levels of credibility on Twitter. Their findings suggest that the words of millions of people on social media have considerable information about an event’s credibility – even when an event is still ongoing.
“There have been many studies about social media credibility in recent years, but very little is known about what types of words or phrases create credibility perceptions during rapidly unfolding events,” said Tanushree Mitra, the Georgia Tech Ph.D. candidate who led the research.
The team looked at tweets surrounding events in 2014 and 2015, including the emergence of Ebola in West Africa, the Charlie Hebdo attack in Paris and the death of Eric Garner in New York City. They asked people to judge the posts on their credibility (from “certainly accurate” to “certainly inaccurate”). Then the team fed the words into a model that split them into 15 different linguistic categories. The classifications included positive and negative emotions, hedges and boosters, and anxiety.
The Georgia Tech computer then examined the words to judge if the tweets were credible or not. It matched the humans’ opinions about 68 percent of the time. That’s significantly higher than the random baseline of 25 percent.
“Tweets with booster words, such as ‘undeniable,’ and positive emotion terms, such as ‘eager’ and ‘terrific,’ were viewed as highly credible,” Mitra said. “Words indicating positive sentiment but mocking the impracticality of the event, such as ‘ha,’ ‘grins’ or ‘joking,’ were seen as less credible. So were hedge words, including ‘certain level’ and ‘suspects.’”
Higher numbers of retweets also correlated with lower credibility scores. Replies and retweets with longer message lengths were thought to be more credible.
“It could be that longer message lengths provide more information or reasoning, so they’re viewed as more trustworthy,” she said. “On the other hand, a higher number of retweets, which was scored lower on credibility, might represent an attempt to elicit collective reasoning during times of crisis or uncertainty.”
The system isn’t deployable yet, but the Georgia Tech team says it could eventually become an app that displays the perceived trustworthiness of an event as it unfolds on social media.
“When combined with other signals, such as event topics or structural information, our linguistic result could be an important building block of an automated system,” said Eric Gilbert, Mitra’s advisor and an assistant professor in Georgia Tech’s School of Interactive Computing. “Twitter is part of the problem with spreading untruthful news online. But it can also be part of the solution.”
The paper, “A Parsimonious Language Model of Social Media Credibility Across Disparate Events,” will be presented in February at the 20th ACM Conference on Computer-Supported Cooperative Work and Social Computing in Portland, Oregon.
Learn more: Finding Credibility Clues on Twitter
Receive an email update when we add a new PERCEIVED TRUSTWORTHINESS article.
The Latest on: Perceived trustworthiness
via Google News
The Latest on: Perceived trustworthiness
- Why telehealth champions are worried about truston March 23, 2020 at 8:51 am
They both emphasize that even in a crisis, we must not be lulled into a perceived false choice between speed and privacy (or speed and ... The core issue, Coravos suggests, is trust; for telemedicine ...
- Simulation needs to overcome perceived complexity and trust issueson March 23, 2020 at 8:23 am
Finally, the most critical factor as always is trust. Decisions made by simulation need to be trusted – by users and by management and certification agencies such as the TÜV or FDA. There are already ...
- First Trust Mortgage Income Fund Declares its Monthly Common Share Distribution of $0.06 Per Share for Aprilon March 20, 2020 at 5:14 pm
NYSE: FMY) has declared the Fund’s regularly scheduled monthly common share distribution in the amount of $0.06 per share payable on April 15, 2020, to shareholders of record as of April 2, 2020. The ...
- First Trust Intermediate Duration Preferred & Income Fund Declares its Monthly Common Share Distribution of $0.1325 Per Share for Aprilon March 19, 2020 at 5:11 pm
NYSE: FPF) has declared the Fund’s regularly scheduled monthly common share distribution in the amount of $0.1325 per share payable on April 15, 2020, to shareholders of record as of April 2, 2020.
- First Trust/Aberdeen Global Opportunity Income Fund Declares its Monthly Common Share Distribution of $0.08 Per Share for Aprilon March 19, 2020 at 1:28 pm
First Trust Advisors L.P. ("FTA") is a federally registered investment advisor and serves ... regulatory or market developments, changes in interest rates and perceived trends in securities prices.
- Study identifies factors that determine trustworthiness of online information about vaccineson March 19, 2020 at 7:17 am
Furthermore, across the board, answers provided by health professionals were viewed as more trustworthy than those supplied by parents, which, in turn, were more likely to be perceived as trustworthy ...
- The SPDR Gold Trust (GLD) ETF Has an Ample Supply of Fear to Rely Onon March 19, 2020 at 3:20 am
But can you trust the Gold Trust? I’m biased, but I believe you can ... But even if the coronavirus was only a perceived threat, the bottom line is that the fear is real. And when you’re scared, ...
- CORRECTING and REPLACING First Trust Global Portfolios Limited Announces Distribution for First Trust Low Duration Global Government Bond UCITS ETFon March 12, 2020 at 10:16 am
The corrected release reads: FIRST TRUST GLOBAL PORTFOLIOS LIMITED ANNOUNCES DISTRIBUTION ... changes in interest rates and perceived trends in securities prices. The use of derivative instruments can ...
- Building customer trust with an open approachon March 12, 2020 at 2:09 am
They don’t need or want to understand this perceived voodoo magic – and, more importantly, they don’t care. Ultimately, all a customer wants is for your X to solve their Y, ideally in an easy, ...
via Bing News