Call them the cyberbully detectives: Researchers at CU Boulder have designed a new technique for spotting nasty personal attacks on social media networks like Instagram.
The new approach, developed by the CyberSafety Research Center, is a response to a pernicious online problem that has been linked to the suicides of multiple teenagers in recent years. The method combines several different computing tools to scan massive amounts of social media data, sending alerts to parents or network administrators that abuse has occurred.
It’s rocket fast, too: In recently published research, the group reported that their approach uses five times less computing resources than existing tools. That’s efficient enough to monitor a network the size of Instagram for a modest investment in server power, said study co-author Richard Han.
He and his colleagues hope that social media companies will take note, implementing the team’s toolset in their own networks. Han compared the prevalence of cyberbullying to the spread of fake news on social media, which Facebook CEO Mark Zuckerberg spoke to European leaders about in May.
“The response of the social media networks to fake news has recently started to uptick, even though it took grave consequences to reach that point,” said Han, an associate professor in the Department of Computer Science. “The response needs to be just as strong for cyberbullying.”
The group also released a free app for Android phones that allows parents to receive alerts when their kids are the objects of bullying on Instagram. Study co-author Shivakant Mishra said that the app, called BullyAlert, is a valuable tool because it can learn from and adapt to what parents consider bullying.
“As a parent, I know that a lot of times we are not in full knowledge of what our children are doing on their social networks,” said Mishra, a professor in Computer Science. “An app like this that informs us when something problematic is happening is invaluable.”
Building these sorts of resources, however, is a technical challenge—akin to finding a toxic needle in a very large haystack.
Mishra explained that users have posted 40 billion photos and videos to Instagram since its launch in 2010. As a result, “we want to be able to process as many posts as possible as fast as possible,” he said. “But at the same time, we don’t want our accuracy to go down.”
To keep that balance, the CyberSafety team first employed real humans to teach a computer program how to separate benign online comments (“Love you!”) from abuse (“You suck.”)
Next, the researchers designed a system that works a bit like hospital triage. When a user uploads a new post—say, a photo of a new pasta recipe—the group’s tools make a quick scan of the comments. If those comments look questionable, then that post gets high priority to receive further checks. But if the comments all seem charitable, then the system bumps the post to the bottom of its queue.
“Our goal is to focus on the most vulnerable sessions,” Han said. “We still continue to monitor all of the sessions, but we monitor more frequently those sessions that we think are more problematic.”
And it works: The researchers tested their approach on real-world data from Vine, a now-defunct video-sharing platform, and Instagram, which is especially popular among younger Internet surfers. Han explained that the team picked those networks because they make their data publicly available.
In research presented at a conference in April, the group calculated that their toolset could monitor traffic on Vine and Instagram in real-time, detecting cyberbullying behavior with 70 percent accuracy. What’s more, the approach could also send up warning flags within two hours after the onset of abuse—a performance unmatched by currently available software.
Han said that social media companies have no excuse not to implement such approaches for monitoring cyberbullying. He explained that online harassment can be more dangerous than schoolyard bullying because it can reach kids anywhere, even in their own homes.
The message to social media companies is that “people are abusing your networks to spread fake news, but also they’re also hurting kids,” Han said. “All of us need to do better to protect the kids.”
The Latest on: Monitoring cyberbullying
via Google News
The Latest on: Monitoring cyberbullying
- Screen Time and Young People in the Age of Social Distancingon March 21, 2020 at 9:20 pm
Last week I received an email from the Superintendent of my daughter’s school district. In response to the COVID 19 pandemic and efforts to curb the spread of the virus, schools in her district would ...
- Q&A: The startup that's using AI to protect children onlineon March 21, 2020 at 11:07 am
Many parents worry about what their children might stumble across online. L1ght is an anti-toxicity startup using AI to detect and filter harmful online content to protect children. We talk with the ...
- Office of Public School Monitoring to conduct Tiered Focused Monitoring Review of Assabet Valley Regional Technical High Schoolon March 19, 2020 at 4:11 am
Areas of review related to civil rights include bullying, student discipline, physical restraint and equal access to school programs for all students. In addition to the on-site visit, parent outreach ...
- FISA ‘Reform’ Is No Reform at Allon March 11, 2020 at 9:08 am
Expect bullying and fear mongering by the supporters of warrantless wiretapping to commence ... They point out that there are no limitations on the use of business records collection and that a ...
- Enfield Council's former deputy leader in 'bullying' stormon March 10, 2020 at 12:08 am
The monitoring officer states Cllr Anderson “failed to treat officers with respect on several occasions”, breaching two parts of the code of conduct. His letter also states that on several occasions ...
- Rockland Public Schools to host Office of Public School Monitoringon March 9, 2020 at 8:32 am
The PSM will conduct a tiered focused monitoring review of Rockland Public Schools ... PSM officials will also review areas regarding civil rights at the school including bullying, student discipline, ...
- Bullying suspected factor in girl's suicideon February 27, 2020 at 4:07 pm
that doesn’t mean we have the power to completely erase bullying, monitor it at every moment, or prevent it from happening. The law requires that we educate all students, even those who engage ...
- Aunt calls for new bullying laws after Birmingham nephew committed suicide at just nine-years-oldon February 22, 2020 at 9:33 pm
in its FAQ section. The answer is as follows: "Staff should develop a consistent approach to monitoring bullying incidents in their school and evaluating whether their approach is effective.
- Footy Legend Tayla Harris Urges The AFL To “Be The Leader” Against Social Media Trollingon February 21, 2020 at 11:48 pm
God damn I’ll give up my AFLW wage to employ someone to monitor this, public bullying is a ripple effect to young people in schools and communities that lead to mental health issues and suicide.
via Bing News