AI Case Study
Instagram battles bullying on its platform with machine learning
Instagram has leveraged machine learning to eliminate offensive comments and bullying on its platform. The system is designed to proactively detect bullying in photos, captions or comments and flag them to the Community Operations team for reviewing. The technology was launched in early October 2018 and is developing.
This change will help us identify and remove significantly more bullying — and it’s a crucial next step since many people who experience or observe bullying don’t report it. It will also help us protect our youngest community members since teens experience higher rates of bullying online than others. This new technology has begun to roll out and will continue to in the coming weeks." (Instagram Press Release)
Industry
Technology
Internet Services Consumer
Project Overview
"Detecting Bullying in Photos:
While the majority of photos shared on Instagram are positive and bring people joy, occasionally a photo is shared that is unkind or unwelcome. We are now using machine learning technology to proactively detect bullying in photos and their captions and send them to our Community Operations team to review.
This change will help us identify and remove significantly more bullying — and it’s a crucial next step since many people who experience or observe bullying don’t report it. It will also help us protect our youngest community members since teens experience higher rates of bullying online than others. This new technology has begun to roll out and will continue to in the coming weeks." (Instagram Press Release)
Reported Results
Results undisclosed
Technology
Function
Customer Service
Other
Background
"Social media companies have been under pressure to better manage harassment and hate speech, a difficult challenge since many of them have millions of users.
Tech companies have also been investing in specialized technology to moderate comments and posts, which is particularly difficult when dealing with photos."
Benefits
Data