Published: Fri, September 14, 2018
Industry | By Terrell Bush

Facebook Rosetta AI finds and understands text in memes

Facebook Rosetta AI finds and understands text in memes

The social network announced its latest artificial intelligence system, dubbed the Rosetta AI.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

With more than 2 billion users worldwide, the sheer volume of languages that appear on Facebook and Instagram presents another significant challenge. The extracted text is then used by downstream classifiers to immediately act upon the policy-violating content or by-product applications like photo search. Asus Days Sale: Get Asus Max Pro 1 Smartphone at Rs 10,499 + Extra Exchange Value Up to Rs 3,000 Exclusively on Flipkart.

Facebook has struggled in the past to adequately identify hate speech or misleading information and in documents seen by Motherboard, Facebook's own training material incorrectly said that an image of the 2010 quake in Jeiegu, China was a picture of a Myanmar genocide.

Through Rosetta, Facebook is able to improve its image search as well as the systems that determine the types of images that may appear in your News Feed. Facebook, in particular, uses an army of moderators that help it weed out offensive content shared on the platform.

Nintendo Direct set for 9/13, will include Switch Online details
Ultimate, some more info about that new Yoshi game, and if you're feeling really lucky, an Animal Crossing Switch announcement. For $59.99, you get a pair with rechargable batteries that can attach to your Nintendo Switch to charge when not in use.

Because recognizing long words or long phrases can be especially challenging, the authors describe using what's called a "curriculum" approach to train the character recognition system.

After extracting the text, it uses its text recognition model that has been trained to understand the context of the text and the image together, to figure out if the particular video or meme is offensive in nature.

Rosetta is here to solve a problem that has plagued Facebook for quite some time.

Accused of not doing enough to unearth and block these risky accounts, the company went face to face with Congress last week to discuss content moderation policies and security practices to keep users safe.

In one recent instance, the tech titan admitted it had not acted quickly enough stop the spread of ethnic hate and violence across Myanmar. That includes both written posts and manipulated images.

Like this: