Summary: In May 2015, Google rolled out its "Google Photos" service. This service allowed users to store their images in Google's cloud and share them with other users. Unlike some other services, Google's photo service provided unlimited storage for photos under a certain resolution, making it an attractive replacement for other paid services.
Unfortunately, it soon became apparent the rollout may have outpaced internal quality control. The built-in auto-tagging system utilizing Google's AI began tagging Black people as "gorillas," resulting in backlash from users and critics who believed Google's algorithm was racist.
Google's immediate response was to apologize to users. The Twitter user who first noticed the tagging error was contacted directly by Google, which began tackling the problem that made it out of beta unnoticed. Google's Yonatan Zunger pointed out the shortcomings of AI when auto-tagging photos, noting the company's previous problems with mis-tagging people (of all races) as dogs and struggles with less-than-ideal lighting or low picture resolution. In fact, Google's rollout misstep mirrored Flickr's own struggles with auto-tagging photos, which similarly resulted in Black people being labeled as "ape" or "animal."
Decisions to be made by Google:
Questions and policy implications to consider:
Resolution: As of 2018, Google was still unable to completely eliminate this problem. Instead, it chose to eliminate the problematic tags themselves, resulting in no auto-tags for terms like "gorilla," "chimp," "chimpanzee," and "monkey." An investigation by Wired showed searches of Google Photos images returned zero results for these terms. Google said it was working on "longer-term fixes" but put no end date on when those fixes would arrive. It also acknowledged those terms had been blocked by Google and would remain blocked until the problem was solved.
Written by The Copia Institute, October 2020
We just sent you an email. Please click the link in the email to confirm your subscription!