I don't understand why a big company like Google can put some feature online if it's not thoroughly tested or thought. It is because it is a web product and it wants the users to be the testers?
Simple procedure: take a large sample (1M pictures or so), tag them with the system and then show each picture with the label to a person (using Mechanical Turk or similar) and ask "is this label offensive?"