READ INSTRUCTIONS CAREFULLY: These ratings use newly updated ads rating guidelines that are different from earlier versions of the guidelines. If you have not read the guidelines since the version date listed above, you must carefully read or review all instructions before rating.
For this task, you will be evaluating YouTube video ads for content inappropriateness. These video ads could be either in-stream video ads shown inside the video player or the videos that YouTube users are taken to when they click on advertisements on YouTube main pages.
(1) Error / Did Not Load
If the video on the Landing Page does not load, select the “Error / Did Not Load” flag.
(2) Wrong Language Flag
Do NOT select “Wrong Language” even if the language in the video is different from the language specified in the task. Do your best to evaluate the video based on the video title, description, image or text in the video. Only select this flag if you don’t completely understand the content of the video at all.
For example, if the video is made in a language that you don’t understand, but the video contains nudity, drug or violence content, you should still rate the video based on your understanding.
Step 1: Understand Video Ads Inappropriate Content
First, click on the “YouTube Video Ad” button to be taken to the YouTube video page. Next, imagine that is the video ad you will be shown on YouTube, watch the video and also pay attention to its title and description.
Note: You should watch the entire video and pay attention to any inappropriate content that appears in the video.
Feel free to fast forward and scan around in the video while you are evaluating its content. If you see an ad before the actual video starts, please ignore / skip that ad.
What should be considered for video inappropriateness:
- video content
- video title
- video description
DO NOT READ THE VIDEO’S COMMENTS
Provide your rating for the overall video ad inappropriateness and also check corresponding inappropriateness flags if content in the video, the title or description of that video contains any of the inappropriate categories described below, or if it contains any other offensive, disrespectful or controversial content. You may select all items that apply.
Step 2: How to determine the overall inappropriateness of video ads
A video ad is not inappropriate if it is merely uninteresting or unlikely to have broad appeal to users. For example, if a video looks uninteresting or irrelevant to you, it does not automatically make it inappropriate. To be inappropriate, a video must have some content that fits into at least one of the following categories.
Note: this is an overview of each category and more examples can be found in Step 3
|Mentally Distressing / Body Parts||Repulsive, gross, scary, distressing content related to injuries, death & decay. Videos related to fat loss or health conditions/focusing on unhealthy body parts are also considered disturbing, including but not limited to:Topics include weight loss, hair loss, menstrual cycles, skin conditions, mental disorders, etc. The ad overly emphasizes body parts (e.g. zoomed in on belly fat or butt, including animated content) or bodily symptoms (e.g. fluids and rashes)Medical/Dental surgery procedures (including human and animal) that show blood, guts, gore, bodily fluids or tooth decay.Funerals that show people weeping, mourning or screaming.Videos designed to be scary or invoke fear, enforcement applies to simulated or real content.Accidents/natural disaster e.g., vehicle accidents from dashcam.|
|Sex / Nudity / Suggestive||Full or excessive partial nudity or suggestive content with the intent to arouse or titillate viewers (content of swimwear or spa is typically OK if mainly focuses on appeal and is NOT suggestive).|
|Violence||Graphic or gruesome content and images that may shock, disturb, or disgust viewers (video game or action movie violence is typically OK, if NOT very gory), including but not limited to:News footage that shows violent protests, terrorism or death in a war.Dangerous actions that could potentially result in harm and should not to be imitated, such as dangerous challenges.Dramatized or animated content that is excessively gory or realistic.|
|Recreational drugs||Growing of, use of, promotion and / or sale of recreational drugs, including:Marijuana, weed, cannabis, cocaine, crystal meth, heroin and other narcotics.|
|Counterfeit Goods / Clickbait||Clickbait: Having false claims related to money/overnight success, curing diseases or anything that may seem misleading/unreasonable or too good to be trueHacking/Unlocking instructions that enable a user to gain unauthorized access (or make unauthorized changes) to systems, devices, property, phones, webcams or credit card|
|Inappropriate Language||Language or slang that are offensive or may provoke anger.Derogatory language that incites hatred against, promotes discrimination of, or disparages an individual or group on the basis of their race or ethnic origin, religion, disability, age, nationality, veteran status, sexual orientation, gender, or other characteristic that is associated with systemic discrimination.|
|Other potentially Inappropriate content||Other possibly inappropriate issues that do not fit into the aforementioned categories.|
The overall inappropriateness rating depends on how offensive the inappropriate content is. The video should be marked as inappropriate even if the inappropriate content is short compared to the entire video.
|Appropriate||The video is completely fine, it is not at all inappropriate, and it does not contain any content that belongs to any category mentioned above.|
|Slightly Inappropriate||The video is borderline. It contains images or text that are slightly suggestive, violent or mentally distressing, but would not offend or shock too many people.|
|Moderately Inappropriate||The video contains more inappropriate content than the borderline. The video contains much nudity or is obviously suggestive, overly focuses on unhealthy body parts (e.g., belly fat, butt or hair loss even if it is animated) or more mentally distressing or violent. The video is not suitable for the general audience.|
|Extremely Inappropriate||The video shows content of recreational drugs, contains more nudity or very suggestive content, overly zooms in on unhealthy body parts (e.g., belly fat, butt or hair loss), or show too much violence or mentally distressing content. The video is not suitable for most of the audience.|
Videos can be inappropriate for many different reasons (clickbait, racy, violent, etc). It is possible to find problematic content due to multiple reasons, but it’s important to think about the video as a whole. Use the examples below to help you make a decision. These will also be available within the task. If a video happens to have aspects that relate to more than one issues (e.g. clickbait and racy), apply the rating which in your opinion is WORSE. For example, if you think a video is only slightly clickbait but much more racy, then use a higher rating like Extremely Inappropriate.
- Base your rating only on the video, title and description within this task. Do not do any extra research, do not consider comments left on the video.
- Remember, a video is not inappropriate if it is merely poorly made, or unlikely to have broad appeal.
- Do your best to rate according to your experience as long as you have enough information to rate, even if for videos that seem not targeted to your location or contain language different from the language specified in the task.
Step 3: Examples of inappropriate content
Please watch the corresponding video example by clicking the link below each image, to have a better understanding of inappropriate content.
Once you’ve answered all the questions shown, click “Submit” to complete the task and acquire the next one.
If you have questions about this project that are not answered by the instructions above, please review the Rater Hub first, which contains additional content about rating. If you encounter a technical problem with this rating task, use the “Report A Problem” link in the lower-right hand corner of the rating page.