FTC to Investigate Apple for Antitrust Issues
June 11, 2010Clash of Titans: Apple vs. Google
June 27, 2010Webmaster Level: All
We’d like to highlight three best practices that address some of the most common problems found when crawling and indexing video content. These best practices include ensuring your video URLs are crawlable, stating what countries your videos may be played in, and that if your videos are removed, you clearly indicate this state to search engines.
- Best Practice 1: Verify your video URLs are crawlable: check your robots.txt
- Sometimes publishers unknowingly include video URLs in their Sitemap that are robots.txt disallowed. Please make sure your robots.txt file isn’t blocking any of the URLs specified in your Sitemap. This includes URLs for the:
- Playpage
- Content and player
- Thumbnail
- Sometimes publishers unknowingly include video URLs in their Sitemap that are robots.txt disallowed. Please make sure your robots.txt file isn’t blocking any of the URLs specified in your Sitemap. This includes URLs for the:
- Best Practice 2: Tell us what countries the video may be played in
- Is your video only available in some locales? The optional attribute “restriction” has recently been added (documentation at http://www.google.com/support/webmasters/bin/answer.py?answer=80472), which you can use to tell us whether the video can only be played in certain territories. Using this tag, you have the option of either including a list of all countries where it can be played, or just telling us the countries where it can’t be played. If your videos can be played everywhere, then you don’t need to include this.
- Best Practice 3: Indicate clearly when videos are removed — protect the user experience
- Sometimes publishers take videos down but don’t signal to search engines that they’ve done so. This can result in the search engine’s index not accurately reflecting content of the web. Then when users click on a search result, they’re taken to a page either indicating that the video doesn’t exist, or to a different video. Users find this experience dissatisfying. Although we have mechanisms to detect when search results are no longer available, we strongly encourage following community standards.
To signal that a video has been removed,
- Return a 404 (Not found) HTTP response code, you can still return a helpful page to be displayed to your users. Check out these guidelines for creating useful 404 pages.
- Indicate expiration dates for each video listed in a Video Sitemap (use the <video:expiration_date> element) or mRSS feed (<dcterms:valid> tag) submitted to Google.
- Sometimes publishers take videos down but don’t signal to search engines that they’ve done so. This can result in the search engine’s index not accurately reflecting content of the web. Then when users click on a search result, they’re taken to a page either indicating that the video doesn’t exist, or to a different video. Users find this experience dissatisfying. Although we have mechanisms to detect when search results are no longer available, we strongly encourage following community standards.
For more information on Google Videos please visit our Help Center, and to post questions and search answers check out our Help Forum.