Disallow particular extension in robots.txt file for web crawlers

From Notes_Wiki

Home > Internet tips and tricks > Disallow particular extension in robots.txt file for web crawlers

To disable crawling of ogv (video) files which anyway cannot be indexed use:

   User-agent: *
   Disallow: /*.ogv$
   Allow: /

Refer: http://tools.seobook.com/robots-txt/

Home > Internet tips and tricks > Disallow particular extension in robots.txt file for web crawlers

Retrieved from "http://www.sbarjatiya.com/notes_wiki/index.php?title=Disallow_particular_extension_in_robots.txt_file_for_web_crawlers&oldid=5974"