User-Agent: * Disallow: /category/ Disallow: /wp- Disallow: /cgi-bin/ Disallow: /tag/ Disallow: /page/ # Disallow parsing feeds trackbacks Disallow: */feed/ Disallow: */trackback/ Disallow: /rss/ # Disallow all files ending with these extensions Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$