User-agent: * disallow: /Category/ disallow: /forum/ Disallow: /profile/ Disallow: /cgi-bin/ Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.cgi$ Disallow: /*.xhtml$ Disallow: /*.php* Disallow: /*?* Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$