User-agent: * Disallow: /_ Disallow: /priv Disallow: /Int Disallow: /iuser Disallow: *.csv Disallow: *.txt Disallow: /pdf Disallow: /data Disallow: /