#This is our robots.txt file to let robots know what files not to include in search engines #First we want to block docs folder so it does not get to protected docs User-agent: * Disallow: /docs/ #Next we want to block access to our RSS page User-agent: * Disallow: /rss/pdrma_rss.xml #Next we want to block access to images directory including subfolders User-agent: * Disallow: /images/ #Now going for some other root folders that we want to block User-agent: * Disallow: /exchange/ Disallow: /email/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /cg/ Disallow: /ip/ Disallow: /members/ Disallow: /style/ Disallow: /ws/