# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /AssetAddEdit.aspx Disallow: /AssetDelete.aspx Disallow: /AssetEdit.aspx Disallow: /DateTime.ascx Disallow: /Default.aspx Disallow: /DefaultLayout.aspx Disallow: /FinanceAddEditInvoiceRecord.aspx Disallow: /FinanceSelectInvoiceRecord.aspx Disallow: /LoggedInView.ascx Disallow: /LoggedOutView.ascx Disallow: /Logon.aspx Disallow: /PathViewer.ascx Disallow: /Q1Maintenance.aspx Disallow: /Q1Search.ascx Disallow: /Q1Style.css Disallow: /UserAddEdit.aspx Disallow: /UserAddEditSelect.aspx Disallow: /UserCompanySelect.aspx Disallow: /web.config Disallow: /Web.sitemap Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /images/ Disallow: /media_tour/ Disallow: /test/