#AgreeWorks.com- There is a space after the : #basically everything is disallowed after a /. /xxx/ disallows everyting in and under the directory. #a record starts with "User-agent" and ends at the first blank line. #Everybody has their own standarts. #If it is not on this list, it is allowed User-agent: Slurp Disallow: /Admin/ Disallow: /AppNotes/ Disallow: /BRepCon/ Disallow: /Contracts/ Disallow: /CustAcct/ Disallow: /DiscCon/ Disallow: /ErrorPages/ Disallow: /Forms/ Disallow: /FRCon/ Disallow: /Help/ Disallow: /Images/ Disallow: /LeaseCon/ Disallow: /ResCon/ Disallow: /ResList/ Disallow: /Transmit/ User-agent: Googlebot Disallow: /Admin/ Disallow: /AppNotes/ Disallow: /BRepCon/ Disallow: /Contracts/ Disallow: /CustAcct/ Disallow: /DiscCon/ Disallow: /ErrorPages/ Disallow: /Forms/ Disallow: /FRCon/ Disallow: /Help/ Disallow: /Images/ Disallow: /LeaseCon/ Disallow: /ResCon/ Disallow: /ResList/ Disallow: /Transmit/ User-agent: Teoma Disallow: /Admin/ Disallow: /AppNotes/ Disallow: /BRepCon/ Disallow: /Contracts/ Disallow: /CustAcct/ Disallow: /DiscCon/ Disallow: /ErrorPages/ Disallow: /Forms/ Disallow: /FRCon/ Disallow: /Help/ Disallow: /Images/ Disallow: /LeaseCon/ Disallow: /ResCon/ Disallow: /ResList/ Disallow: /Transmit/ User-agent: msnbot Disallow: /Admin/ Disallow: /AppNotes/ Disallow: /BRepCon/ Disallow: /Contracts/ Disallow: /CustAcct/ Disallow: /DiscCon/ Disallow: /ErrorPages/ Disallow: /Forms/ Disallow: /FRCon/ Disallow: /Help/ Disallow: /Images/ Disallow: /LeaseCon/ Disallow: /ResCon/ Disallow: /ResList/ Disallow: /Transmit/ User-agent: * #Keeps all the rest out. Disallow: /