#
#EXAMPLE METHOD #2 - EXCLUDE BY DIRECTORY
#
#Tip:  If you use this file as your template, remove all the comments
#      before uploading it.
#
#Tip #2:  To avoid potential discrimination, avoid naming your files 
#or directories where they include the name or initials of the 
#search engine.  Instead, use generic names like "Product1" or
#"Product2", etc. 
#
#This subsection will show how to disallow all pages from AltaVista,
#except for the MyAltaVistaDirectory/ which is not included in the 
#list of disallowed pages below.  AltaVista's agent name is called
#"Scooter".
#The idea below is to exclude all pages that do not apply to AltaVista.
#You would of course replace these directories with your own directory
# names.  
User-agent: Scooter
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow all pages from Infoseek/Go,
#except for the MyInfoseekDirectory/ which is not included in the list of
#disallowed directories below
User-agent: Infoseek
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow the Inktomi spider from all 
#directories below except your Inktomi directory.
#Therefore Hotbot, MSN, Goto, Snap, Looksmart, AOL Search and Iwon will 
#all have access to your Inktomi directory since they are Inktomi based
#engines.  That's why we suggest grouping all Inktomi engines under 
#one directory since its not required to put them in separate
#directories.
#We are not aware of a way to handle each Inktomi engine differently
#since they all depend on the same spider.  However, many times  
#a handful of well designed pages can get you ranked well in all 
#the Inktomi engines.
User-agent: Slurp
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow the Excite spider from all 
#directories below except your Excite directory.
#Therefore Excite and WebCrawler will both have access to your Excite
#directory since they are both Excite based engines.
#We are not aware of a way to handle Excite & WebCrawler differently
#since they all depend on the same spider.   
User-agent: ArchitextSpider
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow the Google spider from all 
#directories below except your Google directory.
#Therefore Google, Netscape, and Yahoo Web Pages will 
#all have access to your Google directory since they are Google based
#engines.
#We are not aware of a way to handle each Google engine differently
#since they all depend on the same spider.  However, many times  
#a handful of well designed pages can get you ranked well in all Google
#engines.
User-agent: Googlebot
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow all pages from Lycos, except
#for MyLycosDirectory/ which is not included in the list of disallowed
#directories below.
User-agent: Lycos
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyFastWebDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow all pages from Fast, except
#for MyFastWebDirectory/ which is not included in the list of disallowed
#directories below
User-agent: Fast
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyDirectHitDirectory/

#This subsection will show how to disallow all pages from DirectHit
#except for MyDirectHitDirectory/ which is not included in the list of #disallowed directories below
User-agent: Grabber
Disallow: /MyAltaVistaDirectory/
Disallow: /MyInfoseekDirectory/
Disallow: /MyInktomiDirectory/
Disallow: /MyExciteDirectory/
Disallow: /MyGoogleDirectory/
Disallow: /MyLycosDirectory/
Disallow: /MyFastDirectory/

            **Use your "Back" button**