#Rgb9000.net robots exclusion directive file #Revised February 2008 to allow indexing. User-agent: * Robot-version: 2.0 #Disallow: / #Private website. #Crawl-delay: 5 #one page every 5 seconds #Request-rate: 1/5 #Redundant in case bot can't understand first one. #Visit-time: 0600-0845