User-agent: * Disallow: /bin/ Disallow: /config/ Disallow: /css/ Disallow: /radControls/ Disallow: /images/ Crawl-delay: 30 # number of seconds to wait between successive requests to the same server Request-rate: 1/15 # maximum rate is one page every 15 seconds Visit-time: 0500-1000 # only visit between 05:00 and 10:00 UTC (GMT) (00:00-05:00 EST/01:00-6:00 EDT)