User-agent: *

User-agent: BingPreview
Crawl-delay: 1