# /robots.txt file for http://www.godbdigital.com/ User-Agent: Baiduspider Disallow: / User-Agent: Twiceler Disallow: / User-Agent: MSRBOT Disallow: / User-Agent: Charlotte Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: Yeti Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: GurujiBot Disallow: / User-agent: Yandex Disallow: / User-agent: heritrix Disallow: / User-agent: Jyxobot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: SBIder Disallow: / User-agent: BDFetch Disallow: / User-agent: Sensis Disallow: / User-agent: BecomeBot Disallow: / User-agent: noxtrumbot Disallow: / User-agent: RufusBot Disallow: / User-agent: voyager Disallow: / User-agent: Exabot Disallow: / User-agent: SearchDaimon.com-dc Disallow: / User-agent: YaCy Disallow: / User-agent: Spock Crawler Disallow: /