User-agent:AhrefsBot Disallow: / User-agent:MJ12bot Disallow: / User-agent:Gigabot Disallow: / User-agent:CazoodleBot Disallow: / User-agent:* Allow:/