User-agent: * Disallow: /24-live-blog/ User-agent: Twitterbot Disallow: