User-agent: * Allow: / Sitemap: https://www.itprotoday.com/sitemap.xml Sitemap: https://www.itprotoday.com/generic-content.xml Sitemap: https://www.itprotoday.com/article-content-formats-index.xml Sitemap: https://www.itprotoday.com/googlenews.xml Sitemap: https://www.itprotoday.com/news-archive-index.xml Sitemap: https://www.itprotoday.com/contributors.xml Sitemap: https://www.itprotoday.com/podcast-archive-index.xml Sitemap: https://www.itprotoday.com/webinar-archive-index.xml Sitemap: https://www.itprotoday.com/document-archive-index.xml Sitemap: https://www.itprotoday.com/event-archive-index.xml Sitemap: https://www.itprotoday.com/videos-archive-index.xml Sitemap: https://www.itprotoday.com/image-archive-index.xml Sitemap: https://www.itprotoday.com/sitemap-index.xml Disallow: /search Disallow: /recipe-portal/search Disallow: /api/health Disallow: /cdn-cgi/ User-agent: GPTBot Disallow: / Disallow: /live-preview/