Freebies / Resources

Free technical SEO tool

Robots.txt Generator

Create a clean robots.txt file to help search engines understand what they can and cannot crawl on your website.

Generator settings

Generated robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /login/
Disallow: /cart/
Disallow: /checkout/
Disallow: /wp-admin/
Sitemap: https://example.com/sitemap.xml
robots.txt should not be used to hide sensitive information. It only gives crawl instructions to search engines and does not protect private pages.

Deployment guidance

Upload this file to the root of your website so it appears at https://example.com/robots.txt. After publishing, check the URL in your browser and submit the sitemap in Google Search Console.

Free Website Growth Review

Not sure whether your site is being crawled properly?

Uppercut Labs can review your technical SEO setup and check whether search engines can properly access, understand, and index your website.

Book a Free Website Growth Review

Related freebies

Keep improving the foundations.

View all resources

Free SEO Score Checker

Run a rules-based check across technical SEO, metadata, content and conversion signals.

Open resource

Website Performance Report

Check mobile speed, Core Web Vitals and PageSpeed opportunities.

Open resource

Local SEO Score

See whether your page sends clear location, service and contact signals.

Open resource