Skip to content
Searchpedia SEO field notes Callum Bennett Callum

Site ops

Technische SEO Analyse

A technische seo analyse should start with crawlability, not performance metrics — most indexation problems hide in plain sight.

Beginner3 min readUpdated 2026-07-27Notes by Callum Bennett

Start here

  • Audit your robots.txt file first – a single disallow directive can block entire sections from Googlebot.
  • Compare the number of URLs in your sitemap with the indexed count in Google Search Console – a large gap means indexation problems.
  • Run a crawl with Screaming Frog or Sitebulb and check for 4xx status codes, redirect chains, and missing meta robots tags.
  • Check Core Web Vitals for your top landing pages using PageSpeed Insights or the Chrome User Experience Report.
  • Set up log file analysis to understand how Googlebot actually spends its crawl budget on your server.

Plain-English take

A technische seo analyse is not a content audit. It is a check of the plumbing: whether search engines can find your pages, crawl them without errors, and decide to put them in the index. I often see people dive straight into keyword gaps or backlinks, when the real problem is a [robots.txt](/robots-txt/) that blocks half the site or a sitemap that returns 404s. For example, a client once had 10,000 product pages but only 1,500 indexed. The cause? A misconfigured [canonical tag](/canonical-tag/) pointing to an old domain. Fixing that took an hour and recovered 5,000 URLs. The best tool for starting is Google Search Console’s Index Coverage report. That shows you, in numbers, how many URLs are valid, excluded, or errored. If the 'excluded' count is high, you have a technical problem. A proper analysis covers crawlability, indexability, and performance. Crawlability means can Googlebot reach the page? Check robots.txt, noindex tags, and server errors. Indexability means should Google put it in the index? Check canonical tags, duplicate content, and structured data. Performance involves loading speed, mobile responsiveness, and [Core Web Vitals](/core-web-vitals/). Do not confuse a fast site with a crawlable one. I have seen sites that load in under a second but have 80% of pages blocked. Prioritise crawlability over speed. Use a crawler to get a baseline, then compare that with Search Console data. The difference between what the crawler found and what Google indexed tells you where the blockage is.

When it actually matters

A technische seo analyse matters most after a site migration, before launching a new site, or when you notice a sudden drop in organic traffic. It also matters when you add a large number of new pages, change your CMS, or implement a new JavaScript framework. Many teams skip it because 'the site works fine'. But a site can look perfect in a browser and be invisible to Google. For instance, I worked with a site that migrated from HTTP to HTTPS but forgot to update the internal links. Half the pages were still pointing to HTTP versions, causing redirect chains and lost link equity. Another common trigger is when a redesign introduces infinite scroll without proper pagination. Googlebot cannot scroll, so content below the fold never gets indexed unless you use proper JavaScript rendering or [pagination](/pagination/). Counter-argument: Some SEOs run technical analyses too frequently, treating it as a monthly ritual even when nothing has changed. I think you should run it when you make a change to the infrastructure, not on a calendar. The exception is Core Web Vitals: because Google updates its criteria periodically, a quarterly performance check makes sense. In practice, I do a full [technical SEO](/technical-seo/) crawl every time I onboard a new client, and then only after significant site changes. The rest of the time, I monitor Search Console daily for new errors. That catches issues faster than any scheduled [SEO audit](/seo-audit/).

What I got wrong

For years I treated a technische seo analyse as a one-off checklist: run a crawler, fix the 404s, redirect the broken links, done. I thought if the crawl report was green, the site was healthy. What I missed was the difference between crawling and indexing. A crawler can find a URL perfectly fine, but if Google decides not to index it for quality reasons, the crawler report shows no error. I learned this the hard way when a client's blog section had 200 articles, all crawlable, but only 30 indexed. The issue was thin content – but the crawler did not flag it. Now I always compare crawl data with Search Console’s index coverage. Another mistake: I ignored log files. I thought they were for server administrators, not SEOs. Then I discovered that Googlebot was crawling the same 10 pages every day and ignoring 90% of the site. Log files showed that the crawl budget was being wasted on parameterised URLs. I now consider log file analysis essential for any site with over 10,000 pages. A third error: I used to prioritise mobile speed above all else. I chased a perfect Lighthouse score while pages had noindex tags or broken sitemaps. Speed matters, but not if the page is not in the index. My current rule: fix indexation first, then crawl efficiency, then performance. Speed is the polish, not the foundation.

Next step

Quick answers

What tools do I need for a technische seo analyse?

You need a crawler like Screaming Frog or Sitebulb, access to Google Search Console, a log file analyser (or a hosting tool that provides logs), and a performance tool like PageSpeed Insights. That is minimal. I also use a custom script to compare crawl data with Search Console index counts.

How long does a full technical SEO analysis take?

For a small site under 1,000 pages, about 4-6 hours including manual checks. For a larger site with 50,000 pages, expect 2-3 days. The crawl itself is fast, but interpreting the data and verifying hypotheses takes time.

Should I fix every technical issue I find?

No. Prioritise issues that block indexation or waste crawl budget. A 404 on a page that no one links to has low impact. A misconfigured canonical that deindexes 1,000 pages is critical. Use the Search Console 'Not indexed' report to decide where to start.

Sources

Primary documentation is linked directly. Anything commercial is marked nofollow.

Notes from Callum Bennett.