Technical SEO focuses on the infrastructure and presentation that allow search engines and people to access a website. It includes crawlability, indexability, URL handling, internal architecture, rendering, structured data and performance.
Technical excellence does not compensate for unhelpful content, but technical barriers can prevent useful pages from being discovered. Work from verified evidence and test changes before deploying them widely.
Crawling and robots.txt
A robots.txt file gives compliant crawlers instructions about which paths they may request. It is not a reliable way to remove a URL from the index. Use an appropriate noindex control or access restriction when pages must not appear.
XML sitemaps
An XML sitemap lists canonical, indexable URLs that matter. Keep it accurate, use absolute URLs and update last-modified values only when content materially changes.
Canonicalisation and redirects
Use consistent preferred URLs, resolve HTTP/HTTPS and www/non-www variants, avoid redirect chains and ensure internal links point directly to canonical destinations.
Rendering and structured data
Important information should be available in crawlable HTML. Structured data should describe visible content accurately; markup does not guarantee a rich result or AI citation.
Performance and security
Use HTTPS, responsive layouts, stable page elements and sensible resource delivery. Review Core Web Vitals and real-user evidence, prioritising changes that improve the experience.
Related SEOLORE expertise
Where relevant, this topic can connect to strategy, implementation and measurement. Explore SEO & content, technical SEO and GEO and AI search.