SEO Automation: What to Automate, What to Never Touch (2026)

The 200 Pages I’m Not Proud Of

In 2024, while I was still deep in Clickly — my URL shortener that never quite launched — I did something I still wince about. I wrote a script that generated 200 pages. “Best URL shortener for real estate agents.” “Best URL shortener for podcasters.” “Best URL shortener for etsy sellers.” You get it. Change one noun, keep the rest, ship 200 pages of near-identical mush overnight.

I told myself it was smart. Programmatic SEO. Scale. I’d seen the YouTube crowd bragging about it — whole channels competing over who could publish the most auto-generated articles, six million, seven million pages, all of it garbage. I wanted a slice.

They got indexed. For about three weeks I even had a couple ranking on page two. I felt like a genius.

Then Google did what Google does. A core update rolled through, and those pages didn’t just drop — they vanished. Deindexed. And because the same domain was hosting them, my real pages, the handful I’d actually written, took a hit too. I’d poisoned my own well to save myself an afternoon of writing.

That’s the whole reason I’m writing this post. Because “SEO automation” is two completely different things wearing the same jacket, and if you can’t tell them apart, you’ll do exactly what I did.

---

The Trap Hiding in the Word “Automation”

Here’s the thing nobody says out loud. SEO is maybe 80% boring mechanical work and 20% actual thinking. The boring 80% — checking for broken links, generating sitemaps, watching your rankings, making sure Google can crawl you — is tedious, repetitive, and rule-based. That’s exactly what machines are for. Automate all of it. Guilt-free.

The other 20% — deciding what to write, having an opinion, telling a story only you can tell — is the entire reason a page ranks in 2026. The moment you automate that, you become the slop Google is actively deleting.

So the rule for the whole post is simple: automate the mechanics, never automate the judgment. Let me show you where the line actually sits, tool by tool, cheaply.

(This is the automation angle. If you want the broader kit — keyword research, publishing, newsletters — I already wrote the content-marketing tools I actually use. This post assumes you’ve got that and want to stop doing the repetitive parts by hand.)

---

Automate the Boring: Technical SEO on Autopilot

Technical SEO is a checklist. Is the page reachable? Does it have a title? Is anything returning a 404? Are you accidentally telling Google not to index half your site? None of that needs a human, and none of it needs a subscription.

Crawl your own site on a schedule. Screaming Frog SEO Spider is the tool I reach for. The free version crawls up to 500 URLs with no time limit — it’s not a trial, it’s genuinely free forever under that cap. For most bootstrapped sites, 500 URLs is your entire site plus room to grow. It’ll flag broken links, redirect chains, missing meta descriptions, duplicate titles, and orphan pages in one pass. Paid is £199/year and removes the cap, but don’t pay until you’ve got thousands of pages and revenue.

If you’d rather not install anything, Ahrefs Webmaster Tools gives you a free Site Audit once you verify your domain — same idea, runs in the cloud, and you can schedule it to re-crawl weekly. (Their full suite is $129/month, which is absurd for a site with no traffic. The free audit is the only part you need right now.)

The automation move: run one of these on a weekly cron and have it email you only when something breaks. No dashboard to check, no daily ritual. You find out about the broken link before Google punishes you for it.

Sitemaps: set up once, forget forever. This whole blog runs on Astro, and Astro has an official sitemap integration — you add it once, and every time you build, a fresh sitemap.xml is generated automatically with every page on it. I have not thought about my sitemap in over a year. That’s what good automation feels like: you install it, then it becomes invisible. Whatever stack you’re on — Vercel, Next, whatever — there’s an equivalent. Wire it up and stop hand-editing XML like it’s 2011.

---

Rank Tracking Without the $99 Bill

Every SEO tool wants to sell you rank tracking. Semrush, Ahrefs, a dozen others — “track your keyword positions daily!” for $99+ a month. Here’s the part they’d rather you didn’t notice: the best rank tracker on earth is free, and it’s Google’s own.

Google Search Console tells you the exact average position of every query you’re already showing up for. Not an estimate scraped from a third-party database — Google telling you, directly, where it’s ranking you and how many impressions and clicks you got. That’s more accurate than anything Semrush can give you, because it’s the source.

The automation layer: Search Console has an API. You can pull your query data on a schedule into a spreadsheet, a PostHog dashboard, or just a tiny script that runs weekly and pings you when a page you care about moves up or down. I run a dumb little job on GitHub Actions that dumps my top queries every Monday morning. Cost: zero. It took an afternoon to set up and it’s replaced a tool people pay hundreds for.

Getting new pages found faster. When you publish, you want search engines to notice. There’s an open protocol called IndexNow that lets you ping search engines the second content changes — and it’s genuinely useful, but know the catch: Google doesn’t support it. As of 2026 Google still relies on its own crawl scheduling, your sitemap, and Search Console. IndexNow works for Bing, Yandex, Naver, and a few others. So it’s a nice-to-have for the non-Google engines (which increasingly feed AI search), but for Google, just keep your sitemap fresh and let it do its thing.

And no, you can’t shortcut Google with its Indexing API either. That API — documented over at Google Search Central — officially only works for two things: job postings and livestream video pages. Everyone who tells you to use it to “instantly index” your blog posts is either wrong or about to get their access revoked. Don’t build your workflow on a loophole Google will close.

---

Programmatic Pages: The Good Kind of Scale

Now here’s where it gets interesting, because I told you at the top that I burned myself on auto-generated pages — and yet programmatic SEO done right is one of the strongest plays a solo founder has. The difference is everything.

The 200 pages that got me nuked had no unique value. They were the same paragraph with a noun swapped. That’s the exact thing Google’s scaled content abuse policy targets — pages generated at scale mainly to manipulate rankings, with little or nothing new for the reader.

But a programmatic page built on real, unique data or a real utility is a completely different animal. This site has a tools directory — over 100 free calculators. Each one is a genuine page that does something: takes your input, computes an answer, saves you a trip to a spreadsheet. Google can tell the difference between 100 working calculators and 200 spun articles, because one of them actually helps the person who lands on it.

That’s the free-tools play from the distribution playbook, and it’s automation in the truest sense: you build the template and the logic once, and it generates hundreds of useful, indexable pages. A currency converter for every currency pair. A pricing calculator for every plan tier. A “days between two dates” tool. Each one is thin text but rich function — and function is value.

The test I use now: would this page be worth existing if search engines didn’t exist? A calculator someone actually uses — yes. A “best X for Y” article I mass-produced to catch a keyword — no. If the honest answer is no, don’t ship it. That single question would have saved 2024-me a lot of grief.

---

Internal Linking: Automate the Scaffolding, Not the Judgment

Internal links are how a blog compounds — every post pointing to the others, building a web that both readers and Google follow. On a site with 30 posts, wiring those by hand is tedious. On a site with 300, it’s impossible.

So automate the scaffolding. A “related posts” block at the bottom of each article, generated from tags or categories — pure mechanics, let the code do it. A script that flags orphan pages with no inbound links — great, run it weekly.

But the contextual link — the one dropped mid-sentence, in your own voice, because you genuinely think the reader wants that other thing right now — that’s judgment. A machine will happily stuff “click here” links into every paragraph and make your writing read like a robot wrote it. Don’t let it. I place those by hand, every time, because the anchor text and the placement are the quality signal. Tools like Zapier or n8n can glue your publishing pipeline together, but they can’t decide what’s genuinely relevant. That’s still your job, and it should be.

---

The Line You Never Cross

Let me be blunt, because it cost me to learn this. Never automate the writing.

I know the pitch. “Generate 100 SEO-optimized articles a month while you sleep.” It is the single most tempting shortcut in this entire business, and it is a trap with teeth. Google’s March 2026 core update explicitly went after scaled content abuse, and sites publishing hundreds or thousands of auto-generated pages without a human in the loop saw traffic drops of 50 to 80 percent. Not a penalty box you climb out of in a week — a slow, brutal decline. And in mid-2026 Google extended those same spam policies to cover its AI Overviews and AI Mode, so the machine-written slop doesn’t even get a second life in the AI answers.

Here’s the nuance people miss: Google does not ban AI. Using AI to help you draft, tighten a sentence, or check your grammar is fine. What gets you killed is publishing at scale with no genuine expertise, no editorial judgment, no reason for the page to exist beyond ranking. AI as an accelerator for a human who knows things — survives. AI as a replacement for having anything to say — deleted.

The thing that ranks in 2026 is the thing a machine can’t produce: a first-hand story, a number nobody else has, an actual opinion, a scar. I have exactly one competitive advantage over an AI content farm, and it’s that I paid the $90/month SaaS tax with $0 MRR and lived to write about it. No script can generate that. (The same fight shows up in the distribution playbook — SEO feels broken right now precisely because everyone automated their way into identical sameness.)

One honest post beats fifty generated ones. I’d rather publish once a month with something real to say than flood my domain with content I’d be embarrassed to put my name on.

---

The Bottom Line

SEO automation isn’t one thing. It’s a fork in the road, and both paths are labeled the same.

Down one path: you automate the boring, mechanical, rule-based stuff — the crawls, the sitemaps, the rank tracking, the technical checks, the genuinely useful programmatic pages. All of it cheap or free, all of it quietly humming in the background while you do the work that matters. That path buys you time.

Down the other: you automate the thinking. You let a script write your opinions for you, and you wake up to find you sound exactly like every other domain that did the same thing — right before Google buries all of you together. I walked a few steps down that path in 2024 with my 200 pages, felt the ground give way, and turned back. Learn from my scar instead of collecting your own.

Automate the grind. Guard the craft. That’s the whole guide. (And if you’re still assembling the rest of your growth stack on a shoestring, the content marketing tools post is the companion to this one, and the broke solopreneur’s survival guide is the bigger picture.)

This is the Broken Engineer Guide. I over-engineer everything, fail at business, and share the learnings so you can win. Now go automate the boring stuff — and write the thing only you can write.