← All research

The Data Center Gold Rush Ends When We Stop Trying to Prompt Our Way to Savings

Billions are going into compute on the bet that prompts can replace expertise. Our tests cut one AI step's cost 96.7% by engineering it instead. Here's how.

The enterprise AI market is betting billions on the idea that enough compute and enough prompts can stand in for skilled people. In our own testing, the savings came from the opposite direction: when we engineered one judging step instead of prompting harder, its cost fell 96.7% and it gave the same answer more often. The short version: you don't save money by throwing tokens at a process. You save it by writing the process in code and paying a model only for the steps that need one.

Prefer the numbers at a glance? See the Stop Prompting and Start Engineering (Part 2) infographic.

The AI Data Center Gold Rush

Right now, the enterprise AI market is caught in a capital-expenditure frenzy. Billions are pouring into data centers on the premise that if we just throw enough compute, tokens and massive "Skill Vaults" at a problem, we can flatten skilled human expertise into a folder of reusable prompts.

That gold rush has a hard expiration date. It ends the moment companies realize you cannot prompt your way to real savings, operational consistency or a competitive moat.

Scroll through your feed and you'll see the current silver bullet: libraries promising to bottle an entire consulting firm's methodology into 150 Claude or GPT skills. It looks great in a carousel graphic. In production, it's an expensive slot machine. (We took the skill vaults apart in Why a Library of 150 AI Skills Won't Save Your Enterprise Workflows.)

Why Prompting Your Way to AI Cost Savings Fails in Production

When companies try to replace engineering discipline with prompt libraries and LLM-mediated tool loops, they don't eliminate labor. They shift it into babysitting probabilistic outputs. Whether you are injecting static prompt folders or routing every step through Model Context Protocol (MCP) servers, every round-trip is still mediated by the LLM. The model still has to read tool schemas, decide what to do next and digest raw payloads, and you pay for every token of it.

That shows up on the bill in three ways:

When you try to reduce skilled talent to generic prompts, you get generic, fragile outputs, and you burn data center compute doing work that ordinary software solved decades ago.

Where the Savings Actually Came From

Our business process engine is a coded workflow graph built on LangGraph. Code decides the order of the steps and the model only makes bounded calls inside them. In our 135-step graph, 122 steps run as code with zero generative tokens, more than 80% of the workflow. Only 13 call a model.

Then we went after the cost of those 13. We rebuilt one judging step: one keyword per call instead of 350, a pinned prompt with 72 labeled examples, strict JSON checked by code, and about 93% of the prompt read from cache. We ran the same 1,000 keywords twice on three Claude tiers (full results in Part 2):

Model on the rebuilt stepCost per 1,000 keywordsSame answer twice
The old graph step (350 keywords per batch)Not priced87.7%
Opus 5.5$6.9399.1%
Sonnet 5.5$3.47 (49.9% less)97.9%
Haiku 5.5$0.23 (96.7% less)96.1%

Every engineered tier beat the old step's repeatability, and the cheapest model was within three points of the most expensive one. That is the savings the gold rush is chasing, and it didn't come from more compute. It came from engineering what goes into each call. We still check the cheaper models' answers against hand-judged ground truth before we choose one for production.

Engineers Building Products, Not Prompt Folders

If every company in your vertical downloads the same 150-skill prompt vault, nobody has an edge. Competitive advantage comes from taking what makes a company genuinely unique and encoding that domain expertise into deterministic, repeatable software.

At Pressfit.ai, we are engineers at heart who build products. We aren't selling magic prompt folders. We are taking this deterministic graph architecture into industries we have lived and built in for years: ad measurement, ad agencies and SEO.

In those spaces, precision isn't optional. You can't afford an LLM hallucinating attribution math, drifting off a client's brand architecture during a multi-step SEO audit, or failing silently halfway through an agency deliverable. By combining deep domain engineering with bounded, deterministic AI workflows, we're building tools that set a new operational standard, and we're sharing our research openly so teams in every industry can get off the "prompt your way to savings" treadmill.

The future of enterprise AI belongs to builders who use engineers to amplify unique human expertise, not flatten it into a chat window. When we build for determined outcomes, compute waste drops, failed jobs recover automatically, and AI finally delivers on its promise.

See it applied to your own search and AI visibility: get your Playbook.

FAQ

Can prompt libraries cut AI costs?+

Not reliably. Prompt-driven runs in our 70-step test swung 3.4 times in token use on the same job, from 1.7 million to 5.7 million tokens. Engineering the workflow in code gave a flat, predictable band instead.

How do you reduce LLM costs in production?+

Run every step that can be code as code, and engineer the remaining model calls: one item per call, pinned examples, strict JSON checks and prompt caching. On our rebuilt judging step, that let Haiku 5.5 run at $0.23 per 1,000 keywords, 96.7% less than Opus 5.5.

Do you need a frontier model to run AI workflows?+

Not when code sets the path. On our rebuilt step, Sonnet 5.5 gave the same answer twice 97.9% of the time at half the cost of Opus 5.5. We still check cheaper models against hand-judged answers before choosing one.

What share of an enterprise AI workflow needs an LLM?+

Far less than most teams assume. In our 135-step graph, only 13 steps call a model; 122 run as code with zero generative tokens.

The Research Behind This Post

Need help putting it to work? Get in touch, or email our team at redevteam@pressfit.ai.

The numbers at a glance

Open the infographic full screen · The full research report · AI Infra in Graphics · The Graph Workflow Starter Kit

Originally published on Pressfit.ai.