Skip to main content
← Back to feed
Official announcementCloudflare BlogRyan Skidmore

Cutting our inference bill by 68% by being obsessive about optimization

Cutting our inference bill by 68% by being obsessive about optimization

From the official release

When we previously blogged about our AI code reviewer in April, an average review cost a palatable $1.19. By the end of August, that figure had shot up to about $2.46. We hadn't made any significant architectural changes: the coordinator was still handing work to the same set of specialist reviewers, and the same risk tiers decided how intensive of a review we gave.

Around mid-September we tasked our agents with working out where those tokens were going and cutting them — aggressively. With code quality at high effort, the average review now costs just $0.77, down 68% from the $2.43 it averaged over our two most expensive weeks before we started. Our main goal was to cut costs, but as part of this work we also managed to optimize the reviewer, so that the median review now takes just 1m 32s instead of the 4m 09s it took before.

This is a short excerpt. Read the full announcement on the official source.

Continue on blog.cloudflare.com → (opens in a new window)
How HP Is Building an AI-Ready CDP with Databricks CustomerLake
Official announcement

How HP Is Building an AI-Ready CDP with Databricks CustomerLake

Databricks Blog

At Data + AI Summit 2026, Luis Alonso, Global Head of Data Strategy & Engineering...

What makes a catalog open? Unity Catalog Advances the Open Lakehouse
Official announcement

What makes a catalog open? Unity Catalog Advances the Open Lakehouse

Databricks Blog

While almost every platform now supports open formats, what makes a catalog truly...

How to get the most out of running dbt on Databricks
Official announcement

How to get the most out of running dbt on Databricks

Databricks Blog

Tens of thousands of organizations rely on dbt for data transformation. Where you...

Accelerating Mamba-2 with High-Performance Forward Pass Kernels in NVIDIA CUDA Tile
Official announcement

Accelerating Mamba-2 with High-Performance Forward Pass Kernels in NVIDIA CUDA Tile

NVIDIA Developer Blog

NVIDIA CUDA Tile (cuTile) is a Python-based DSL and parallel programming model for NVIDIA GPUs that automatically leverages advanced hardware capabilities to... NVIDIA CUDA Tile (cuTile) is a Python-based DSL and parallel programming model for NVIDIA GPUs that automatically lever

Snowflake Decision Fast: Low-Latency AI Decision Models
Official announcement

Snowflake Decision Fast: Low-Latency AI Decision Models

Snowflake Blog

Just two weeks ago, we introduced Snowflake Decision in Cortex AI Functions in private preview. Built specifically for classification, scoring, filtering and routing, it tackles high-volume tasks with bounded answers. Instead of open-ended text, it returns a typed answer, such as

Amazon CloudWatch Omni is now available in additional AWS Regions
Official announcement

Amazon CloudWatch Omni is now available in additional AWS Regions

AWS What’s New

AWS announces that Amazon CloudWatch Omni is now available in eight additional AWS Regions. CloudWatch Omni is an AI-powered observability experience, organized around your teams and the applications they run, that helps you observe and troubleshoot your applications and agents i