Read the latest posts - ”A deeper look at AI crawlers： breaking down traffic by purpose and industry”

News from the Cloudflare Blog:

Thursday, August 28, 2025

A deeper look at AI crawlers: breaking down traffic by purpose and industry

We are extending AI-related insights on Cloudflare Radar with new industry-focused data and a breakdown of bot traffic by purpose, such as training or user action.

By David Belson

Read More

Thursday, August 28, 2025

Evaluating image segmentation models for background removal for Images

An inside look at how the Images team compared dichotomous image segmentation models to identify and isolate subjects in an image from the background.

By Deanna Lam

Read More

Thursday, August 28, 2025

The age of agents: cryptographically recognizing agent traffic

Cloudflare now lets websites and bot creators use Web Bot Auth to segment agents from verified bots, making it easier for customers to allow or disallow the many types of user and partner directed.

By Jin-Hee Lee

Read More

Thursday, August 28, 2025

Make Your Website Conversational for People and Agents with NLWeb and AutoRAG

With NLWeb, an open project by Microsoft, and Cloudflare AutoRAG, conversational search is now a one-click setup for your website.

By Catarina Pires Mota

Read More

Thursday, August 28, 2025

The next step for content creators in working with AI bots: Introducing AI Crawl Control

Cloudflare launches AI Crawl Control (formerly AI Audit) and introduces easily customizable 402 HTTP responses.

By Will Allen

Read More

Copyright © 2025 Cloudflare, Inc. 101 Townsend Street, San Francisco, CA 94107 www.cloudflare.com | Community | Unsubscrib