ai

Your ads have an audience. Does it have a pulse?

51Degrees

Wednesday, September 16, 2026 9:00:00 AM

Your ads have an audience. Does it have a pulse?

Autonomous AI agents browse in real browsers, on real devices, from real addresses. Here is how to tell whether a human is involved.

There is now a third kind of visitor, and it fits neither box. Autonomous AI agents drive genuine Chrome, on genuine laptops, over genuine residential connections, so nothing in the request is fake and every check you already run passes. HumanConfidence reads eight device and network signals in one call and returns High, Medium, or Low, with the recipe published so you can check the working yourself.

Naver's robots and crawlers

51Degrees

Tuesday, July 28, 2026 1:30:00 PM

Naver's robots and crawlers

Research into Naver's approach to scraping web content

This blog explains how Naver’s web crawlers, including Yeti, Ads-Naver, and Blueno, interact with website content. It outlines their different roles, the crawler usage values assigned to each, and how they affect content visibility across Naver’s search and services.

DuckDuckGo's Robots and Crawlers

51Degrees

Tuesday, June 16, 2026 1:30:00 PM

DuckDuckGo's Robots and Crawlers

Research into DuckDuckGo's approach to scraping web content

This blog explains how DuckDuckGo’s web crawlers, including DuckDuckBot and DuckAssistBot, interact with website content. It outlines their different roles, how they follow robots.txt directives, and the management of crawler access and content visibility.

Apple Web Crawler

51Degrees

Monday, March 30, 2026 5:30:00 PM

Apple Web Crawler

How Applebot and Apple crawlers shape visibility across Apple’s ecosystem

This blog explains how Apple’s web crawlers, including Applebot and Applebot-Extended, work across its ecosystem to surface content in Siri, Spotlight, and Safari. It outlines the different crawlers, their purposes—such as search indexing, feed updates, and AI training—and how enabling them can improve content visibility, traffic, and control over how content is used, particularly in generative AI.

Perplexity's robots and crawlers

51Degrees

Tuesday, March 3, 2026 5:30:00 PM

Perplexity's robots and crawlers

Research into Perplexity's approach to scraping web content

Find out how we classify Perplexity's AI web crawlers.

Meta's robots and crawlers

51Degrees

Friday, February 13, 2026 5:30:00 PM

Meta's robots and crawlers

Research into Meta's approach to scraping web content

Find out how we classify Meta's crawlers and AI content scrapers.

AI Is Eating the Content World. Now What?

51Degrees

Wednesday, January 28, 2026 5:45:00 PM

AI Is Eating the Content World. Now What?

3rd March 2026 | Recording

In this one-hour session, James will cover:

  • How AI is reshaping content distribution and consumption
  • The real risks - and the overlooked opportunities - for publishers
  • Practical steps content creators and media businesses can take today to protect their business
  • What "survival" actually looks like in an AI-driven content economy

If you work in publishing, media, or content, this session is built for you. You'll leave with a clear, practical playbook - and a better chance of staying relevant.