Introduction About Site Map

XML
RSS 2 Feed RSS 2 Feed
Navigation

Main Page | Blog Index

Wednesday, November 18th, 2026, 6:31 am

Almost a Million

When bots identify as humans (in user-agent strings)

A day ago I said we had likely broken (or set) a record in Techrights. A day later, yesterday, it was another record (929,170 Web requests, almost a million), but I am told many of the requests are for old pages, so they’re quite likely bots.

Stress-testing the site for capacity, however, is good fun. It shows it can cope with quite a lot without any slowdowns. It also shows it’s well positioned against the slop scourge; it has become very hard to tell apart bots from humans because Serial Plagiarists (sloppers) are as dishonest about what user-agent they use as they are about the ethics of their modus operandi.

This generally means “blocking bots” or “blocking only bad bots” sounds nice in theory; in practice you end up blocking many legitimate visitors.

Technical Notes About Comments

Comments may include corrections, additions, citations, expressions of consent or even disagreements. They should preferably remain on topic.

Moderation: All genuine comments will be added. If your comment does not appear immediately (a rarity), it awaits moderation as it contained a sensitive word or a URI.

Trackbacks: The URI to TrackBack this entry is:

https://schestowitz.com/Weblog/archives/2026/11/18/almost-a-million/trackback/

Syndication: RSS feed for comments on this post RSS 2

    See also: What are feeds?, Local Feeds

Comments format: Line and paragraph breaks are automatic, E-mail address never displayed, HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Back to top

Retrieval statistics: 21 queries taking a total of 0.072 seconds • Please report low bandwidth using the feedback form
Original styles created by Ian Main (all acknowledgements) • PHP scripts and styles later modified by Roy Schestowitz • Help yourself to a GPL'd copy
|— Proudly powered by W o r d P r e s s — based on a heavily-hacked version 1.2.1 (Mingus) installation —|