Friendica
daniel:// stenberg://
daniel:// stenberg://

daniel:// stenberg://

bagder@mastodon.social

daniel:// stenberg://

bagder@mastodon.social
I write curl. I don't know anything.
ActivityPub
2025-11-09 02:39:24 2025-11-04 13:38:44 2025-11-04 13:38:39 9108939

daniel:// stenberg://
daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

2 weeks ago • •

daniel:// stenberg://

2 weeks ago • •


Total bandwidth spend on the website curl.se over the last 30 days? 71.94 TB

Distributed over an average of 3.44K requests per second.

  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

Stefan Eissing
mastodon - Link to source

Stefan Eissing

in reply to daniel:// stenberg:// • 2 weeks ago • •
madness
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

synlogic4242
mastodon - Link to source

synlogic4242

in reply to daniel:// stenberg:// • 2 weeks ago • •
now compare to goat.se!
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

Jonathan Yu
mastodon - Link to source

Jonathan Yu

in reply to daniel:// stenberg:// • 2 weeks ago • •
Do you have a breakdown by user agent? How much traffic is curl downloading curl?
  •  Languages
  •  Search Text
  •  Share via ...
in reply to Jonathan Yu

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to Jonathan Yu • 2 weeks ago • •
@jawnsy I don't have that. I only have some rough accumulated numbers that fastly offers in their admin interface.
@Jonathan Yu
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

Falko
mastodon - Link to source

Falko

in reply to daniel:// stenberg:// • 2 weeks ago • •
Guesstimate: 98% AI scraper?
  •  Languages
  •  Search Text
  •  Share via ...
in reply to Falko

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to Falko • 2 weeks ago • •
@AstroBoar that's basically what we all assume, but I don't know this for sure since I have no logs!
@Falko
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to daniel:// stenberg:// • 2 weeks ago • •
#Fastly takes about 99.59% of that bandwidth.
#fastly
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

Geert Uytterhoeven
mastodon - Link to source

Geert Uytterhoeven

in reply to daniel:// stenberg:// • 2 weeks ago • •
That happens when you have a few billion users ;-)
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

JP Mens
mastodon - Link to source

JP Mens

in reply to daniel:// stenberg:// • 2 weeks ago • •
crazy
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to daniel:// stenberg:// • 2 weeks ago • •

As a comparison, in September 2014 the curl website served 236GB.

A 300 times bandwidth growth in 11 years.

  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

crazyeddie
mastodon - Link to source

crazyeddie

in reply to daniel:// stenberg:// • 2 weeks ago • •
Are you able to estimate how much of that is probably human vs. bot?
  •  Languages
  •  Search Text
  •  Share via ...
in reply to crazyeddie

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to crazyeddie • 2 weeks ago • •
@crazyeddie as far as I can assess, it looks like a vast majority of this is automated/bot traffic. It's too much 301 responses and HTTP/1 for what browsers would generate.
@crazyeddie
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

Wolf480pl
mastodon - Link to source

Wolf480pl

in reply to daniel:// stenberg:// • 2 weeks ago • •
is there a spike around the time LLMs became a thing?
  •  Languages
  •  Search Text
  •  Share via ...
in reply to Wolf480pl

daniel:// stenberg://
mastodon - Link to source

daniel:// stenberg://

in reply to Wolf480pl • 2 weeks ago • •
@wolf480pl I've never detected a steep trsunami rise, only an ever increasing growth
@Wolf480pl
  •  Languages
  •  Search Text
  •  Share via ...
in reply to daniel:// stenberg://

pancake
mastodon - Link to source

pancake

in reply to daniel:// stenberg:// • 1 week ago • •
how many of those using the curl useragent?
  •  Languages
  •  Search Text
  •  Share via ...
⇧