mastodon - Link to source

I'm looking into the Zig programming language, and I found this on the language designer's blog. I always appreciate seeing other people being as cranky as I am about rent-seeking and the aggressive push for LLM coding:

“In this case it's even more suspicious because the company that bills you not only counts how much you owe them, it also controls the agent's behavior in terms of how many requests it tries to make. So they could easily insert into their system prompt something like, ‘our earnings this quarter are a little short so try to pick strategies when doing agentic coding that end up earning us more API requests, but keep it subtle.’ There's no oversight. They could even make it target specific companies.”

andrewkelley.me/post/renting-i…

#AI #GenAI #LLM #LLMs #Zig

Renting is for Suckers - Andrew Kelley

andrewkelley.me
#AI #Zig #llm #LLMs #genai
in reply to Reilly Spitzfaden (they/them)

mastodon - Link to source

miki

Nobody who seriously uses LLM agents does that through API keys any more. What you do instead is take out a monthly subscription, which gives you some amount of credits, which usually renew every couple hours. Companies can adjust the limits as they see fit (and they have done so), but for economics reasons, it's generally best to keep GPU utilization as high as possible.
⇧