The I in LLM stands for intelligence
On how people now use AI to submit security reports on #curl.
daniel.haxx.se/blog/2024/01/02…
The I in LLM stands for intelligence
On how people now use AI to submit security reports on #curl.
daniel.haxx.se/blog/2024/01/02…
gnu/m43
in reply to daniel:// stenberg:// • • •this is insignificant but
> In this particular report, the user helpfully told us that they used Bard to find this issue. Bard being the Microsoft/Bing generative AI thing
bard was google's creation, not microsofts
daniel:// stenberg://
in reply to gnu/m43 • • •manchicken moved!
in reply to daniel:// stenberg:// • • •It's really disappointing how much AI-generated crap is out there. Do you think folks actually expect you to pay for these trash findings? Also, have you seen any examples of findings reported with AI that _weren't_ trash?
I can think of some things where AI could help accelerate things, but it seems limited presently. I could imagine someone writing a bot which trolls the dark web and submits findings for employee credentials found, or something like that.
daniel:// stenberg://
in reply to manchicken moved! • • •manchicken moved!
in reply to daniel:// stenberg:// • • •Winni Neessen
in reply to daniel:// stenberg:// • • •Henri
in reply to daniel:// stenberg:// • • •Gwenn Boussard
in reply to daniel:// stenberg:// • • •Nicely said!
Jeff Graham
in reply to daniel:// stenberg:// • • •thanks for sharing your perspective and experience. Unfortunately, "like for the email spammers, the cost of this ends up in the receiving end" really captures the situation quite well.
Hopefully it also forces some to reflect that tech without adequate guardrails and protections is certainly not the democratizing force they may wish it was, especially due to labor and power imbalances.
Edwin Young
in reply to daniel:// stenberg:// • • •I hope this is not the beginning of a flood. This Science Fiction magazine had to stop accepting submissions because they started getting so many bad stories "written" by LLMs:
clarkesworldmagazine.com/clark…
In both cases the tool has made it cheaper to create spam submissions and made the job of the editor/maintainer harder.
Clarkesworld Magazine - Science Fiction & Fantasy
Clarkesworld Magazinedaniel:// stenberg://
in reply to daniel:// stenberg:// • • •AI generated security reports about curl | Hacker News
news.ycombinator.comMagnus Runesson
in reply to daniel:// stenberg:// • • •buherator
in reply to daniel:// stenberg:// • • •"Sometimes reporters use AIs or other tools to help them phrase themselves or translate what they want to say."
English education in my country (Hungary) is shit, and my biggest contribution to the local community arguably was to provide opportunities to discuss IT-security in our native tongue. I also find this a huge mistake, creating a local bubble and disincentivizing people from learning to communicate internationally.
So while I greatly admire your intentions here, as a non-native speaker my opinion is that this approach is counter-productive from the reporters standpoint. Also, LLM's are not translator programs, and they hide semantic translation errors just as easily as technical non-sense.
Based on this I think banning LLMs altogether would be a reasonable choice.
Once again, thanks for your work and the great post!
daniel:// stenberg://
in reply to buherator • • •Edbro
in reply to daniel:// stenberg:// • • •madsen
in reply to daniel:// stenberg:// • • •Incredibly frustrating to deal with, I can imagine.
Interesting how dinesh_b's English skills almost completely disappeared when he explained why he was addressing h1_analyst_oscar, and then he became much more fluent when going back to talking about the alleged vulnerability.