iceshrimp.net - Link to source
Am I finally done with these horrible, no good, verry bad #lemmy performance issues? I think I might be. Lemmy federation requires a lot more...everything...than does Mastodon style microblogging. People vote constantly. Posts and comments are longer. Everything has multiple images. And by default lemmy wants to cache everything all the time forever.
#lemmy
in reply to Lemmy Brasil

iceshrimp.net - Link to source

🇨🇦Samuel Proulx🇨🇦

@brasil@rimu No, it’s a hundred percent Lemmy. A database that’s over 1 tb because old federated posts never get cleared won’t be fast no matter what you do. Lemmy has no built in tools to clear this. It’s also really bad at clearing the pict-rs thumbnail cache. I don’t block crawlers, I just rate limit anyone who hits the server too often, no matter who or what they are. The Internet shouldn’t become a walled garden; as long as you’re not consuming more than your fair share of resources, you don’t need to prove your identity for access.
@Rimu @Lemmy Brasil
in reply to 🇨🇦Samuel Proulx🇨🇦

mastodon - Link to source

Lemmy Brasil

The Internet shouldn’t become a walled garden; as long as you’re not consuming more than your fair share of resources, you don’t need to prove your identity for access.

Unfortunately that boat is gone. I also love the OG internet, before the block my server would delivery about 50 TB dayli. Now it sits about 10 GB.

Lemmy does have automatic postgres maintenance, that's odd that you have 1TB database. Since when does your server is federating? Which instance is that you run?

in reply to 🇨🇦Samuel Proulx🇨🇦

mastodon - Link to source

Lemmy Brasil

Oh! so you run rblind, that's awesome. I am sorry for the problems you are having with Lemmy, I wish that wasn't the case. I admire your work very much, since way before getting in touch with you here.

I see you tried some solutions, in that case if you really can't get Lemmy to properly work, I head of instances that migrated to Piefed. @rimu can help with that, should not be hard, Lemmy clears the signature cache every week or so, IIRC

btw, sorry if I mistype something english is

@Rimu
in reply to Lemmy Brasil

iceshrimp.net - Link to source

🇨🇦Samuel Proulx🇨🇦

@brasil@rimu So there are some big reasons we can't move to piefed. First, there's no migration path that I can find documented anywhere to move user accounts, local posts, etc. Second, a lot of our users depend on apps that they find more accessible, like Thunder. Piefed doesn't have a Lemmy compatible API. Third, last I checked, Piefed really assumes you're just using Cloudflare and AWS. The AWS Console isn't accessible, and cloudflare presents inaccessible captchas, so neither of those are options for us.
@Rimu @Lemmy Brasil
in reply to 🇨🇦Samuel Proulx🇨🇦

mastodon - Link to source

Lemmy Brasil

I didn't know about the AWS/Cloudflare part. I think Piefed was going to or is in the way of implementing Lemmy API in order to be fully compatible with the already established apps. I am talking from memory though, I might be wrong.

About moving the posts, I guess that's a no for any ActivityPub platform I've heard so far.

Maybe it is not solvable now, but could be in a near future.

in reply to 🇨🇦Samuel Proulx🇨🇦

mastodon - Link to source

Rimu

Yes, you're right about the lack of migration path.

On your other points though - everything has improved a lot - Thunder has PieFed support (as do most other Lemmy apps) and Cloudflare is now very optional. See this blog post for more on that: join.piefed.social/2025/11/22/…

AWS can be used for email but any SMTP server can be used also and AFAIK most instances just use plain SMTP.


Reducing PieFed's dependence on Cloudflare - PieFed

When Cloudflare had problems recently pretty much every PieFed instance went offline. This was a real “wtf are we doing” moment, for me.
piefedadmin (PieFed)
in reply to Rimu

iceshrimp.net - Link to source

🇨🇦Samuel Proulx🇨🇦

@rimu@brasil For now, I've gotten my Lymmy cleanup scripts doing things properly, and I've brought the server load down from 36.7 to around 5.4 on an 8 core box. And I thought AWS was required by piefed for images. Lemmy uses pict-rs and that can handle storage on the local filesystem, until I find a provider of object storage that's actually accessible and not evil (I'm not holding my breath).
@Rimu @Lemmy Brasil
in reply to Lemmy Brasil

iceshrimp.net - Link to source

🇨🇦Samuel Proulx🇨🇦

@brasil@rimu And far, far more of my traffic comes from federation than from any bots. If your traffic blocked that much, I suspect your filters are preventing other servers from federating correctly. Remember that every upvote or downvote on any post anywhere is a federation event that your server needs to receive, in order to keep the vote counts up to date. So if you have even tens of active users you should be getting sometimes a hundred of these per second. Then there's stuff like LiveThreadBot, that edits posts when socur games are going on, updating them with every single play.
@Rimu @Lemmy Brasil
⇧