See you on the other side!
So the update is done, but the bot was offline for 6 hours, and needed to catch up.
Unfortunately, another update slipped through, which switched the default feed from www.reddit.com
to old.reddit.com
, which has the side effect of changing all the urls in the posts as well. On one hand this is great, because new reddit sucks. On the other hand, this is terrible, because for every post the bot encounters, it checks if it already exists on lemmit… based on the url.
So for every post the bot encountered, it went like “old.reddit.com/r/blabla/123
? Haven’t seen that one yet, there’s an www.reddit.com/r/blabla/123
, but that must be something completely different, let’s post it again!”
This also meant that the bot took over a minute and a half to update each community because it takes a couple of second per post. When I went to bed last night, I figured it was just posting a lot of content because it had so much catching up to do. But this morning I figured something was off because it still hadn’t caught up.
Anyway, the fix is out now. Sorry for all the duplicates. I need coffee now.
That took a bit longer than expected, but the good news is that we survived the upgrade to 18.1, and managed to migrate the image storage to a (cheap knock-off) S3 bucked.
Any performance issues and disk space shortage will forever be a thing of the past! *knocks on wood*
The Lemmy upgrade itself went pretty smooth. Now it’s just waiting for the update for pict-rs to finish, so that it can use S3 storage instead of local disk. Until then, no new posts.
deleted by creator