@venko it would probably take a while normally but it might be worse than normal because there's some job backlog right now
@violet @haskal @nightpool
long story short is in 3.3 we're now seeing posts with missing images because mastodon is handling errors from the media store, whereas before it would have forced the remote server to retry.
the real solution would be to reduce our error rate from our media store, but a temporary solution is to immediately retry media store if they fail. i'll try that and see if that helps.
@violet @haskal @nightpool i think the problem's down to this commit: https://github.com/tootsuite/mastodon/commit/1045549f85041b13002801808b30a332c3a68c61#diff-9a8cecdf35c00c53c513bfa0592c8631e8369038cccdc16794aee6107d2418abR2551 (which is new in mastodon 3.3). i added some logging to cybrespace to confirm we're hitting the case on line 255
if our storage backend errors out while we're caching a remote image, it'll hit this Seahorse::Client::NetworkingError, which will cause it to just give up on fetching the image.
before 3.3, it would have thrown all the way up to where the request came in, which would probably have resulted in the remote server seeing a 500 error from us and failing to deliver the post. it then would have gone into retry logic and probably come in successfully a few minutes later.
@violet @nightpool not sure if its correlated with the update, but this usually means that at the time cybre.space received the post, it couldnt cache the media, either due to a problem with our media backend or the remote server’s copy of it being unavailable. not much we can do about this unless it turns out it was an issue with mastodon not fetching stuff correctly or something, i’m afraid
@niconiconi should be back up now, i'll try to work out why it's going down and see if i can stabilize it
Question about #OrishaLand. Can any of you find a single article about it that isn't written by a cop when you search online? Very concerned about this, given that it's gotten a lot more attention from fascists, including local police, in the last few days. Can someone who's not fascist write about it? Can people work on a wikipedia page or something?
A group of Black revolutionaries have started an autonomous zone named #OrishaLand in #Austin, #Texas. They've already done a lot to fight #gentrification by organizing material support & political education for the local Black community. It's a real glimmer of hope for what has otherwise been a shitty #BlackHistoryMonth.
For more about their recent efforts:
On social media:
cybre.space is now on mastodon 3.3! there were quite a few changes since 3.1, you can read about them here:
there are a few known issues in the cybre.space fork, which i did not have time to address tonight, but should get to by the end of the week. please feel free to ping @ me or create new issues if you see anything else wrong after the update:
okay after some, uh, brief jankiness due to a dependency needing an update, we should be fully back now
admin of https://cybre.space.
dragon whomst do the software