@OberstKrueger if it wasn't corrected shortly after the fix, it probably won't be corrected, but missing posts can still be fetched by loading threads that they may have been a part of and pasting direct URLs into the search bar
mastodon administration, technical details
if you run mastodon on ubuntu or debian with jemalloc and you notice sidekiq crashing frequently, it may be related to this issue with FFI: https://github.com/mastodon/mastodon/issues/15751
the fix in our case was to add LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so to the systemd unit files, so that all native (non-ruby) code could use the same memory allocation system
and then suddenly its fine?? didnt get a response to my support ticket but i'll take it
@haskal digitalocean is definitely failing their SLA, but hetzner has been basically fine til now aside from an occasional short outage that kicked something of ours over. we are unfortunately getting what we're paying for, there, though.
well, this sucks
server slowness appears to be due to degraded disk performance on the host, following up with them to see if there's anything to be done about it
@TheGibson we seem to be good on memory and the sidekiq queues are empty, weirdly. current theory is it might be a slow db connection, possibly due to disk i/o
cybre.space users: this appears to be due to the cybre.space web server taking too long to respond and returning a 504 / timeout error. if you see this happen, it might mean the server is just processing slowly and will eventually submit the post! (looking into why it's taking so long, but this should help you avoid accidentally submitting duplicates in the meantime)
cybre.space users: our media provider is having an ongoing issue, so you've probably noticed some images not loading and some uploads not working today. incident page is here: https://status.digitalocean.com/incidents/hyclhcgjs16g
they identified the issue as of 4 hours ago, so hopefully it is resolved soon.
cool media's still fine here
@gargron i guess its just a simple delete forward, confused about why it generated so many jobs though, 2 million seems like a lot more inboxes than i'd expect to have to forward to
@gargron any clue why there would be hundreds of thousands of low priority delivery jobs of a Delete activity for a single status from someone else's server addressed to inboxes on various other servers
@venko the server should keep track of it, you can close the tab and come back later
i think it'll also email you when it's ready
admin of https://cybre.space.
dragon whomst do the software