~1 million Creative Commons images on 500px.com are dissapearing tomorrow!
If you have the resources please install the Archiveteam's Warrior program and select the 500px project! https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior
irc is #500pieces on efnet
thank you (boosts very appreciated)
@TheOuterLinux i think the archiveteam will be able to handle distribution of the items already. the main problem is the actual archival lol
@eq Well, I've owned a website before and it shouldn't be too hard for them to just backup their own data base files and figure it out later, wether they're self hosting or paying someone else. Owning a website is getting to be a pain for little traffic. I've learned it's much better to get a .io static website or repository from places like GitHub or GitLab and then you have SSL and pretty more storage than you'll ever really need, all for free. You can self host GitLab too.
@TheOuterLinux yes, but 500px isn't archiving the thing. they're just shutting it down without warning.
If they wanted to continue hosting the content, they would. They don't, so that's what the archiveteam is for
@eq And then you can just use software like Bluegriffon to manage it. Git add ., git commit -m '...', git push, done.
@TheOuterLinux why are you explaining git to me? i know how git works. what does that have to do with this
I just turned my 4 warriors with 4 concurrent items each to the 500px project. Hope we get it in time.
What a bunch of suckers.
@luricaun I believe right now doing 1 concurrent item per warrior might be more efficient because of rate limiting.
Thanks for the advice. I was wondering if there is a way to speed things up. Any suggestions? I will lower the concurrent items for now then.
@luricaun Well, the ratelimiting is around 1 request per second per IP, so you should run each warrior on its own IP if you aren't already. Basically at this point that's all you can do, I think.
@eq Unfortunately I'm running those puppies at home and I don't have IPv6 yet. So there is no chance to serve from different IPs for me.
Anyhow thanks for the tip and let's safe a little piece of the web, shall we?
@luricaun Unfortunately even if you did, apparently this site doesn't have an ipv6 address to use.
Thank you for setting the warrior up!
@eq Thanks for the notification. It's running on my side to do my part and save all these CC images…
That's not very nice. Ahrem. Yeah, not very nice.
ｃｙｂｒｅｓｐａｃｅ: the social hub of the information superhighway
jack in to the mastodon fediverse today and surf the dataflow through our cybrepunk, slightly glitchy web portal