~1 million Creative Commons images on 500px.com are dissapearing tomorrow!
If you have the resources please install the Archiveteam's Warrior program and select the 500px project! https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior
irc is #500pieces on efnet
thank you (boosts very appreciated)
@eq THAT SUCKS SO MUCH WHAT THE HECK
LB context: #500px is removing the ability to upload, download, or search for #CreativeCommons licensed images, with basically no warning. Follow the instructions provided by @eq if you can: https://cybre.space/@eq/100290879824956894
@eq thanks for the heads up! got one of my pooputers to help
@eq I think I have 500 GB of spare bandwidth to contribute.
@eq Looks like mine is getting 429 (too many requests) response codes.
Should I just sit tight?
@eq Aha, it’s intermittently working now. 🤘
@elomatreb @val @mkb welcome to capitalism
@elomatreb @eq @mkb It keeps happening. $company say they'll remove the contnt, ArchiveTeam downloads it, $company whines about archivists.
Last time it was Soundcloud
@eq i have set up a machine to help out. 👍 💪
@eq wait what? My pictures are on 500px using CC. Do you have a link?
@eq https://pexels.com may be happy to have them. Just be aware most of the images there are CC0 (Creative Commons Zero) and therefore can be for any use and no attribution required.
@TheOuterLinux i think the archiveteam will be able to handle distribution of the items already. the main problem is the actual archival lol
@eq Well, I've owned a website before and it shouldn't be too hard for them to just backup their own data base files and figure it out later, wether they're self hosting or paying someone else. Owning a website is getting to be a pain for little traffic. I've learned it's much better to get a .io static website or repository from places like GitHub or GitLab and then you have SSL and pretty more storage than you'll ever really need, all for free. You can self host GitLab too.
@TheOuterLinux yes, but 500px isn't archiving the thing. they're just shutting it down without warning.
If they wanted to continue hosting the content, they would. They don't, so that's what the archiveteam is for
@eq And then you can just use software like Bluegriffon to manage it. Git add ., git commit -m '...', git push, done.
@TheOuterLinux why are you explaining git to me? i know how git works. what does that have to do with this
@eq @TheOuterLinux lol this is the most fossbro shit I've ever seen.
@eq can I run the warrior on a VPS?
@eq can I run the warrior (or at least the script) on my phone?
@SoniEx2 i would ask the IRC but i doubt it
@eq can I run this behind a CGN?
@eq
I just turned my 4 warriors with 4 concurrent items each to the 500px project. Hope we get it in time.
What a bunch of suckers.
@luricaun I believe right now doing 1 concurrent item per warrior might be more efficient because of rate limiting.
@eq
Thanks for the advice. I was wondering if there is a way to speed things up. Any suggestions? I will lower the concurrent items for now then.
@luricaun Well, the ratelimiting is around 1 request per second per IP, so you should run each warrior on its own IP if you aren't already. Basically at this point that's all you can do, I think.
@eq Unfortunately I'm running those puppies at home and I don't have IPv6 yet. So there is no chance to serve from different IPs for me.
Anyhow thanks for the tip and let's safe a little piece of the web, shall we?
@luricaun Unfortunately even if you did, apparently this site doesn't have an ipv6 address to use.
Thank you for setting the warrior up!
@eq Thanks for the notification. It's running on my side to do my part and save all these CC images…
That's not very nice. Ahrem. Yeah, not very nice.
@AmauryPi thank you :)
@eq yo what? why?