it appears that the SEO optimum is "repeat common search terms but in natural language" and so now every google result for thing like "fix coil whine" or "toilet not filling" are FAQ style posts by domains you've never heard that are like:
How to fix coil whine?
...
What causes coil whine?
..
Can coil whine cause damage?
...
etc
the search situation is dire because sure "toilet not filling" doesn't tend to have misinformation, but if any schmuck can register a 4 dollar domain and get gpt2 to blast out some misinfo that the google algo loves and make bank on advertising (also sold by google) then how am I supposed to trust google when I ask it about things that tend to have common misconceptions or falsehoods like pest remedies or medical symptoms?
I wish archive.org got a full-book search engine like hathitrust
if we assume from now on that google can't source good info, it may be time to move to a "have a collection of reputable sites and use their internal search, or use site:domain"
before you suggest duckduckgo, I don't think their search quality is that much better. I think this is an issue affecting all search engines
maybe the right path is to use a search engine that lets you set a domain whitelist
a search engine that only searches wikipedia, hathitrust, archive.org, github.com, and maybe stack exchange. that would be hype. any other domains?
this is quite bad for net neutrality, unfortunately
@SuricrasiaOnline remembering the time when google let you remove certain domains from results for your account. was amazing. it's gone now, of course
Kagi and Neeva let you boost/demote/ban domains, but since the metasearch engines do not get detailed ranking info through search APIs this only happens on a per-page basis (i.e. a result can't move from page 2 to page 1 very easily). Both do have their own indexes too so that helps build custom ranking.
@Mojeek at one point planned on doing this the "right" way by actually using custom ranking algos (instead of modifying SERPs after they are generated with simple promote/demote rules) but that's Really Hard To Do so they shelved that for now.
@SuricrasiaOnline Yeah, for whatever reason search has gotten disastrous in the last five years and ... well, I have my suspicions why, but
@SuricrasiaOnline I feel like it doesn’t have to be, if it lets the user choose sources they want to use…?
Maybe it could allow rating quality of results for sources to help highlight good/new ones? Idk
@SuricrasiaOnline i know https://kagi.com is trying to be normal but i haven't used it enough to know
@catalina I like how I clicked "random websites" and got the main page for a tilde server populated by people I know
@SuricrasiaOnline oh hell yeah
@catalina @SuricrasiaOnline ha, I searched "how to fix a toilet" and got an art project I'd never heard of by a friend of mine about how people use search engines
@SuricrasiaOnline archwiki, tvtropes, etymonline, dict.org, something with all the man pages, memory alpha, emojipedia
@SuricrasiaOnline here u go: https://easrng.github.io/no-shit-sherlock/
it's a google custom search engine but i added some js before loading it that makes it so the ad script doesn't load even without adblock
it searches wikipedia, wiktionary, wikimedia commons, wikidata, all the SE sites, github, gitlab, sourcehut, codeberg, archive.org, hathitrust, project gutenberg, unsplash, and pexels for now
@SuricrasiaOnline ok i added a few more sites (MDN, css-tricks, old.reddit, emojipedia, dict.org, etymonline, emojipedia, arch wiki, debian.org)
@easrng @SuricrasiaOnline probably better to use a custom centrality algo (like custom pagerank) centered around a few certain sites you deem to be the “Ideal Archetype” of the content you want and then use huerestics to adjust the weight of a site. Huerestics could include:
How much Readability strips
How much uBlock Origin filters (Teclis.com does this)
Manual actions
JavaScript and tracker weight (Marginalia does this)
Structured data (FairSearch, Google, Bing, Yandex, and maybe Petal do this)
@SuricrasiaOnline I think searxng lets you do this
@SuricrasiaOnline DDG just uses Bing for search data, but the ! searches make it actually useful despite that.
@mdhughes what's ! searches?
@SuricrasiaOnline @mdhughes ddg calls it "bang syntax" and it just lets you query another search engine, often site-specific, through ddg. all it does is redirect you.
@SuricrasiaOnline @mdhughes it reminds me of the query shortcuts from krunner in kde3.5 except it's curated and in your browser instead of your desktop
@SuricrasiaOnline if anything, ddg is *worse* at seospam than google, i just can't stand giving google another bit of data so it's worth the sightly shittier results
@_ @SuricrasiaOnline the duck is pretty good at tech and and other "clinical" questions for me at least but with more organic and open ended questions really mess it up
@SuricrasiaOnline https://duckduckgo.com/bang
Welcome to the Internet power tools!
@mdhughes @SuricrasiaOnline at this point "!g to get different results" is so ingrained in my muscle memory I sometimes do it in google
@SuricrasiaOnline I kinda wonder if I should blame javascript for search being Bad now or if I'm being crazy. Many websites these days don't load much of a document at first and just give some script tags to load the rest through a JSON API. Web crawlers can't parse that, and even worse I've seen some sites have stopped using useful tags for links and instead implement everything through onclick events. More and more information is on closed apps like Facebook or Twitter, so it's mainly the SEO hackers hosting their own sites.
@SuricrasiaOnline just realized the formatting on my instance got rid of the "<a> tag" part lol
@SuricrasiaOnline yeah i wasn't gonna because _i_ use ddg and i get those weirdo results
and now i'm probably to reply to the next post and say "just use !bangs at that point"
@SuricrasiaOnline i don't think allow-list only for search is a good idea, but allowing users to block certain sites from showing up, or at least rate results as helpful / not helpful, would be pretty useful
@trwnh @SuricrasiaOnline you should try YACY, it allows you to do both (but the search is still eh)
@SuricrasiaOnline isnt the duck literally just bing trough some anonymizing?
@SuricrasiaOnline that's already become kind of a meme of people searching specific sites for good info
Stellar (not lewd)
@vulp @SuricrasiaOnline it’s like that image ai that got better when you added ‘unreal engine’
I think there is a need for a different kind of search engine, Google-style is fine for finding memes or info about something you do know at least a bit about but ultimately they're trying to rely on unverified data from the internet.
Another popular option is Common Crawl, which Alexandria used.
@SuricrasiaOnline What's the shortcoming with the "text contents" search option?
@noyovo I've never gotten it to work
@SuricrasiaOnline huh dang. we usually are searching for phrases in quotes or multiple words with each in quotes, maybe that's revelant - like: https://archive.org/details/texts?query=%22Omelette+du+fromage%22&sin=TXT
@noyovo ohhh weird. I was searching on this page: https://archive.org/details/books
I'll have to use this page from now on
@SuricrasiaOnline lol yeah they don't make it obvious tbh! but once you find it it's great. the homepage should be
https://archive.org/details/texts but also the top right search box should have it as an option for any page in that category. the "books" page might just mean stuff that's "officially" uploaded by an IA employee somewhere, which is a lot but far from all the text/docs/books on there
@SuricrasiaOnline you mean there weren't 17 separate lifestyle blogs that really reviewed products in $PRODUCT_CATEGORY last $($CURRENT_MONTH - 1)?
Just one generation. The prior generation was taught not to trust the internet at all, the subsequent one was taught not to trust anyone or anything.
@trysdyn
boomers - say they don't trust the internet but actually do
millennials - say they trust the internet but actually don't
zoomers - they are the internet
@SuricrasiaOnline Well, it's basic knowledge to never ever ask Google medical questions unless you know what to avoid and what to look for.
If you look up cancer treatment in german 80% of sites are about "alternative medicine", many even trying to tell you NOT to do chemo or radiotherapy but to smoke weed and eat amygdalin (poison) instead. It's ridiculous.
here's a hint. if you're on a page you found through google, ctrl+f for the phrase "Amazon Services LLC Associates Program"