I suspect that this is the direct result of AI generated content just overwhelming any real content.
I tried ddg, google, bing, quant, and none of them really help me find information I want these days.
Perplexity seems to work but I don’t like the idea of AI giving me “facts” since they are mostly based on other AI posts
ETA: someone suggested SearXNG and after using it a bit it seems to be much better compared to ddg and the rest.
they’re pretty bad, but ddg at least feels like I’m getting actual results.
Yeah DDG is great. The only thing I find is its not good at local results but a quick !g on the end gets me the local results im looking for.
Redirects your search to Google. You can put it anywhere in the search; for example !g how do i shot web, how do i shot web !g and how do i !g shot web will all land you into Google.
There are other 13k (yup) bangs like this. Wikipedia, Wiktionary, Yahoo, Quora, most gaming wikis, etc. A few sites (like Google and Bing) have multiple bangs, that land you directly into a specific page (e.g. !bv searches Bing videos). More info here.
oh, good tip. I didn’t know about that.
you tack !g to the end of whatever the resulting search URL is?
Can be anywhere in the search.
“cute dogs !g” “!g cute dogs” “cute !g dogs”
Those all work the same, though clearly one is more cursed than the others. They have those for a bunch of other sites as well, for example if you want to search YouTube specifically/directly you can use !yt but I can’t kick the habit of just going to those sites first and then searching directly on there.
is it? that kind of makes sense, because I still use Bing occasionally while Google is completely out of rotation, although I don’t find Bing as good as duckduckgo.
edit: it is not! looks like the DuckDuckGo search engine is an aggregate of hundreds of search engines, including their own duck duck bot, excluding Google but including some Bing results.
Their FAQ hems and haws about that, but (in the past) I’ve done side-by-side tests and found identical results. Maybe something’s changed, maybe it hasn’t.
I prefer DDG, but I hate the news search. 90% of the results are paywalled.
Oh, and sometimes the image search will return a pile of porn for a seemingly clean search request. I once searched for “R34 Skyline” expecting Nissans, and got VERY different results without safe search.
News orgs clinging to tradition.
i use archive.is for anything I really want to read.
most news is fluffy bullshit anyway.
It’s just that Bing/DDG seem to promote news from these sites as if they’re sponsored links… but without the disclosure.
R34 is also short for rule 34 - “if it exists, there’s porn of it on the internet”
So if you search R34 and anything, you’ll get porn.
Every search engine I’ve encountered is weird about porn. At first it decides whether or not you’re looking for porn or not looking for porn. If it assumes you are then all the actual porn hits are promoted to the top, where non-porn hits are down-ranked. Vice versa, if it decides you’re not looking for porn.
Once of the fun search engine games is to find out what sets of ambiguous words trigger the porn flag. Pure tended to be one due to a brand name, even when I was looking for pure minerals at the time. Siri created some conflicts, since there’s both a well known LLM digital assistant, rule 34 for the same and a popular porn star.
I’d really like a search engine that let porn sites fall in the hit list without deciding first whether I was trying to look for porn, since I sometimes do metasearching.
DDG often gives me results for individual words of the search but not results for all of the words in that order for which to have contextually relevant results.
I often find myself forced to brave the shitshow that is google search.
have you tried the duck assist thing yet?
If you’re trying to talk to the search engine more like a chat assistant, that sort of response might be what you’re looking for.
Fuck Duck Assist all my homies hate Duck Assist and I keep having to turn it back off again.
Whoever made it should get cancer and not have their children show up or call them back.
I’m very happy with kagi at the moment. Just crossed one year using it as my main search engine last week and don’t see why I would go back.
Having to signup and login to a search engines sounds like an annoying hassle
Signing up and logging in isn’t a problem imo. I wouldn’t even mind if I had to pay for searches, but I’m not going to make it a subscription service. Unless they add an option to do something like buy 1000 searches that never expire, its not something I’d considered. I do think they beat out competitors like google with their results pretty consistently though based on the trial.
I’m not gonna subscription my heated car seats but search is a service that costs an ongoing amount to provide. The subscription isn’t significant, it’s $5 a month for 300 searches (or $10 for unlimited).
I know we’ve been conditioned to expect search for free, but if we want to get away from the “the user is the product” model then I think it’s a good thing to have a subscription to a service that has ongoing costs to provide.
It’s a very minor annoyance and well worth it in my opinion.
I was searching for a book quote for over a year. I tried every search engine, tried changing the terms, checking back several times every few weeks or so, but couldn’t find anything even close. I tried kagi and it was literally the very first result on my very first search.
I haven’t looked back and have never had an issue finding what I’m searching for since.
Same. Using Kagi feels like surfing the old web. The first thing I did was block all Pinterest results. That alone made every search golden. 😂
You’re not the only one. They have a leaderboard and the top 7 results are various Pinterest domains.
Leaderboard here for anyone curious
Yep everyone blocking Pinterest.
Also the most prioritized website is Wikipedia. Guess everyone wants facts in the the age of hallucinatory AI
I don’t remember any specifics, but I think I heard there were some privacy concerns?
Then again, there seem to be privacy concerns about pretty much anything so might not be that bad…
Never heard any issues with Privacy, but I’ve heard issues about them using Brave search Results as part of their results.
The concerns are about the credit card you use to pay.
The argument is that they can associate the card with your searches.
As far as I know they don’t keep search data. I’m personally happy with them
Is it really $108/year good though for a single person (based on the tier that makes sense for me)? Just curious what other search engines you’ve used or tried and what features set it apart to make it worth spending the money on.
That really depends on your use case and how valuable web search is for your daily life.
I’ve personally tried Google, Bing, DDG, Brave search, and ChatGPT. Kagi is consistently able to find what I’m searching for more quickly and accurately than anything else, which has been very valuable for me in my personal and professional life.
It’s easily worth the cost in result quality and time saving for me personally, but that doesn’t mean the same will apply to you or anyone else.
As far as stand out features, there aren’t really any that I can think of. It just gives me the results I’m looking for without any bullshit to wade through.
I don’t use perplexity, but AI is generally 60-80% effective with a larger than average open weights off line model running on your own hardware.
DDG offers the ability to use some of these. I use a modified Mistral model still, even though its base model(s) are Llama 2. Llama 3 can be better in some respects but it has terrible alignment bias. The primary entity in the underlying model structure is idiotic in alignment strength and incapable of reason with edge cases like creative writing for SciFi futurism. The alignment bleeds over. If you get on DDG and use the Anthropic Mixtral 8×7b, it is pretty good. The thing with models is to not talk to them like humans. Everything must be explicitly described. Humans make a lot of implied context in general where we assume people understand what we are talking about. Talking to an AI is like appearing in court before a judge; every word matters. The LLM is basically a reflection of all of human language too. If the majority of humans are wrong about something, so is the AI.
If you ask something simple like just a question, you’re not going to get very far into what the model knows. Models have very limited scope of focus. If you do not build prompt momentum into the space by describing a lot of details, the scope of focus is large but the depth is shallow. The more you build up momentum by describing what you are asking in detail, the more it narrows the scope and deeper connections can be made.
It is hard to tell what a model really knows unless you can observe the perplexity output. This is more advanced, but the perplexity score for each generated token is how you infer that the model does not know something.
Search sucks because it is a monopoly. There are only 2 relevant web crawlers m$ and the goo. All search queries go through these either directly or indirectly. No search provider is deterministic any more. Your results are uniquely packaged to manipulate you. They are also obfuscated to block others from using them for training better or competitive models. Then there is the anti trust US government case and all of that which makes obfuscating one’s market position to push people onto other platforms temporarily, their best path forward. - criminal manipulators are going to manipulate.
I think it’s just you. Differential Transformers are pretty good at regurgitating information that’s widely talked about. They fall short when it comes to specific information on niche subjects, but generally that’s only a matter of understanding the jargon needed to plug into a search engine to find what you’re looking for. Paired with uBlock Origin, it’s all typically pretty straight forward, so long as you know which to use in which circumstance.
Almost always, I can plug some error for an OS into a LLM and get specific instructions on how to resolve it.
Additionally if you understand and learn how to use a model that can parse your own set of user-data, it’s easy to feed in documentation to make it subject-specific and get better results.
Honestly, I think the older generation who fail to embrace and learn how to use this tool will be left in the dust, as confused as the pensioners who don’t know how to write an email.
Stable Diffusors are pretty good at regurgitating information that’s widely talked about.
Stable Diffusion is an image generator. You probably meant a language model.
And no, it’s not just OP. This shit has been going on for a while well before LLMs were deployed. Cue to the old “reddit” trick that some people used.
Also, they’re pretty good at regurgitating bullshit. Like the famous ‘glue on pizza’ answer.
Or, in a deeper aspect: they’re pretty good at regurgitating what we interpret as bullshit. They simply don’t care about truth value of the statements at all.
That’s part of the problem - you can’t prevent them from doing it, it’s like trying to drain the ocean with a small bucket. They shouldn’t be used as a direct source of info for anything that you won’t check afterwards; at least in kitnaht’s use case if the LLM is bullshitting it should be obvious, but go past that and you’ll have a hard time.
I asked Google why search engines are so bad now and its AI summaries its own deficiencies quite well:
Some say search engines have declined in quality due to a number of factors, including:
Search engine optimization (SEO) spam A wave of SEO spam has contributed to the decline in search result quality.
Affiliate marketing Affiliate link sites contribute to the low-quality content that floods the internet.
AI-generated content New technology can quickly produce low-quality content.
Marketing Search results are filled with marketing and links that may not be relevant to the query.
Recommender algorithms Some say the algorithm that recommends content is a mess. For example, someone might be recommended alt-right content after watching a click-bait video.
Ads Google’s biggest business is advertising, and it’s inserting more ads into its products to make more money.
Some say it’s harder to find specific information these days, and that search operators are often needed to filter search results.
