jmathai 4 years ago

This is a pretty innovative feature.

Here's the source code for a sample "Hacker News" Goggle. Essentially, it will prioritize domains popular on Hacker News. I could even see a browser plugin that lets you add or remove domains as you visit them.

https://github.com/brave/goggles-quickstart/blob/main/goggle...

And here's the language syntax.

https://github.com/brave/goggles-quickstart/blob/main/goggle...

  • lostlogin 4 years ago

    Assuming I’m understanding Goggles correctly, I’d like to be able to have more than one search bar. An unfiltered, and a couple of custom ones.

    • benjaminjackman 4 years ago

      maybe combine them with user defined !bang commands like on duckduckgo, !hn search_term (searches hn sites list from above).

    • sp332 4 years ago

      You can use keywords to select search engines in both Chrome and Firefox. If you configure "custom1" as a keyword, then just type custom1 followed by a space into the address bar it will activate that search engine and send the rest of your query to that URL.

      • ghostly_s 4 years ago

        This wouldn't let you use multiple "flavors" of Brave though unless they expose different URLs for 'Goggles'; sounds like you just are allowed to enable one as a sitewide setting.

        • sp332 4 years ago

          They do have different URLs for different goggles. Do a search for the word "test" with a Goggle on, then grab the URL from the address bar and paste that into your new bookmark. Replace "test" with "%s", add a keyword, and you're good to go. Repeat with other goggles.

  • irthomasthomas 4 years ago

    And I was wondering how long it would take for the hn version to arrive. Very cool.

  • lowwave 4 years ago

    > sample "Hacker News" Goggle

    wonder how they came up with that list? That list it self is a goldmine on it's own.

  • mintplant 4 years ago

    The syntax makes me wonder if the implementation is related to their high-performance filter rule evaluation library, adblock-rust [0]. Whatever is doing the dynamic reranking would need to evaluate lots of rules and churn through links fast.

    [0] https://github.com/brave/adblock-rust

  • nico 4 years ago

    This sounds like a killer feature.

    Would be great to complement with social media as we’ll. For example, make the domains in posts within my networks, more relevant.

    That way, through controlling/curating my networks, I get to decide what’s more relevant to me in search results.

    Would be awesome to add stackoverflow in there too :)

    • sassy_quat 4 years ago

      Man, with tech evangelists like you, Brave is going receive an anti-trust case for making a killer app.

    • SmellTheGlove 4 years ago

      > Would be great to complement with social media as we’ll. For example, make the domains in posts within my networks, more relevant.

      The cynic in me can’t help but wonder if this is just dialing up an echo chamber if we include social media proximity as a filter.

      • s3tz 4 years ago

        Would help to have an easy toggle between the different ones.

      • jmathai 4 years ago

        Promoting ways to do curate your own echo chamber beats other companies doing it for you based on ad revenue.

      • keenmaster 4 years ago

        Our brains are not well-equipped to down-rank bad information sufficiently once we are exposed to it. By then, it’s often too late. We do have powers of planning and selective exposure though, so we can say “I think these newspapers are authoritative and these others aren’t, so that’s what I’m going to subscribe to” much easier than “I’m going to selectively ignore this trash information that I see in google results or my Facebook wall.” Tools like this will allow reasonable people to curate the most authoritative sources on their side of the ideological spectrum. So even a right-leaning lens will tend to exclude the most extreme sources, and this will ease pressure on Fox such that it can present more center-right content without losing views. Same with the left-leaning lenses and MSNBC. If this idea proliferates (of selective exposure in a digital environment, where algorithms don’t entirely choose what you see), it can help deflate the network effects of extremism and populism in a virtuous cycle.

  • danskeren 4 years ago

    This is one of the first things I did when I implemented my own Bing proxy, although I did the site boosting/downranking/exclusions and rewrote URLs (e.g. www.reddit.com > old.reddit.com) myself since I didn't have any users, but the plans was always to give users the ability to control this.

    I later learned that it's actually against Microsoft's Bing Search API use and display requirements (https://docs.microsoft.com/en-us/bing/search-apis/bing-web-s...), which states that you're not allowed to:

    > Modify the results content (other than to reformat them in a way that does not violate any other requirement), unless required by law or agreed to by Microsoft.

    > Reorder, including by omission, the results displayed in an answer when an order or ranking is provided, unless required by law or agreed to by Microsoft.

    > Display content that was not included within any part of a response in a way that would lead a user to believe that content is part of the response.

    And there are many other restrictions imposed upon you. I'd argue the reason you see almost zero innovation in this space (the only thing I can think of is !bangs) is because non-Google/Bing(/Brave) Search Engines have very little control over the received data, and with the little control we do have then there are many restrictions that prevents us from making these 'innovative' features.

    Based on my pessimistic reading then we're not allowed under any circumstances to merge API results from multiple search engines (e.g. Bing + Yandex + Google), and for every site we want to exclude/boost/derank/rewrite sites/urls then we need explicit permission from a Microsoft representative (which would prevent us from implementing this kind of feature). We're also not allowed to display third-party ads on any pages that displays part of the API results (which is funny because I feel it's near impossible to join Microsoft's Advertising network even though my site in my opinion have a good purpose and provide a high quality UI/UX experience - https://ask.moe).. I've later switched to Google's Programmable Search Engine and even though my site has been approved by Google as a non-profit, as well as approved for AdSense, then they will only display ads in the search results if I turn off revenue-share.

    This industry desperately needs legislation that makes it possible for everybody to obtain access to Google/Microsoft's crawled data, and this access should not be limited to expensive APIs that make it impossible for anybody besides Google/Microsoft to do any sort of innovation.

    • nico 4 years ago

      Great insight.

      I wonder if the LinkedIn scraping case would apply to someone crawling Google search results.

    • ghostly_s 4 years ago

      Surely big partners like DuckDuckGo have negotiated their own terms with MS. DDG certainly combines Bing's results with other sources, at least they claim to.

atotic 4 years ago

I hope Goggles can be used as a ranking signal to help default search engine deliver better results.

Google has never had the appetite for letting users explicitly improve its results. Their reasoning was that pure algorithm is the only possible solution that scales. Even the minor features, such as "I never want to see this site", were removed.

I am glad Brave is trying out something different. Crossing my fingers that it works, the current state of search is so meh..

  • spaniard89277 4 years ago

    I hope forums gain some weight after google decided to f** them over in the results. IDK in English but for spanish language forums are still valuable, but you need to know the domain name so that hurts discoverability.

    • aliasxneo 4 years ago

      I just used Brave for the first time and was absolutely delighted to see they have a dedicated "discussions" section when you search for something. It's literally what has sold me to trying it as my default engine for a few weeks.

      • spaniard89277 4 years ago

        Mmm, gonna try, thanks.

        Hmmm, can't find that discussions tab.

        • lrae 4 years ago

          It's not a tab, it's a section of the default search results page. And it also is just Reddit. At least for the couple of searches I just tried it for.

          • GeorgeWBasic 4 years ago

            Same, I've only ever seen reddit in that section. Helping reddit's hegemony is counterproductive, not helpful.

      • Agamus 4 years ago

        We users are a funny lot. I just used Brave for the first time, and the very first thing I did was look for how to turn off "discussions".

        • danuker 4 years ago

          At least you know they're there, and you could turn them off.

      • Nemi 4 years ago

        I want this but can’t find it. I want to find discussions on something (toyota sienna) but when I search I don’t see any discussions section. Even putting “discussions” in the search terms does not bring it up. Looks like something they should make toggleable.

        EDIT: I take this back. If I put the term “discussion” in the search along with “toyota sienna”, I see a “discussions” section in the search results if I am on the “goggles” tab. I don’t see the discussions section if I omit the “discussion” term though.

  • hedora 4 years ago

    Google has had a large team that manually curates results for a very, very long time.

    I have no idea why they aren't able to flag and block spam domains anymore.

    • not2b 4 years ago

      The web is much too big for that to be practical.

    • slig 4 years ago

      Seriously how hard must be to flag duplicated content from GitHub, Wikipedia and Stack Overflow? Seriously, last week I had a query that returned the exact same content three times on the same page: the first result was a GH issue, and the other two were spam websites with the same content from GH. Google used to be good at flagging and downranking duplicated content, but now they don't even care, it's a shame.

      • davidatbu 4 years ago

        I'm always amazed at such comments that trivialise the challenges of fighting spam and SEO while being the most dominant search engine by far (which means spam and SEO targets you by far).

        If it is so easy, why don't you build a dominant search engine that manages to complete avoid the "totally easy" spam you talk about?

        If perhaps, you have extensive experience in the anti-spam section of a dominant search engine (or some similar position), I'd give your comment more weight. Do you have such experience?

        • shepherdjerred 4 years ago

          It’s not easy, but it’s hard to believe that a company with Googles resources and dominance can’t build a good solution.

          • davidatbu 4 years ago

            The only constant in my journey in comp sci is my underestimation of how much time and effort things take, so I guess I may be trying to compensate for that.

            Incidentally, if anyone has insight into how to improve that aspect of my job, that would be much appreciated!

        • GeorgeWBasic 4 years ago

          What exactly is difficult about detecting direct copies of just those three sites? Because that's what's out there: exact copies. If Google isn't filtering those out, it's because they don't want to.

          • davidatbu 4 years ago

            Google Search is most likely an incredibly complex engineering feat with many moving parts.

            Unless you provide me with your qualifications and/or previous experience that would lend credence to your claim, I will view your claim as one from an armchair critic/engineer.

        • slig 4 years ago

          They used to be good at it, now they seem bad. How can that be? How hard is to not show three exact copies of the same result for the same query on the first page?

          And yes, I'm being "an armchair critic/engineer", like everyone else criticizing Google or any other big company that seems to be getting worse at what they excelled.

          • davidatbu 4 years ago

            To be clear, I am not labeling your commentary armchair criticism because you are supposing that spam on Google is more prevalent in recent times, but because you are so confidently asserting that it is easy to fight spam at the scale and quality Google is operating at.

            Since you haven't provided any qualifications/past experience, I am not convinced at all that it's as easy as you say it is.

            • slig 4 years ago

              Fair enough.

    • esperent 4 years ago

      I don't think so, can you provide a source for this?

  • throwaway81523 4 years ago

    > I hope Goggles can be used as a ranking signal to help default search engine deliver better results.

    Ranking is already treated as predicting which of the search matches the user is most likely to want to see. Clickbait gets highly ranked because users do in fact click on it. Goggles (which sound like a great idea) apparently let you somewhat control the prior probability distribution as an input to the ranking algorithm.

    I wonder what features it lets you select on. E.g. we had a thread here recently about finding useful product reviews. It would be great to have a goggle that downranks any site containing amazon affiliate links, since those are almost always basically shill sites despite being "reviews".

    • oDot 4 years ago

      That is incorrect. Many high quality reviewers make money through affiliate links. For example, In 2020 LTT made 9% through Amazon Associates[0]

      [0] https://linustechtips.com/topic/1270087-linus-media-group-ma...

      • throwaway81523 4 years ago

        Yes there are some exceptions. Maybe I should have said "most of" instead of "almost all", but the thing is that it's common and frequent enough that I want to bypass that style of "review".

  • raxxorraxor 4 years ago

    Google has problem with generated "marketing" sites whose content gets filled by bots. They also use the latest SEO tricks to get ahead. This is something any small private internet presence will never have while click-farms will.

    Additionally we hide information behind proprietary platforms like Discord that cannot be crawled.

    Ironically Googles research of text AI undermines their search algorithm because now spammers use said AIs to get good page ratings. A lot of sites have ever the same content with a few different words here and there. Especially new media content get immediately swamped with such sites since there are no established sites under certain key words. A domain filter sadly won't work as well since there a so many scamming sites.

  • asiachick 4 years ago

    I feel like Google would do better by letting users register filters. For example I'd filter out ranker, vulture, and similar sites. That would seem like more signal for Google than not having that user preference. More signal = better searches = more searches = more money.

rel2thr 4 years ago

Yea I’ve been waiting for this. Feels like the biggest innovation in search in a long time . Can’t wait till the community builds a goggle to remove all built for SEO sites

  • niutech 4 years ago

    You can also make your own filters using Google Programmable Search Engine.

jacooper 4 years ago

Honestly, its the only usable independent search engine, its privacy focused and unlike start page and DDG, its actually independent.

Brave is doing what Mozilla wont't do.

Also with Goggles you can finally block all the stupid Automated comparisons sites, Brave already had a forums section, and this makes it even better.

tacotacotaco 4 years ago

Sounds a lot of Kagi’s block/boost and their lenses features. I haven’t used either. Just pointing out prior art.

https://blog.kagi.com/kagi-features

  • buildbot 4 years ago

    Yeah seems like a copy of that feature

  • walterbell 4 years ago

    Are those search ranking preferences linked to your paid Kagi account identity?

  • pythux 4 years ago

    From what I can see the Lenses feature only allows to specify up to 10 domains? (Screenshot in the article linked above). If that’s the case I don’t see how Lenses and Goggles are comparable.

    Goggles allows to specify thousands of rules, not only on domain but also URL patterns and in the future matching on elements of the page as well (e.g. titles, etc.)

    It is also not clear that Lenses predates the Goggles whitepaper. We’ve been playing with the idea of Goggles for a long time.

    Disclaimer: I work at Brave.

  • solso 4 years ago

    Disclaimer: Works at Brave, before at Tailcat.

    Goggles white-paper was released more than a year ago, long before Kagi was even announced to the public.

    Additionally, before Brave acquired Tailcat (Jan 2021) I had the pleasure to share the draft of the paper with Kagi's founder.

    So no, there is no prior art.

    Let me add that I do not claim that Goggles is prior art of Lenses either.

    One of the key features of Goggles design is that the instructions, rules and filters are open and URL accessible.

    A Goggle is not so much a personal preference configuration, but a way to collaborative come up with shareable and expandable search re-rankers.

    Very different goals if you ask me. Of course, Goggles can be used for personal preferences exclusively, but that's not the use case we had in mind.

    • freediver 4 years ago

      Hello Josep ! (Kagi founder here)

      For a bit of historic accuracy if it ever matters for future readers:

      Kagi was founded in 2019 and we have operated for years in private beta with thousands of users before public beta release this June.

      Goggles were not inspired by Kagi”s lenses and I can confirm seeing the whitepaper before we got the lens feature out last year.

      Kagi”s Lenses were inspired by Blekko’s “slashtags” which is probably the original “prior art” for this kind of feature.

      Looks like we arrived to similar idea, but different execution. Kagi”s Lens feature is osimple to create filter for the web, that anyone can make with a few clicks plus a bunch of powerful built-in lenses like “noncommercial” or “discussions” search.

      • libraryatnight 4 years ago

        I'm a paying Kagi user, it's a solid search engine and the lenses feature is excellent. Keep it up :)

        • eitland 4 years ago

          I'm a paying Kagi user because doublequotes works, i.e. if I search for something using doublequotes around it, Kagi actually makes sure those words are in the page, and if it fails they create a bug report and fix it.

          It seems to be better in every other way too, but that is actually the single reason why I pay for it.

      • ColinHayhurst 4 years ago

        We applaud all these innovations and are glad to see what is being done with Kagi Lenses and Brave Goggles. The Web ecosystem and users need innovations in search.

        Our own innovation in this domain go back to 2005 and was called Personal Search Engine. https://web.archive.org/web/20060220233451/http://www.mojeek... (first capture Feb 2006).

        We are currently bringing this back (in Beta). RollYo innovated too (private Beta August 2005). Google Custom Search launched in October 2006. So there were at least 3 services that predate Blekko (2010).

      • solso 4 years ago

        Hi Vladimir! Good to see we are in sync. Glad to see Kagi doing well as well.

        For the record, when I said "long before Kagi was even announced to the public." I meant exactly what I wrote, not that Kagi did not exist, it did.

        • freediver 4 years ago

          That is what I corrected, assuming you meant we were announced to the public in 2022.

          Kagi was announced to the public in 2019, long before public beta release this June. I understand it is kind of hard to track small, bootstrapped startups with no mainstream exposure, but as I said this is for historic accuracy.

    • atrudeau 4 years ago

      I love the initiative, but I agree with parent that some prior art should be acknowledged.

      My extension has existed since 2012: https://chrome.google.com/webstore/detail/search-filter/eidh...

      In June 2020, I added support for external (collaborative) filter lists which are incredibly similar to Goggles.

      Not saying anything was copied, just that it might be nice to cite/reference prior work.

      • closedloop129 4 years ago

        Do you offer public access to those lists or are they only available to users of the plugin?

        This sounds like an opportunity to create white and blacklists in cooperation among various projects.

        • atrudeau 4 years ago

          Filter lists can be hosted anywhere and imported with the @ syntax:

          # Make these domains stand out in results +en.wikipedia.org +stackoverflow.com +github.com +api.rubyonrails.org # SPAM - never show these results experts-exchange.com # Pull filters from external source @https://clobapi.herokuapp.com/default-filters.txt

          This default list is the only one I distribute but users have come up with own lists.

          It would be nice to have a Github repo with such lists (or meta lists: the @ syntax works recursively, allowing lists to import other lists).

          Your suggestion of having a standard for the list syntax is interesting.

  • astonex 4 years ago

    It's not necessarily hard to come up with this independently.

    I hadn't heard of Kagi before until recently, and only just seen this Brave Goggle feature, but I had a very similar idea with my own search https://namusearch.com/ - Search using user defined url lists which can be publicly shared

    I think I initially had the idea by thinking about uBlock but for Search.

hirundo 4 years ago

From the whitepaper:

  This paper proposes an open and collaborative system by whicha community, or a single user, can create sets of rules and filters, called Goggles, to define the space which a search engine can pull results from. Instead of a single ranking algorithm, we could have as many as needed, overcoming the biases that a single actor (the search engine) embeds into the results ... Such system would be made possible by the availability of a host search engine, providing the index and infrastructure, which are unlikely to be replicated without major development and infrastructure costs.

Unironically, a multitude of biases in search engine results is just what we need. And the difficulty in building your own index is just why we don't have it. I would love to have my own version of google-without-the-stupid-stuff according to people I specifically identify and respect.

I don't think we yet appreciate the importance of good bubble hygeine on mental health, and this is a bespoke bubble construction kit.

  • Darkphibre 4 years ago

    Absolutely! I see a lot of people complain about twitter, but if you actively curate who you want to see and turn off recommendation posts it can be a very pleasant experience. There's loads of positive communities posting heartwarming and uplifting content. It's just that rage and anger are optimized by the algorithms, you have to actively curate your bubble to counteract.

    Goggles have a lot of promise. I'm excited about the concepts Brave is bringing forth.

    • loonster 4 years ago

      I hate Twitter, reddit, quora, and a multitude of others because they do not allow you to read comments if you don't have an account.

donmcronald 4 years ago

> Essentially, Goggles will act as a re-ranking option on top of the Brave Search index.

The idea is amazing. Just the "no pinterest" and "copycats removal" examples have me super excited.

  • loonster 4 years ago

    The pinterest images sometimes give me exactly what I want, but make it harder to get to what I want. I would loved if the pinterest rank space was saved, but replaced with a link from a reverse image search of that image.

gnicholas 4 years ago

What does anyone think of the name "Goggles"? I wonder if they would have named it this if Google didn't exist. Seems like a genius name to me, under the circumstances!

  • jkuria 4 years ago

    Also a ripe opportunity for Google's lawyers to go after them as it creates confusion in the marketplace. Or maybe a marketing opportunity for them, if they play the David vs. Goliath card, should Google come after them.

    • gnicholas 4 years ago

      That would be a genius judo-style move. David versus Googliath — the headlines practically write themselves!

      • smsm42 4 years ago

        Google, giggling giddily, gobbles "goggles".

      • edm0nd 4 years ago

        Bravid VS Googliath

  • donmcronald 4 years ago

    Plus, if Google gets in their face about it they can rename it to "Shades - Better than Goggles".

  • robonerd 4 years ago

    I think they're trying to bait Google into a legal fight that would immediately turn into a PR war. Very.. brave.. of them.

    • xbar 4 years ago

      Can you hear the Google PR team whispering to Legal?

      "...don't touch it...."

  • smsm42 4 years ago

    Probably not the best idea, given how similar it to "Google", but I assume all better alternatives were trademarked away or something. Then again, if Google would be stupid enough to declare they own the word "goggles", it may generate a lot of PR for the project that they would never get otherwise. So may end up a win.

  • throwaway81523 4 years ago

    It makes me think of the movie "They Live", which predates Google.

  • rustoo 4 years ago

    exactly.. Even while reading, I tend to read it as Googles! :D The Brave team is indeed brave.

enragedcacti 4 years ago

Does anyone have thoughts about how to use these to eliminate Amazon-Affiliate pop-up shops with auto-generated listicles of products no one so much as even looked at?

I would love a "Product Reviews" goggle that helps find legitimate reviews or recommendations without having to narrow to somewhere specific like reddit.

  • __ka 4 years ago

    If there is a pattern Amazon affiliate links have in common, you can create a goggle which removes any URL containing that pattern.

  • mminer237 4 years ago

    It might be too computationally intensive to make publicly available, but I would love it if they gave more in-depth controls for goggles beyond URL filtering. Being able to penalize sites for Amazon links, ad counts, or numbered lists or to boost sites for linking to high-quality content would be amazing.

    • pythux 4 years ago

      Hey, I work at Brave,

      This is great feedback, thank you! We already have a few ideas on how to make Goggles more powerful in the future, and the things you listed sound very interesting. Would you mind elaborating a bit on how you would see yourself using these features in a Goggle? (e.g. ads count, linking to high-quality content, etc.)

      • mminer237 4 years ago

        There might be more powerful ideas, but I'm thinking pretty simple:

          $downrank=%adcount%
          www.amazon.com*tag=$inlinks,downrank=2
          news.ycombinator.com$inlinks,boost=1
        • dubswithus 4 years ago

          Love this idea. Except for a few review sites, I generally find sites with many affiliate links unworthy.

        • pythux 4 years ago

          Thank you, very interesting ideas. I like the option to boost based on a variable depending on the page itself. How would we define “adcount”, number of network requests blocked by some adblocker when loading the page?

          • mminer237 4 years ago

            I suppose that could work. I would think that would just block Google's ad script in one when it might add three auto ads however. I was just thinking load it without an adblocker and count the number of `.adsbygoogle:not([style*="display: none"])` and `.amzn-native-container`, etc.

        • mminer237 4 years ago

          Thinking about it some more, other ideas would be to be able to make things exponentially more downranky the more affiliate links/ads it has (so one isn't a big deal but 4 is), and to just be able to give a generic percentage tweaks for linking to high-ranking sites or being linked from them, but the later is probably much harder.

throwaway23234 4 years ago

I need to check this out. I am guessing I can do all the things I used to be able to in Google, like disable all results from say, pinterest and a few other sites I dislike.

  • Pakdef 4 years ago

    > like disable all results from say, pinterest and a few other sites I dislike.

    I use the uBlacklist addon for that

tryptophan 4 years ago

I really like Brave and what it is trying to do. I've been using it as my main browser (with the brave engine) and I have no real complaints. Firefox has been making me mad lately(more-so the corporation and its stupidity than the browser itself) and so...Brave.

However, I will not recommend it to my father/mother. I think it is too geared towards techies, and full of traps to confuse people less involved in online tech culture. All this talk of crypto/wallets/coins/ads and the associated buttons and icons everywhere will just confuse the hell out of them. You need to spend a bunch of time disabling stuff or setting things up that they will just not do. Kind of a shame, because the out-of-the-box experience is really good for privacy and ad blocking, etc...

  • pasdoy 4 years ago

    Means growth potential is high

  • dubswithus 4 years ago

    The ads are optin. Tell them to focus on the address bar. Everything else is in the “don’t worry about it” territory.

    • freediver 4 years ago

      The same could be said for products it is supposed to compete with? Should we really ignore the "rest" or strive to have products where there is no "rest" to ignore?

zanethomas 4 years ago

Very interesting.

When I was teaching programming students were bewildered, befuddled, and confused by the incorrect, out-of-version, and incomplete technical information which litters the web.

I have often wondered about creating a curated collection of known-useful information for students to search.

This could be the start of something good.

  • dubswithus 4 years ago

    That’s an awesome idea. I could also see professors’ creating a Goggle to restrict to sources covered by the syllabus. Similar to your idea but perhaps it’s news sites or open access journals.

bombcar 4 years ago

Zee goggles! Zey do sawmsing!

This name is surprisingly close to their largest competitor, interesting choice.

It'd be nice if Goggles could be "additive" and you could subscribe to them; I'd love an "anti stackexchange spam" one.

  • mwint 4 years ago

    Can you expand on the “stackexchange spam” point?

    • zamalek 4 years ago

      There are a bunch of stackexchange "mirrors" that add no value beyond adverts. They somehow rank higher than stackexchanges in popular search engines.

      • purkka 4 years ago

        And arguably even worse, they often fill the first two pages with duplicates of the first couple results, making the entire search almost pointless if those couple solutions didn't work out for you.

      • loonster 4 years ago

        I've seen the same problem with craigslist mirrors. When an item on craigslist gets sold, the seller removes the ad to stop the spam. The old ads stay up on the mirrors and it's not always obvious how old the ad is for.

    • lagrange77 4 years ago

      They often hide the fact that they mirror SO posts. That can be very annoying, like when you're researching a rare coding issue and there are 5 Google hits, and you only find out after clicking on all of them that 4 of them are copies of the first (only genuine) one.

abhinavsharma 4 years ago

We built something a while ago that lets you do this on top of an existing search engine like Google.

https://chrome.google.com/webstore/detail/hypersearch/feojag...

It's 100% open source and client-side https://github.com/abhinavsharma/hypersearch

I wrote a post explaining why we think this is a more pragramtic approach here https://abhinavsharma.com/blog/google-alternatives

  • pythux 4 years ago

    Nice project,

    Goggles is also open-source, the main difference of the approach is that Goggles collaborates with Brave Search index while your approach uses any search index as source of URLs.

    That difference is fundamental, a client can use a host search engine to do query expansions to build a large result set and then apply the filters and boosts that the user defines. However, that recall set is going to be in the order of hundreds URLs (more will take either too long or the client will be blocked); and I assume it would be challenging to apply thousands of filters at once. The smaller the result set, the smaller is the effect or benefit of the user-defined rules.

    Goggles, because it collaborates with the host search engine — as of today only Brave search — can apply the filters and boosts to a recall set of tens of thousands of URLs. So the net effect of such rules is much larger.

    Goggles is a bit more complicated, but it's for a reason.

    Disclaimer: I work at Brave.

georgehill 4 years ago

> Google more than a year to reach 2.5 billion queries, and DuckDuckGo more than 4 years.

I love Brave as a search engine but these statistics are misleading. They fail to account for the fact that there were only 147 million users in 1998, but today we have 5 billion users.

perryizgr8 4 years ago

Mozilla needs to learn how to innovate from Brave. If Mozilla's mission statement includes an open internet, why haven't they considered working on a search engine? An open, transparent search engine would be as much if not more impactful on the web today.

As with most of Mozilla's problems, it seems the impediment is the sweet sweet Google billions rolling in every year without any regard to the work they're putting in.

Imnimo 4 years ago

I feel like I don't grasp the 'boost' concept. The white paper says:

>$boost=XX—is used to alter the ranking of specific results by XX (e.g. $boost=1 would not alter the ranking, while $boost=2 would make a result two times more important).

But then we have this in the example:

>! Generic boosting

>rust$boost=1,site=rs

So this line is a no-op, because it uses boost=1?

  • pythux 4 years ago

    Hey, Brave engineer here,

    In this case it is needed because there is a generic '$discard' rule in the Goggle (which means: discard any result that does not match any other instruction from the Goggle; you can see this as a 'default action' applied to results if they are not caught by any other instruction).

    Using a 'boost=1' allows you to keep some sites, that you don't necessarily want to boost more than their "natural ranking".

    We have a bit more info about that in the "Getting Started" guide here: https://github.com/brave/goggles-quickstart/blob/main/gettin...

    I hope that helps!

    • nvrspyx 4 years ago

      I think it's the "Generic boosting" comment that might have thrown the parent off. The comment could say something like "Keep these sites with default ranking" instead.

      • pythux 4 years ago

        Thanks for clarifying, makes sense. I think the comment might predate the switch to boost=1 and was not updated accordingly.

dwighttk 4 years ago

Can't tell if name is genius or terrible... Just reading about it here and at github I keep seeing Google instead of Goggle.

luis8 4 years ago

I keep saying this but we need a local web search engine.

How can we accomplish this?

I'm not sure if it's possible or feasible.

But i want the discussion to happen. Maybe someone will eventually find a clever way to solve this or maybe it's just a matter of time until our cpus/bandwith/storage is good enough for this to work

eevilspock 4 years ago

Is/will there be a way to combine Goggles? e.g. "No Pinterest" + "Copycats removal" + "1k short"? It would be a union of the discards, and the boosts/downranks either being cumulative, max(boosts/downranks from each Goggle), the current precedence rules[1], or something else.

---

[1]: https://github.com/brave/goggles-quickstart/blob/main/gettin...

  • pythux 4 years ago

    Thanks for the great feedback! As you mentioned, before being able to apply multiple Goggles at once[1], we would need to define precedence rules. It's technically possible, but then we would also need to figure out some UX around it, etc. In the meanwhile, and although this might not be the most convenient, it is still possible to combine them and host them separately.

    The idea of having a separate Goggles aggregator was also mentioned yesterday; imagine a site when you can click a few check-boxes of Goggles you like, then get a new link with the combination of all of them (you could then submit this link in Brave Search to use the aggregated Goggle).

    In any case, applying multiple Goggles at once is something we have discussed internally, we're not yet planning on adding this but feedback like yours is super valuable for us to decide on the next steps.

    [1] https://github.com/brave/goggles-quickstart/blob/main/faq.md...

mihau 4 years ago

Nice! Ability to quickly choose goggle would be nice, something similar to "site:" or !bangs in ddg. Example search: "integration tests best practices goggle:tech-blogs".

  • Method-X 4 years ago

    You could also make search more like the command line for advanced users. Typing a ! would prompt a dropdown and the user could select what Goggle to add. Eventually they could let users add multiple Goggles to a single search.

ZeroGravitas 4 years ago

This feels particularly useful for communities with overlapping names.

The Python programmer community, the Monty Python fans and owners of actual Python snakes probably have mutually useful lists of sites.

I don't really want to exclude many of the copycats/spammers, I just want to replace them with the original or my preferred source for that info, which I don't think this does?

avivo 4 years ago

This is great. That said, I would love to see this extended beyond just keyword search, to contextualization of a given piece of content. https://aviv.medium.com/contextualization-engines-can-fight-... ( I should note that the word authoritative here just means a particular 'lens' that has been vetted by a defined process—it's a way to make the problem simpler for prototyping. It might for example be a lens showing just accepted Stack Overflow answers.)

Imagine being able to select a bit of code in your editor, and getting an explanation of what that code does based off the content of all of the accepted answers on Stack Overflow.

culi 4 years ago

I didn't see any examples of negative "boost". I feel like I'd much prefer to maintain the diversity of the internet by discouraging the dominant crappy sources than by boosting up the finite number of quality sources I can think of

  • pythux 4 years ago

    Hi, Brave engineer here,

    It is true that there are currently less examples of negative boosts, but it is supported by Goggles thanks to the 'downrank' option.

    For example:

    $downrank,site=example.com

    If you want to be stricter, you can also discard sites completely of course:

    $discard,site=example.com

    I hope that helps,

    • culi 4 years ago

      That does help. Thanks for the tip!

divs1210 4 years ago

I already love Brave Browser, now I'm going to start using their search too.

This is the kind of feature that seems obvious in hindsight.

There are still some features I miss from FireFox (forget site, select all, etc.) but otherwise Brave has worked pretty well for me!

bunnywantspluto 4 years ago

Great! Finally, a solution that will help reduce googling numerous times, like "blah blah filetype:pdf site:edu" "blah blah site:reddit.com" for good search results.

princevegeta89 4 years ago

Man, the first thing we need to get rid of is the sponsored search results which have no business to appear on top. For example, if you Google for "toyota", you get an "ad" for the official Toyota website on top.

I mean you are gonna get the official Toyota website on top anyway, for obvious reasons. Showing it as an "ad" to users, just to milk some extra money from advertisers like this makes the entire thing feel like a scam.

  • propogandist 4 years ago

    companies are forced to do this to prevent competitors from bidding on their brand names. Google uses this as a very effective extortion tactic, especially since most people foolishly click the first result (ad)

    • princevegeta89 4 years ago

      Even if competitors end up bidding on their brands I don't think they should show up first if I was Googling for "toyota" anyway, right?

      • propogandist 4 years ago

        Competitors are not allowed to use “Toyota” (trademark) in their ads, but they can serve ads to people who search for “Toyota”. Brands bid for the brand terms to make it expensive for competition to buy the brand keyword. It’s truly extortion by Google.

tommica 4 years ago

Oh wow, I remember this concept being mentioned in HN years ago, and am super happy that this exists now! Need to test this out

1vuio0pswjnm7 4 years ago

Is search.brave.com restricted to only certain clients, e.g., browsers, or certain countries.

I get a "204 No content" response.

christkv 4 years ago

Make it possible to share the goggles in some way and we can get a goggles best of site for different search domains.

ewy1 4 years ago

Now this is the killer feature a search engine needs. Next, what about a feature to invert the goggles? For example, if I wanted to invert the "no Pinterest" rule to get only Pinterest results.

I don't really have any good use cases for this but it'd be funny, to me at least.

seanwilson 4 years ago

> These files contain instructions allowing you to tell Brave Search how you'd like your results to be ranked

Does anyone have any insight on the performance cost to the search engine here if lots of users had large rules and filters files? Does this add a significant cost per search?

Imnimo 4 years ago

The whitepaper opens with:

Democracy dies in darkness, a line recently adopted by the Washington Post as their slogan, warns us that unless people are informed with facts and truth, no true democracy is possible. Those who benefit from darkness have always tried to control media in order to control and manipulate public opinion with propaganda. Until recently, propaganda has been the exclusive domain of nation-states or state-sponsored actors through mass media [19]. With the mass popularization of the Web in the last two decades and the subsequent privatization of it by big platforms like Google, YouTube and Facebook, the paradigm has changed. Propaganda is no longer a tool of an elite, but it has been commoditized to the extent that it is as accessible as advertisement, becoming a weapon that too many actors have access to. One must appreciate the irony that those most vocal about the risks of propaganda are those who controlled it in the past. Nevertheless, the risk of fake-news—a neologism created to mitigate cognitive dissonance—cannot be ignored [5, 6, 30, 33, 36]. It is dangerous for a society if people living in it cannot distinguish between facts, opinions and outright misinformation. Although this danger has always existed, today the situation is dire if only because quantitative becomes qualitative and although all information is theoretically available, in practical terms it is not.

Doesn't this seem a bit overblown for what is ultimately just a tool to make soft white lists for search results? I feel like Brave has this habit of framing mundane software as some sort of weapon in a grand ideological war. You're just letting people filter Pinterest out of their search results. Chill.

  • ntp85 4 years ago

    This might seem out of proportion. OTOH this contextual information makes the motivation to create this tool a lot more transparent, imho of course.

logicalmonster 4 years ago

Goggles sounds like a great idea, and I'll have to play around with this more, but visually the word Goggles looks too much like "Google". I think that makes the marketing a bit confusing to average people.

pleb_nz 4 years ago

I would have been interested in using brave if they hadn't gone with Chromium.

IMO, I don't think it's going to be a good thing for users if chromium ends up being the last thing standing.

jdonaldson 4 years ago

I did a version of this waaaaay back in the day. Naturally since Google was sooo cool back then I called it Google Goggles. Now of course they're not as warm and fuzzy.

  • crthpl 4 years ago

    Do you have a link?

    • jdonaldson 4 years ago

      Nah, it’s seriously ancient. I might get into again here now that google search is hitting the skids.

Commodore63 4 years ago

I guess it's "yay, filter bubbles" in 2022?

  • prohobo 4 years ago

    Well, it's more like individual curation vs corporate curation. It's not necessarily good for discoverability, but with filters like "remove top 1k sites" it can be.

cabirum 4 years ago

Is the similarity to "google" intentional?

  • slg 4 years ago

    You don't "accidentally" name a product something that is one letter off and so visual similar to the name of your biggest rival. It is clearly intentional. The only question is whether Google has or will want recourse for that.

    • nerdponx 4 years ago

      On the other hand, "google" has always sounded like "goggle", in addition to being a cute misspelling of "googol".

      • userbinator 4 years ago

        In what accent do Google and goggle sound almost the same?

        • nerdponx 4 years ago

          Most that I know of. They differ in pronunciation by one vowel sound, and in spelling by one letter.

  • sdfhdhjdw3 4 years ago

    Google? What is that?

    No, it was an accident.

iroh2727 4 years ago

Mmm I have mixed feelings about this. On the one hand, I definitely believe in giving users the ability to customize and control the software they use. But on the other hand, I feel like a search engine, in order to be good, should be opinionated about what constitutes "quality" and what's useful to people. These goggles can kind of be a way for Brave to say "the blood isn't on my hands".

Also, seeing the initial examples from their beta (e.g. boost tech content or boost left-wing news sources) makes me a bit weary about its usefulness (if most people, rather than creating their own goggles end up using some prepackaged ones).

chiefalchemist 4 years ago

It's been a while since I played with it, but how is this different than Google custom search?

emrah 4 years ago

I would have thought DuckDuckGo would be interested in heading something like this

davidork 4 years ago

so... don't get rid of search engine filter "bubbles" that turn the web into an echo chamber, let the people build their own echo chambers?

I mean, its at least transparent, people are aware of it or have to opt in.

It feels like a weird compromise in terms of misinformation, cultural division, etc... but letting people choose which kool-aid they're drinking instead of letting the "totally not hand tweaked for edge cases in favor of the creator of "the algorithm"" to decide. Out of the handful of "ideas" around wrangling the the trashfire that is the modern internet, this seems like the most sane the best fit solution so far.

In terms of it being an actual search tool for finding information, answers, documentation, references that are actually relevant or useful it sounds insanely useful.

Narrow down searches for anything + "datasheet" to manufacturer websites and a handful of non paywalled datasheet catalogs - fuck yeah!

I forsee lots of angry website owners who run fluff content or bury reposted useful info under mile thick layers of ads.

  • LegitShady 4 years ago

    alternately just get rid of consistently bad results - I don't want to see pinterest and simiilar aggregators in any result I'm looking for, ever.

    • davidork 4 years ago

      Pinterest is ad fueled zombie. Scrape the web, rehost thumbnails of other useful/interesting images, put up ads, pollute image search results until the heat death of the universe.

    • guipsp 4 years ago

      believe it or not, other people do

      • LegitShady 4 years ago

        which is why this Goggles concept is so good - let me get rid of the search results I consistently want to remove, like pinterest.

  • ryanjshaw 4 years ago

    I'm waiting for Reddit & Twitter to let me specify who I trust to moderate what I view. Or for a scrappy young startup to show them how to do it. I see no reason for Twitter's hired fact checkers to exclusively perform this function, just like there's no reason why the first user-and-their-friends-to-grab-a-subreddit should have anything other than "recommended moderator" status.

    • gen220 4 years ago

      Twitter's social graph is fairly exposed. You can start with a few trusted "role models" (i.e. you'd want to follow anyone they're following) and build a pretty sizable graph from there, with minimal pruning necessary.

      I built a tool to recursively scrape RSS feeds from web pages linked to twitter bios. You pass in a "root" trusted user, and look in their bio and every "followee"'s bio for a website, then look for anything "rss" "feed" "atom" or "xml"-y on the link itself or in the domain's sitemap.xml.

      Surprisingly very useful. There's a decent amount of value in twitter's content, but arguably much more value in the followee network of "smart people", and the websites "linked out" from their profiles and tweets.

      Reddit, similar but in a different way, filters itself into variously useful, well-moderated communities. Top X posts of subreddits A, B, C is a great heuristic for getting 90% of the value out of reddit with very little of the toxicity.

      You needn't limit yourself to r/all and the twitter equivalent! :)

  • gen220 4 years ago

    From another corner of the "search" universe, I get most of my daily information doses through the lens of a collection of RSS feeds I've built up over the years. My feed collection is intolerant to toxic content, although I still see random toxic stuff on the "wild web" (YT, FB, etc.) every now and again.

    Does it put me in a bubble? Yeah. But it's a bubble of my own design, and it's a pretty nice place from my POV, that reflects my real world interests, hobbies, etc.

    I see goggles as a parallel system for "I'm looking for something specific" search.

    I think Goggles might turn out to be a mild retardant to toxic bubble formation, because toxic content is rocket fuel for the kind of "engagement" metrics that google/youtube/twitter/fb have spent the last decade min-maxing.

    IMO, existing "search" players (Google, FB, Twitter) are culpable for toxic echo chamber formation, only to the extent that they push toxic content "by default". By allowing users to fine-tune their weights, Brave+Goggles is attempting to dislodge this norm by introducing user feedback into the equation. Like you, I think it's a good idea.

    Some people will always opt-in to toxic bubbles, but I think that's more of a human/society problem and not one for a search player to solve.

  • _carbyau_ 4 years ago

    I see the "bubble" issue differently.

    Everyone has context bubbles already. You have work, outside of work, your hobbies both online(IE HN) and offline. You influence these bubbles composition. Hobbies in particular are entirely self selected.

    But you are aware of which context you are communing in and are free to move between them and outside them into the general public sphere.

    I see this as more of the same. As you say, "its at least transparent, people are aware of it or have to opt in"

    Interestingly by the comments here, a big driver for these self selected bubbles are so that people can avoid the advertising they don't wish to see. IE Pinterest and other SEO spam. If "self selected bubbles" are bad, then "targeted relevant advertising" is worse.

Pakdef 4 years ago

Do they ignore symbols like Google? I want a search engine that doesn't

hahnbee 4 years ago

automatically append 'reddit' to every search

  • pawelduda 4 years ago

    site:reddit.com you meant

isodev 4 years ago

Sounds to me as an easy way to let people reinforce their own biases.

  • eevilspock 4 years ago

    The point made is that is going to happen regardless, and additionally biases of the search providers are imposed on everyone. Not to mention that the feedback loop of virality will also bias search engines.

    The solution put forth by Goggles is to make such biases explicit and transparent, and to make them switchable. No one can honestly claim to be objective if they are using the "MAGA" Goggle. That said, people are particularly good and wearing biased goggles and believing they aren't wearing any goggles at all, or that they are wearing "the one true" goggle.

    Anyway, read the white paper, which discusses your point. https://brave.com/static-assets/files/goggles.pdf

mistrial9 4 years ago

technically useful if the first step is to remove SEO bias today then apply goggles.. next is transparency for the goggle filter actions (nothing more sinister than a convincing lie) overall looks useful

  • 2Gkashmiri 4 years ago

    my mind boggles at the sheer number of people being employed over SEO so removing that bias is like literally killing their livelihood. i don't care anyways because i don't use google and use a pi-hole AND ublock origin so i am insulated from ads but just saying

  • melq 4 years ago

    How would you 'remove' SEO bias?

    • vkou 4 years ago

      You apply an arbitrary filter that deranks 'shitty' sites, and then you play a semantic game about what 'bias' is, and how you don't have it, but all the competing search engines do.

      There's no objective measure of what site is 'good', and what site has been 'SEO-gamed' to rise to the top of <arbitrary search engine's algorithm>. The measures are subjective, and people complain when changes to the algorithm aimed at punishing black-hat-SEO also punish their website (Rightly or wrongly).

      Not to mention the problem of using black-hat-SEO to punish a competitor (By creating scummy links to them, that make it look like they are trying to game the search engine.)

      • hedora 4 years ago

        Growing up, my mother always used to give me books that contained content on page one. This goggle really brings back memories of wandering the dusty library isles of Mediterranean street markets with their pungent spices and beautifully crafted rugs.

        ... 100,000 words later ...

        I don't think it will be very hard get right.

    • mistrial9 4 years ago

      I personally ? would remove SEO-bias by first exposing the actual construction of the site without SEO add-ons, to some engine for consideration. A simple example would be "built with wordpress". Please note that it is wise to know that I do not know, many many things. So it becomes a networked endeavor, to find and identify "literal attributes" to sites for the use of the engine, not my personal opinion of what the web-o-sphere is in 2022.

      A very very significant example is the primary language group exposed on the site.. for example, Cantonese ? I personally support the rights of "minority" languages like Gaelic and Welsh in the European setting, Tamil for South Asia, things like that.. make it so..

      • ryandrake 4 years ago

        I agree, the ability to reliably filter out overly-SEO sites, copy-spam, and other search engine-bait would be a true game changer! Defining and detecting it is of course the hard part.

      • melq 4 years ago

        My point is that as long as there is an algorithm, it will be possible to optimize for it.

        • qu4z-2 4 years ago

          The advantage that Brave and co have is that SEO sites will largely not be willing to make changes that decrease their Google rank to improve their Brave rank. If Google changes their algorithm, everyone will optimise for the new one, but as long as the Google algorithm is there and the main priority, Brave may be able to extract some useful signal.

  • indymike 4 years ago

    All web search engines are biased to sites that are well designed to be included in the index. It is literally how a search engine works. Removing SEO bias would just eliminate sites that are easy to spider, parse and index and rank. Goggles are great because they will eventually become a signal for Brave to change the rank of a site - or even in the case of sites that end up on lots of goggles, delist them. I love the feature.

abhayhegde 4 years ago

I kept reading it as 'Googles'. Makes me think it was intentional to keep it close to the rival company just off by a letter?

agloeregrets 4 years ago

The polarization bit is like watching a person who hit your parked car explain why the crash is really your own fault. Explanations that 'the web is too broad' or 'it takes an active choice to enable the goggle' mean nothing. It takes an active choice to watch polarizing news and those sources will tell you that you really need to only get your info from them. I would not be shocked to see major sites use this to control how people view the world.

"Use our brave search and escape the leftist google agenda!" or such.

  • agloeregrets 4 years ago

    That said, I'll trade the world crashing to an end for a search engine that knows that when I type 'Angular template variable scope' It knows that when I say angular I explicitly mean angular 2-current not 'angularjs'

  • enragedcacti 4 years ago

    I've seen a number of stories from places like r/QAnonCasualties (support group for people whose loved ones have fallen into the QAnon conspiracy) where people have deprogrammed their parents or family members by blocking far-right/conspiracy content via DNS or through the cable box parental controls.

    The obvious questions of morality aside, my perception of those stories is that most of the victims are hopelessly addicted to the feeling being righteous and correct and part of something bigger to the point that it takes over their whole lives. They end up a husk of a person all for a fake cause. But what is interesting is that after you take it away they generally don't find something else to latch onto, they slowly go back to having hobbies and normal conversations and normal relationships with their family, friends, and coworkers.

    This is of course all anecdata, but if Goggles are another tool for giving people their loved ones back I think that's worth weighing as part of the equation.

    • kbelder 4 years ago

      Just remember that the addiction to righteousness is symmetrical around the political axis.

  • solso 4 years ago

    An active choice is better than a passive one, if only because it requires an effort, in that respect the explicitness is an advantage over the typical personalization.

    The article also mentions that Goggles will not stop polarization, it suffices to not exacerbate it.

    No technology/system on any period of time has been able to suppress it, censorship included.

    Disclaimer: I work at Brave search

    • cloutchaser 4 years ago

      Active choice is bad for people who think they know better and want to control others.

      • BrendanEich 4 years ago

        You mean people at Big Tech and dependent editorial downrankers such as DDG, right?

        • qu4z-2 4 years ago

          I think they were going for "Active choice is [considered] bad [by] people who think they know better and want to control others." At least, that's my read.

          By the way, cool feature :)

  • davidork 4 years ago

    Being that the vast majority of the public facing internet is ad driven there will always be some sort of leaning.

    Allowing the users to choose their own filters will allow advertisers to actually read the market based on the the sites that are whitelisted in the filters instead of shotgunning ads at any website that claims to be relevant to the target demographic they can actually see the popular ones that users choose based on these filters.

    its still targeted advertising, but abstracted one layer away from the actual user so that the targeted ads don't have to be as fucking creepy with all the data they're gathering on people. With the customer choosing what sites they want to see results from, the advertisers can stop wasting money on ad revenue for click farms that everyone hates.

    its a better deal for advertisers, and provides a better end result for the user and some degree of transparency.

    It can't make people accept inconvenient/uncomfortable facts, it won't solve any political problems. You can lead a horse to water but can't make it drink, you can point out any number of problems to a person but you cannot make them care.

    edit- relevant to solso's comment about an active choice

    The active choice democratizes the ad market allowing users to choose, instead of the passive route of allowing an algorithm to coerce the market.

    • slg 4 years ago

      >its still targeted advertising, but abstracted one layer away from the actual user so that the targeted ads don't have to be as fucking creepy with all the data they're gathering on people.

      How is it less creepy if the advertisers still end up with all the same data? Whether they snoop on my browsing history or snoop on my search rankings doesn't make any material difference to me. The problem is building a profile on me through snooping.