Does SearX let you filter out search results from certain sites? I really need to start filtering domains of content-mills entirely. Yes I know they're cropping up constantly, but that doesn't mean I have to keep seeing the same ones. Next step is to filter every domain that uses NameCheap as a registrar.
@freakazoid Not natively, but here's what I do:
Search request goes into Searx via REST API.
Search request comes back as JSON events.
For each URL, use a Website Agent to run it past a whois lookup API. Grab the registrar from the results (in your case), append to the end as a new key.
Run the event through a Pattern Detector. If the registrar key matches Namecheap, drop the event.
@drwho Given how popular it is to abuse whois APIs, I'm guessing I won't be able to find one I can do that with without paying.
@freakazoid Because I've never tried, how hard can you hit a whois service with the plain old CLI util before you get blocked?
A social network for the 19A0s.