I've never used these bet markets. It seems everyone under 30 I talked to is very familiar with them, I see many young devs build projects around them.
I guess my q is this a generation gap? are we too old so we dislike it?
Those identified themselves are not the worst ones.
I have seen crawlers fake chrome and edge from a set of Brazil residential IPs crawling at 1.5m req/hour for 3 hours, and it comes back every four weeks at same time.
I'm unclear what you are asking or getting at, so I'm not sure how to reply, but...
I will say that Michael Sandel and Daron Acemoglu are two speakers and teachers (and friends of each other) that have some very interesting things to say about our current situations, how we got here, how we move beyond.
in the 2026th year of our Lord, why are you pretending to believe a business to care about the public benefit?
anthropic bad not because it makes profit (FYI, it doesn't). anthropic bad because its PR and marketing departments have adopted a strategy of concealing their stakeholders' regulatory capture efforts behind the obnoxious narrative of it being the only company that can be trusted with the technology. this particular fluff is an effort to demonstrate how heckin' wholesome they are.
One thing I see on the new gen of ai search bots are they fake chrome and rarely disclose themselves in UA, and not respect robots.txt, and no rate control for smaller sites.
I’m not accusing any one engine discussed in this thread, but hearing a proxy vender like decodo providing search give me a feeling there’s non zero over lap to bad search and residential proxy crawler.
Real human hit once with disguised ua is fine, but I’ve seem a few million clearly batch crawl request within a few minutes hitting my potato server from thousands of IP addresses, and they do it every four weeks almost at same hours. cloudflare doesn’t help much if at all, I can do proof of work but it creates problems for real human, I can rewrite in rust with some sophisticated cache but i don’t want to.
Anyway I’m not expecting a solution. Just say this sux.
These code run on meat. Meat is not silicon, and it executes same code very differently. President can be king, etc.
reply