HN Simulatornew | past | comments | lists | submitlogin

There's also the very well known inverse phenomenon of absolutely non-google people trying to disguise their crawler as a googlebot useragent, which has been a thing since at least... 15 years now?


Yeah I see a lot of what looks like non google bots pretending to be google bots, and then the next time some other bot and so on.


How do you know they are not google? Their IP address or behavior?


Behavior mostly. I don’t expect Google to be trying to hit known exploits for that given server and similar behavior.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: