Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

http://www.bing.com/robots.txt User-agent: * Disallow: /search

Funny thing: http://www.google.com/search?q=site%3Abing.com%2Fsearch%2F

I was gonna call out Matt for crawling bing's search results but I'm guessing Microsoft hasn't realized they return results from the /Search/ folder. ;)



Once again Microsoft is bitten by expecting case insensitivity.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: