I do a lot of web scraping that requires a full browser for some websites. This ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

squeaky-clean on Aug 16, 2017 | parent | context | favorite | on: Puppeteer: Headless Chrome Node API

I do a lot of web scraping that requires a full browser for some websites. This sounds perfect for me. I often use Selenium, but it's a lot of complexity and quite buggy if I just want to run chrome (or any one browser, but not all browsers).

shimon_e on Aug 16, 2017 [–]

Have you tried TestCafe? I have had good experience with TestCafe on a recent project. The development team are very responsive to bug fixing and stability.

squeaky-clean on Aug 17, 2017 | [–]

Hadn't heard of it before, I have an upcoming project that's going to need some JS scraping, so I'll give this a shot as well as Puppeteer. Thanks!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact