Repository Details
Shared by
HelloGitHub Rating
0 ratings
Crawler Framework that Mimics Human Behavior
Past 6 days Received 59 stars ✨
Use arrow keys to explore dates, Home and End for the first and last date, Escape to dismiss.| Date | Star | Daily change |
|---|---|---|
| 周日 | 26,379 | — |
| 周一 | 26,396 | +17 |
| 周二 | 26,411 | +15 |
| 周三 | 26,423 | +12 |
| 周四 | 26,432 | +9 |
| 周五 | 26,438 | +6 |
26.4k
Stars
No
Chinese
TypeScript
Language
Yes
Active
164
Contributors
140
Issues
Yes
Organization
None
Latest
2k
Forks
Apache-2.0
License

This is a web scraping and browser automation library characterized by its ability to write crawlers that are not easily detected (blocked/ban). It offers a robust proxy pool feature that can switch and remove invalid IPs automatically based on actual traffic, supports headless browser, simulated browser, and TLS fingerprint behaviors, as well as JavaScript rendering, screen capture, and browser automation features such as Puppeteer. In addition to the NPM package, there is also the latest open-source Python library.
Comments
Rating:
No comments yet