下拉刷新
Repository Details
Shared bynavbar_avatar
repo_avatar
HelloGitHub Rating
0 ratings
Crawler Framework that Mimics Human Behavior
FreeApache-2.0
Claim
Collect
Share
15.4k
Stars
No
Chinese
TypeScript
Language
Yes
Active
95
Contributors
131
Issues
Yes
Organization
3.11.5
Latest
661
Forks
Apache-2.0
License
More
crawlee image
This is a web scraping and browser automation library characterized by its ability to write crawlers that are not easily detected (blocked/ban). It offers a robust proxy pool feature that can switch and remove invalid IPs automatically based on actual traffic, supports headless browser, simulated browser, and TLS fingerprint behaviors, as well as JavaScript rendering, screen capture, and browser automation features such as Puppeteer. In addition to the NPM package, there is also the latest open-source Python library.

Comments

Rating:
No comments yet