Repository Details
Shared by
HelloGitHub Rating
0 ratings
Adaptive Python Crawler Framework for Website Redesigns
Past 2 days Received 251 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
66.7k
Stars
No
Chinese
Python
Language
Yes
Active
21
Contributors
11
Issues
No
Organization
0.4.9
Latest
7k
Forks
BSD-3-Clause
License
More

This is an adaptive Python crawler framework where the parser learns website structure changes and automatically re-locates target elements after page redesigns. It comes with out-of-the-box crawlers and supports features like multi-session concurrency, resume from breakpoint, domain blocking, and MCP services.
Comments
Rating:
No comments yet