Repository Details
Shared by
HelloGitHub Rating
0 ratings
Adaptive Python Crawler Framework for Website Redesigns
Past 7 days Received 702 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
70k
Stars
No
Chinese
Python
Language
Yes
Active
27
Contributors
4
Issues
No
Organization
0.4.11
Latest
7k
Forks
BSD-3-Clause
License
More

This is an adaptive Python crawler framework where the parser learns website structure changes and automatically re-locates target elements after page redesigns. It comes with out-of-the-box crawlers and supports features like multi-session concurrency, resume from breakpoint, domain blocking, and MCP services.
Comments
Rating:
No comments yet