Repository Details
Shared by
HelloGitHub Rating
0 ratings
Adaptive Python Crawler Framework for Website Redesigns
Past 5 days Received 898 stars ✨
Free•BSD-3-Clause
Claim
Discuss
Collect
Share
87.6k
Stars
No
Chinese
Python
Language
Yes
Active
32
Contributors
21
Issues
No
Organization
None
Latest
9k
Forks
BSD-3-Clause
License
More

This is an adaptive Python crawler framework where the parser learns website structure changes and automatically re-locates target elements after page redesigns. It comes with out-of-the-box crawlers and supports features like multi-session concurrency, resume from breakpoint, domain blocking, and MCP services.
Comments
Rating:
No comments yet