polite - Be Nice on the Web
Be responsible when scraping data from websites by following polite principles: introduce yourself, ask for permission, take slowly and never ask twice.
Last updated 1 years ago
crawlermemoiserate-limiterrobotstxtrvestscraperwebscraping
323 stars 8.44 score 58 dependencies 3 dependents