Skip to content

Releases: scrapinghub/frontera

v0.2.0

12 Jan 23:42
Compare
Choose a tag to compare
  • Added documentation (Scrapy Seed Loaders+Tests+Examples)
  • Refactored backend tests
  • Added requests library example
  • Added requests library manager and object converters
  • Added FrontierManagerWrapper
  • Added frontier object converters
  • Fixed script examples for new changes
  • Optional Color logging (only if available)
  • Changed Scrapy frontier and recorder integration to scheduler+middlewares
  • Changed default frontier backend
  • Added comment support to seeds
  • Added doc requirements for RTD build
  • Removed optional dependencies for setup.py and requirements
  • Changed tests to pytest
  • Updated docstrings and documentation
  • Changed frontier componets (Backend and Middleware) to abc
  • Modified Scrapy frontier example to use seed loaders
  • Refactored Scrapy Seed loaders
  • Added new fields to Request and Response frontier objects
  • Added ScrapyFrontierManager (Scrapy wrapper for Frontier Manager)
  • Changed frontier core objects (Page/Link to Request/Response)

First release of Crawl Frontier

07 Dec 16:55
Compare
Choose a tag to compare