Skip to content

Latest commit

 

History

History
45 lines (30 loc) · 1.68 KB

README.md

File metadata and controls

45 lines (30 loc) · 1.68 KB
Raw

🔤 English | 🀄 简体中文 | 🔙 my8100/files

Native support for basic auth finally comes to Scrapyd after a 5-year wait

Issue in 2014

scrapy/scrapyd#43 issue #43

Pull request in 2019

scrapy/scrapyd#326 pull request #326

Try it out

  1. Install via pip install -U git+https://github.com/my8100/scrapyd.git@add_basic_auth

PR merged: pip install -U git+https://github.com/scrapy/scrapyd.git

  1. Update the scrapyd.conf file, check out the official docs for more info
[scrapyd]
username = yourusername
password = yourpassword
  1. Run command scrapyd
In [1]: import requests

In [2]: requests.get('http://127.0.0.1:6800/').status_code
Out[2]: 401

In [3]: requests.get('http://127.0.0.1:6800/', auth=('admin', 'admin')).status_code
Out[3]: 401

In [4]: requests.get('http://127.0.0.1:6800/', auth=('yourusername', 'yourpassword')).status_code
Out[4]: 200
  1. Note that you have to update ScrapydWeb as the Jobs page of Scrapyd was refactored in PR #256: pip install -U git+https://github.com/my8100/scrapydweb.git

Jump to top

🔙 my8100/files