python - unable to deploy portia spider with scrapyd-deploy -
could please me figure out i'm doing wrong ? here steps:
- followed portia install manual found here https://github.com/scrapinghub/portia - ok
- created new project, entered url, tagged item - ok
- clicked "continue browsing", browsed through site, items being extracted expected - ok
next wanted deploy spider:
1st try : tried run, docs specified, scrapyd-deploy your_scrapyd_target -p project_name
- got error - scrapyd wasn't installed fix: pip install scrapyd
2nd try : launched scrapyd server, accessed http://localhost:6800/
-all ok
after brief reading of scrapyd docs found out had edit file scrapy.cfg project : slyd/data/projects/new_project/scrapy.cfg
added following :
[deploy:local] url = http://localhost:6800/
went console, checked ok :
$:> scrapyd-deploy -l local http://localhost:6800/ $:> scrapyd-deploy -l local default
seemed ok gave try :
$scrapyd-deploy local -p default packing version 1418722113 deploying project "default" in http://localhost:6800/addversion.json server response (200): {"status": "error", "message": "ioerror: [errno 21] directory: '/users/mike/www/portia/slyd/data/projects/new_project'"}
what missing ?
for stumbles upon issue, fix deploy scrapyd in directory other of project. see details here : https://github.com/scrapinghub/portia/issues/128
Comments
Post a Comment