{ "info": { "author": "Pablo SEMINARIO", "author_email": "pabluk@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "Intended Audience :: Developers", "License :: OSI Approved :: GNU General Public License v3 (GPLv3)", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Topic :: Internet :: WWW/HTTP", "Topic :: Software Development :: Libraries :: Application Frameworks", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "A Scrapy extension to be used, for example, with `HTTP Callback Tasks `_\r\nof Celery project.\r\n\r\n------------\r\nInstallation\r\n------------\r\n\r\nInstall via pip::\r\n\r\n pip install scrapy-notifications\r\n\r\nTested with\r\n\r\n* Python 2.7+\r\n* Scrapy 0.16\r\n\r\n-----\r\nSetup\r\n-----\r\n\r\nBasically you need configure ``SPIDER_NOTIFICATION_ENABLED``,\r\n``SPIDER_NOTIFICATION_URL`` and add the\r\n``scrapy_notifications.extensions.SpiderNotification`` extension to your\r\nScrapy project ``settings.py``.\r\n\r\nExample::\r\n\r\n EXTENSIONS = {\r\n 'scrapy_notifications.extensions.SpiderNotification': 500,\r\n }\r\n SPIDER_NOTIFICATION_ENABLED = True\r\n SPIDER_NOTIFICATION_URL = 'http://app.example.com/spider-task/'\r\n\r\nBy default HTTP requests are sent with the spider name attribute as an URL\r\nparameter.\r\nBut optionally you can also specify a list of spider attributes passed as\r\nURL parameters on ``SPIDER_NOTIFICATION_ATTRS``.::\r\n\r\n SPIDER_NOTIFICATION_ATTRS = ['name', 'jobid']\r\n\r\n-----\r\nUsage\r\n-----\r\n\r\nFor example crawling with the ``dmoz`` spider used in the\r\n`Scrapy tutorial `_::\r\n\r\n scrapy crawl -a jobid=fe648c57f8 dmoz\r\n\r\nwill generate a HTTP request like this::\r\n\r\n http://app.example.com/spider-task/?name=dmoz&jobid=fe648c57f8\r\n\r\nContributing\r\n------------\r\n\r\nWant to contribute? Great! Bug reports and code and documentation patches are greatly appretiated.\r\nPlease file bugs and send pull requests using the `issue tracker `_.", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/pabluk/scrapy-notifications", "keywords": "", "license": "GNU General Public License v3 (GPLv3)", "maintainer": "", "maintainer_email": "", "name": "scrapy-notifications", "package_url": "https://pypi.org/project/scrapy-notifications/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/scrapy-notifications/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/pabluk/scrapy-notifications" }, "release_url": "https://pypi.org/project/scrapy-notifications/0.1.0/", "requires_dist": null, "requires_python": null, "summary": "Send HTTP notifications on spider actions", "version": "0.1.0" }, "last_serial": 772445, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "24ebb7f076f2be9ad09133e81f411c1b", "sha256": "17fd95ee4f66a66cd2a7c45fea1d51612f7f1b6c82b9c47f7e454cfd42189206" }, "downloads": -1, "filename": "scrapy-notifications-0.1.0.tar.gz", "has_sig": false, "md5_digest": "24ebb7f076f2be9ad09133e81f411c1b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2344, "upload_time": "2013-06-15T22:21:40", "url": "https://files.pythonhosted.org/packages/5e/90/582f7443f106f2de57449f17d551171e2dce9b4cf869fe14827c939547cd/scrapy-notifications-0.1.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "24ebb7f076f2be9ad09133e81f411c1b", "sha256": "17fd95ee4f66a66cd2a7c45fea1d51612f7f1b6c82b9c47f7e454cfd42189206" }, "downloads": -1, "filename": "scrapy-notifications-0.1.0.tar.gz", "has_sig": false, "md5_digest": "24ebb7f076f2be9ad09133e81f411c1b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2344, "upload_time": "2013-06-15T22:21:40", "url": "https://files.pythonhosted.org/packages/5e/90/582f7443f106f2de57449f17d551171e2dce9b4cf869fe14827c939547cd/scrapy-notifications-0.1.0.tar.gz" } ] }