{ "info": { "author": "Kiran Koduru", "author_email": "kiranrkoduru@gmail.com", "bugtrack_url": null, "classifiers": [], "description": "=======\nArachne\n=======\n.. image:: https://travis-ci.org/kirankoduru/arachne.svg\n :target: https://travis-ci.org/kirankoduru/arachne\n\n.. image:: https://coveralls.io/repos/kirankoduru/arachne/badge.svg?branch=master&service=github\n :target: https://coveralls.io/github/kirankoduru/arachne?branch=master\n\nArachne provides a wrapper around your scrapy ``Spider`` object to run them through a flask app. All you have to do is customize ``SPIDER_SETTINGS`` in the settings file.\n\n\nInstallation\n============\nYou can install **Arachne** from pip \n\n\tpip install Arachne\n\n\nSample settings\n===============\nThis is sample settings file for spiders in your project. The settings file should be called **settings.py** for **Arachne** to find it and looks like this::\n\n\t# settings.py file\n\tSPIDER_SETTINGS = [\n\t\t{\n\t\t\t'endpoint': 'dmoz',\n\t\t\t'location': 'spiders.DmozSpider',\n\t\t\t'spider': 'DmozSpider' \n\t\t}\n\t]\n\nUsage\n=====\nIt looks very similar to a flask app but since **Scrapy** depends on the python **twisted** package, we need to run our flask app with **twisted**::\n\n\tfrom twisted.web.wsgi import WSGIResource\n\tfrom twisted.web.server import Site\n\tfrom twisted.internet import reactor\n\tfrom arachne import Arachne\n\n\tapp = Arachne(__name__)\n\n\tresource = WSGIResource(reactor, reactor.getThreadPool(), app)\n\tsite = Site(resource)\n\treactor.listenTCP(8080, site)\n\n\tif __name__ == '__main__':\n\t\treactor.run()", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Strahivan/arachne", "keywords": "", "license": "BSD", "maintainer": "", "maintainer_email": "", "name": "Arachne-Strahi", "package_url": "https://pypi.org/project/Arachne-Strahi/", "platform": "", "project_url": "https://pypi.org/project/Arachne-Strahi/", "project_urls": { "Homepage": "https://github.com/Strahivan/arachne" }, "release_url": "https://pypi.org/project/Arachne-Strahi/0.5.0/", "requires_dist": null, "requires_python": "", "summary": "API for Scrapy spiders, adjusted for Novelship", "version": "0.5.0" }, "last_serial": 3292662, "releases": { "0.5.0": [ { "comment_text": "", "digests": { "md5": "f6499e9d81be40a2f8357cde8064b407", "sha256": "9ed8cac23616eb2ec2d14aa1d39bd5b69448cc4f9c89ff4a5d1e0493d5462d53" }, "downloads": -1, "filename": "Arachne-Strahi-0.5.0.tar.gz", "has_sig": false, "md5_digest": "f6499e9d81be40a2f8357cde8064b407", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9102, "upload_time": "2017-10-30T22:02:16", "url": "https://files.pythonhosted.org/packages/9f/94/fb6d5689f91345a67813d5463f5a6ce18b689e2296817cf43c669a3cdfd5/Arachne-Strahi-0.5.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f6499e9d81be40a2f8357cde8064b407", "sha256": "9ed8cac23616eb2ec2d14aa1d39bd5b69448cc4f9c89ff4a5d1e0493d5462d53" }, "downloads": -1, "filename": "Arachne-Strahi-0.5.0.tar.gz", "has_sig": false, "md5_digest": "f6499e9d81be40a2f8357cde8064b407", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9102, "upload_time": "2017-10-30T22:02:16", "url": "https://files.pythonhosted.org/packages/9f/94/fb6d5689f91345a67813d5463f5a6ce18b689e2296817cf43c669a3cdfd5/Arachne-Strahi-0.5.0.tar.gz" } ] }