{ "info": { "author": "Mark Anderson", "author_email": "mark@m3b.net", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Environment :: Console", "Framework :: Scrapy", "Intended Audience :: Developers", "License :: OSI Approved :: BSD License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7", "Topic :: Utilities" ], "description": "==============================\nscrapy-feedexporter-azure-blob\n==============================\n\n.. image:: https://img.shields.io/pypi/v/scrapy-feedexporter-azure.svg\n :target: https://pypi.python.org/pypi/scrapy-feedexporter-azure-blob\n :alt: PyPI Version\n\n.. image:: https://img.shields.io/github/license/undernewmanagement/scrapy-feedexporter-azure-blob.svg\n :target: https://github.com/undernewmanagement/scrapy-feedexporter-azure-blob/blob/master/LICENSE\n :alt: License\n\n\nscrapy-feedexporter-azure is a `Scrapy Feed Exporter Storage Backend\n`_\nthat allows you to export `Scrapy items\n`_ to an Azure Blob Container.\n\nUsing scrapy-feedexporter-azure-blob\n====================================\n\nAdd a the following to your Scrapy settings::\n\n FEED_STORAGES = {\"azure\": \"scrapy_feedexporter_azure_blob.AzureBlobFeedStorage\"}\n\n FEED_URI = \"azure://accountname/container\"\n\n AZURE_ACCOUNT_NAME = \"mycrawldata\" # this is the subdomain to https://*.blob.core.windows.net/\n\n AZURE_ACCOUNT_KEY = \"your_account_key\"\n\n AZURE_CONTAINER = 'sites' # the name of the container (you should have already created it)\n\n AZURE_FILENAME = 'bob.json' # the name of the file as it will be in blob storage\n\n\nNote, you can define all of these settings when you run your crawler with the\n``-s`` command line switch:\n\n ``scrapy crawl -s AZURE_ACCOUNT_KEY='' -s AZURE_ACCOUNT_NAME=''``\n\nTODO\n====\nHave the feed exporter properly parse the FEED_URI string: ``azure://account_name:api_key@container/filename.json``\n\nDEVELOPER NOTES\n===============\nWhen deploying to pypi, just use twine", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/undernewmanagement/scrapy-feedexporter-azure-blob", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "scrapy-feedexporter-azure-blob", "package_url": "https://pypi.org/project/scrapy-feedexporter-azure-blob/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/scrapy-feedexporter-azure-blob/", "project_urls": { "Homepage": "https://github.com/undernewmanagement/scrapy-feedexporter-azure-blob" }, "release_url": "https://pypi.org/project/scrapy-feedexporter-azure-blob/0.2/", "requires_dist": [ "azure-storage" ], "requires_python": "", "summary": "Scrapy extension Feed Exporter Storage Backend to export items to a Azure blob container", "version": "0.2" }, "last_serial": 2176244, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "18e9cfb793fcd496b8a0368f778f2f61", "sha256": "76ff25471922bb6ddbe34e7731a34f5a1fdbd3145dc2d11a72150f1c3c067dc4" }, "downloads": -1, "filename": "scrapy_feedexporter_azure_blob-0.1-py3-none-any.whl", "has_sig": false, "md5_digest": "18e9cfb793fcd496b8a0368f778f2f61", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 4446, "upload_time": "2016-06-13T06:47:37", "url": "https://files.pythonhosted.org/packages/86/a6/771686b41aa0dbd9c5f110ce9e31d91044ced93c6f3c050bb6837f5fa61e/scrapy_feedexporter_azure_blob-0.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "7f5a052f4cea67f825cb2eb4c323ce80", "sha256": "9700b6a794c9d190f04d3cea9d85b8c9e365bda92a08f230f36566f622411822" }, "downloads": -1, "filename": "scrapy-feedexporter-azure-blob-0.1.tar.gz", "has_sig": false, "md5_digest": "7f5a052f4cea67f825cb2eb4c323ce80", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2359, "upload_time": "2016-06-13T06:47:42", "url": "https://files.pythonhosted.org/packages/11/66/037f48a9e65a2fd6ff05cb585a5efe3aeeaed7f8ab03b0f0ce02c257a5d6/scrapy-feedexporter-azure-blob-0.1.tar.gz" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "a89f97e013a12f95c69deaef82d64fd2", "sha256": "0ba79543654d6aa7bc932bf8649f209e8ef446e398c03465f1c7bc1be1293f1e" }, "downloads": -1, "filename": "scrapy_feedexporter_azure_blob-0.2-py2-none-any.whl", "has_sig": false, "md5_digest": "a89f97e013a12f95c69deaef82d64fd2", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 4717, "upload_time": "2016-06-19T20:20:07", "url": "https://files.pythonhosted.org/packages/6c/1a/2d1f4144ecf7a315d5275dc09f3d1e3f13e462737db8639edf63c303821b/scrapy_feedexporter_azure_blob-0.2-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "bff68bd95f6bd6b6707c88694904af54", "sha256": "0bdabad498f63fd30e4776a48d3402674b50dcc976993e33241ccfa385b8b563" }, "downloads": -1, "filename": "scrapy-feedexporter-azure-blob-0.2.tar.gz", "has_sig": false, "md5_digest": "bff68bd95f6bd6b6707c88694904af54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2638, "upload_time": "2016-06-19T20:20:11", "url": "https://files.pythonhosted.org/packages/04/af/3004d2dc95446481451885a33e82fffc4904f51614f855d66094df5e5b5a/scrapy-feedexporter-azure-blob-0.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "a89f97e013a12f95c69deaef82d64fd2", "sha256": "0ba79543654d6aa7bc932bf8649f209e8ef446e398c03465f1c7bc1be1293f1e" }, "downloads": -1, "filename": "scrapy_feedexporter_azure_blob-0.2-py2-none-any.whl", "has_sig": false, "md5_digest": "a89f97e013a12f95c69deaef82d64fd2", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 4717, "upload_time": "2016-06-19T20:20:07", "url": "https://files.pythonhosted.org/packages/6c/1a/2d1f4144ecf7a315d5275dc09f3d1e3f13e462737db8639edf63c303821b/scrapy_feedexporter_azure_blob-0.2-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "bff68bd95f6bd6b6707c88694904af54", "sha256": "0bdabad498f63fd30e4776a48d3402674b50dcc976993e33241ccfa385b8b563" }, "downloads": -1, "filename": "scrapy-feedexporter-azure-blob-0.2.tar.gz", "has_sig": false, "md5_digest": "bff68bd95f6bd6b6707c88694904af54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2638, "upload_time": "2016-06-19T20:20:11", "url": "https://files.pythonhosted.org/packages/04/af/3004d2dc95446481451885a33e82fffc4904f51614f855d66094df5e5b5a/scrapy-feedexporter-azure-blob-0.2.tar.gz" } ] }