{ "info": { "author": "Manish Sinha", "author_email": "masinha@microsoft.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 2 - Pre-Alpha", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7" ], "description": "==========================\nDask Azure Blob FileSystem\n==========================\n\nAzure Blob Storage Backend for Dask\n\n.. image:: https://travis-ci.org/manish/dask-azureblobfs.svg?branch=master\n :target: https://travis-ci.org/manish/dask-azureblobfs\n\n.. image:: https://readthedocs.org/projects/dask-azureblobfs/badge/?version=latest\n :target: https://dask-azureblobfs.readthedocs.io/en/latest/?badge=latest\n :alt: Documentation Status\n\n\nFeatures\n--------\n\n* Supports dask when your data files are stored in the cloud.\n\n * Import ``DaskAzureBlobFileSystem``\n\n * Use ``abfs://`` as protocol prefix and you are good to do.\n\n* For authentication, please read more on Usage_.\n\n* Support for key-value storage which is backed by azure storage. Create an instance of ``AzureBlobMap``\n\n\nUsage\n-----\n\nMake the right imports::\n\n from azureblobfs.dask import DaskAzureBlobFileSystem\n import dask.dataframe as dd\n\nthen put all data files in an azure storage container say ``clippy``, then you can read it::\n\n data = dd.read_csv(\"abfs://noaa/clippy/weather*.csv\")\n max_by_state = data.groupby(\"states\").max().compute()\n\nyou would need to set your azure account name in environment variable ``AZURE_BLOB_ACCOUNT_NAME``\n(which in our above example is ``noaa``) and the account key in ``AZURE_BLOB_ACCOUNT_KEY``.\n\nIf you don't want to use account key and instead want to use SAS, set it in the\nenvironment variable ``AZURE_BLOB_SAS_TOKEN`` along with the connection string in the\nenvironment variable ``AZURE_BLOB_CONNECTION_STRING``.\n\nInstallation\n------------\n\nJust::\n\n pip install dask-azureblobfs\n\nor get the development version if you love to live dangerously::\n\n pip install git+https://github.com/manish/dask-azureblobfs@master#egg=dask-azureblobfs\n\nCredits\n-------\n\nThis package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.\n\n.. _Usage: https://dask-azureblobfs.readthedocs.io/en/latest/usage.html\n.. _Cookiecutter: https://github.com/audreyr/cookiecutter\n.. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage\n\n\n=======\nHistory\n=======\n\n0.1.0 (2018-11-18)\n------------------\n\n* First release on PyPI.\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/manish/dask-azureblobfs", "keywords": "azureblobfs", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "dask-azureblobfs", "package_url": "https://pypi.org/project/dask-azureblobfs/", "platform": "", "project_url": "https://pypi.org/project/dask-azureblobfs/", "project_urls": { "Homepage": "https://github.com/manish/dask-azureblobfs" }, "release_url": "https://pypi.org/project/dask-azureblobfs/0.1.0/", "requires_dist": [ "dask", "azure-storage-blob" ], "requires_python": "", "summary": "Azure Blob Storage Backend for Dask", "version": "0.1.0" }, "last_serial": 4554191, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "2b16c91c41027031a02db4710db1abd6", "sha256": "d06b8ab74cd3771f0e429008fd04623246a94d025a2256fb0b31abc51317ecaf" }, "downloads": -1, "filename": "dask_azureblobfs-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "2b16c91c41027031a02db4710db1abd6", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9296, "upload_time": "2018-12-03T03:07:35", "url": "https://files.pythonhosted.org/packages/e3/71/3196bd5a61e7292da59e69b9b07dd4ee01e245a9327696177c1bdd0321f3/dask_azureblobfs-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "cebfec2784d58ed306cf0c46648b6f28", "sha256": "4214ab2eb70d7efe7f2b9b32a7b6b395d03092e245e13ad8e764472ff5cf7181" }, "downloads": -1, "filename": "dask-azureblobfs-0.1.0.tar.gz", "has_sig": false, "md5_digest": "cebfec2784d58ed306cf0c46648b6f28", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4625875, "upload_time": "2018-12-03T03:07:39", "url": "https://files.pythonhosted.org/packages/ae/69/ac55acde2ad9902764a7f04175abf02c01ad6b1feef2494f26ea53c1839d/dask-azureblobfs-0.1.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "2b16c91c41027031a02db4710db1abd6", "sha256": "d06b8ab74cd3771f0e429008fd04623246a94d025a2256fb0b31abc51317ecaf" }, "downloads": -1, "filename": "dask_azureblobfs-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "2b16c91c41027031a02db4710db1abd6", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9296, "upload_time": "2018-12-03T03:07:35", "url": "https://files.pythonhosted.org/packages/e3/71/3196bd5a61e7292da59e69b9b07dd4ee01e245a9327696177c1bdd0321f3/dask_azureblobfs-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "cebfec2784d58ed306cf0c46648b6f28", "sha256": "4214ab2eb70d7efe7f2b9b32a7b6b395d03092e245e13ad8e764472ff5cf7181" }, "downloads": -1, "filename": "dask-azureblobfs-0.1.0.tar.gz", "has_sig": false, "md5_digest": "cebfec2784d58ed306cf0c46648b6f28", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4625875, "upload_time": "2018-12-03T03:07:39", "url": "https://files.pythonhosted.org/packages/ae/69/ac55acde2ad9902764a7f04175abf02c01ad6b1feef2494f26ea53c1839d/dask-azureblobfs-0.1.0.tar.gz" } ] }