{ "info": { "author": "James Mills", "author_email": "James Mills, j dot mills at griffith dot edu dot au", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Operating System :: MacOS :: MacOS X", "Operating System :: POSIX :: Linux", "Programming Language :: Python :: 2.7" ], "description": ".. _Python: http://www.python.org/\n.. _funcy: http://pypi.python.org/pypi/funcy\n.. _py: http://pypi.python.org/pypi/py\n.. _Griffith University: http://www.griffith.edu.au/\n.. _TerraNova: https://terranova.org.au/\n.. _Climate Change and Adaptation Visualization: http://ccav.terranova.org.au/\n.. _Project Website: http://bitbucket.org/prologic/streamio\n.. _PyPi Page: http://pypi.python.org/pypi/streamio\n.. _Read the Docs: http://streamio.readthedocs.org/en/latest/\n.. _Downloads Page: https://bitbucket.org/prologic/streamio/downloads\n.. _API: http://streamio.readthedocs.org/en/latest/api/\n\n\nstreamio is a simple library of functions designed to read, write and sort large files using iterators so that the operations will successfully complete\non systems with limited RAM. This library has been used extensively at `Griffith University`_ whilst developing the `TerraNova`_\n`Climate Change and Adaptation Visualization`_ tool(s) and processing large volumes of data. streamio is written in `Python`_ and has extensive documentation\nand unit tests with 100% coverage.\n\nSee the `API`_ for a list of the available functions.\n\n- Visit the `Project Website`_\n- `Read the Docs`_\n- Download it from the `Downloads Page`_\n\n.. image:: https://pypip.in/v/streamio/badge.png\n :target: https://crate.io/packages/streamio/\n :alt: Latest PyPI version\n\n.. image:: https://pypip.in/d/streamio/badge.png\n :target: https://crate.io/packages/streamio/\n :alt: Number of PyPI downloads\n\n.. image:: https://jenkins.shiningpanda-ci.com/prologic/job/streamio/badge/icon\n :target: https://jenkins.shiningpanda-ci.com/prologic/job/streamio/\n :alt: Build Status\n\n.. image:: https://requires.io/bitbucket/prologic/streamio/requirements.png?branch=default\n :target: https://requires.io/bitbucket/prologic/streamio/requirements/?branch=default\n :alt: Requirements Status\n\n\nExamples\n--------\n\n\nRead a large text file iteratively:\n\n.. code-block:: python\n \n from streamio import stream\n f = stream(\"large_file.txt\")\n \n\nRead a large CSV file iteratively:\n\n.. code-block:: python\n \n from streamio import jsonstream\n f = stream(\"large_file.json\")\n \n\nMerge-sort a large JSON file with the key ``itemgetter(\"value\")``:\n\n.. code-block:: python\n \n from operator import itemgetter\n from streamio import mergesort\n f = mergesort(\"large_file.json\", key=itemgetter(\"value\"))\n \n\nRequirements\n------------\n\n- `funcy`_\n- `py`_\n\nstreamio also comes with documentation and a full comprehensive unit test suite which require the following:\n\nTo build the docs:\n\n- `sphinx `_\n\nTo run the unit tests:\n\n- `pytest `_\n\n\nInstallation\n------------\n\nThe simplest and recommended way to install streamio is with pip.\nYou may install the latest stable release from PyPI with pip::\n\n > pip install streamio\n\nIf you do not have pip, you may use easy_install::\n\n > easy_install streamio\n\nAlternatively, you may download the source package from the\n`PyPI Page`_ or the `Downloads page`_ on the `Project Website`_;\nextract it and install using::\n\n > python setup.py install\n\nYou can also install the\n`latest-development version `_ by using ``pip`` or ``easy_install``::\n \n > pip install streamio==dev\n\nor::\n \n > easy_install streamio==dev\n\n\nFor further information see the `streamio documentation `_.\n\n\nSupported Platforms\n-------------------\n\n- Linux, FreeBSD, Mac OS X\n- Python 2.7\n- PyPy 2.2\n\n**Windows**: We acknowledge that Windows exists and make reasonable efforts\n to maintain compatibility. Unfortunately we cannot guarantee\n support at this time.\n\n\nChanges\n-------\n\n\nstreamio 0.0.9 (*2014-02-27*)\n.............................\n\n- Bumped py 1.4.19 -> 1.4.20\n\n\nstreamio 0.0.8 (*2014-02-13*)\n.............................\n\n- Fixed Unicode support for ``csvstream`` adding `unicodecsv `_ as a new dependency.\n\n\nstreamio 0.0.7 (*2014-01-29*)\n.............................\n\n- Forgot to include required README.rst and CHANGES.rst\n\n\nstreamio 0.0.6 (*2014-01-29*)\n.............................\n\n- Don't include fabfile and tests (for now) in the resulting egg\n- Make ``mergesort`` show progress optionally via ``progress=True``\n\n\nstreamio 0.0.5 (*2014-01-16*)\n.............................\n\n- Added ``encoding`` parameter support to ``*stream()`` function(s).\n\n\nstreamio 0.0.4 (*2013-11-22*)\n.............................\n\n- Added ``streamio.stream.compress`` function for compressing an iterable using zlib compression.\n- Loosended requirements on ``py`` and ``progress``\n\n\nstreamio 0.0.3 (*2013-11-21*)\n.............................\n\n- Fixed broken link to the API Docs.\n\n\nstreamio 0.0.2 (*2013-11-21*)\n.............................\n\n- Added some examples\n- Fixed a few typos\n\n\nstreamio 0.0.1 (*2013-11-21*)\n.............................\n\n- Initial Public Release", "description_content_type": null, "docs_url": "https://pythonhosted.org/streamio/", "download_url": "https://bitbucket.org/prologic/streamio/downloads/", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://bitbucket.org/prologic/streamio", "keywords": "Python Large Files Reading Writing Sorting Streaming", "license": "MIT", "maintainer": null, "maintainer_email": null, "name": "streamio", "package_url": "https://pypi.org/project/streamio/", "platform": "POSIX", "project_url": "https://pypi.org/project/streamio/", "project_urls": { "Download": "https://bitbucket.org/prologic/streamio/downloads/", "Homepage": "https://bitbucket.org/prologic/streamio" }, "release_url": "https://pypi.org/project/streamio/0.0.9/", "requires_dist": null, "requires_python": null, "summary": "reading, writing and sorting large files", "version": "0.0.9" }, "last_serial": 1014345, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "248b811dac270eba5b8ad8186b39f6b2", "sha256": "d2f225690794b1fa9e9d96d485464b403d9d4eda004e57ade2a8273253d8cac2" }, "downloads": -1, "filename": "streamio-0.0.1-py2.7.egg", "has_sig": false, "md5_digest": "248b811dac270eba5b8ad8186b39f6b2", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 27745, "upload_time": "2013-11-21T02:05:12", "url": "https://files.pythonhosted.org/packages/ef/83/6746d51a55eed5b69cb0860ba0ccb8abb3b5238fc0fcdbec454fafbafd30/streamio-0.0.1-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "80d8ad4f5a8aa7eada51a36a271fa817", "sha256": "506a7b3f5bc215c853f324c976cb0aa584079876bf34d0a49ffd76578ec1b5ad" }, "downloads": -1, "filename": "streamio-0.0.1.tar.gz", "has_sig": false, "md5_digest": "80d8ad4f5a8aa7eada51a36a271fa817", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 166848, "upload_time": "2013-11-21T02:05:08", "url": "https://files.pythonhosted.org/packages/b0/a5/d94a2350fff36355d9469a01e5be3f2f92f0af29da4cb972eb5c2dcdea58/streamio-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "83a3821ff9b7abdd70af5a839615e71e", "sha256": "993d51fa83d4e88de910ccfcdd519716d7627e8d2e9369b6a8c00eb1b493658f" }, "downloads": -1, "filename": "streamio-0.0.2-py2.7.egg", "has_sig": false, "md5_digest": "83a3821ff9b7abdd70af5a839615e71e", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 27691, "upload_time": "2013-11-21T02:45:22", "url": "https://files.pythonhosted.org/packages/22/3c/cf1a994b3801452a0609411ea1efe8accc71ccf4c789d1e26dbf3c8e1345/streamio-0.0.2-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "6ba7011bc57e5f589579d40836f2a146", "sha256": "11efb731ec844da4c81c1e689fb98e614b274210444acfaf1e8ba118b9297a78" }, "downloads": -1, "filename": "streamio-0.0.2.tar.gz", "has_sig": false, "md5_digest": "6ba7011bc57e5f589579d40836f2a146", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 167159, "upload_time": "2013-11-21T02:45:19", "url": "https://files.pythonhosted.org/packages/60/20/c98ed985cd4192c4b0db00d1788645ec7f6c20a66a68f103672d740f78db/streamio-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "4a153d09c79886fd457c2cc879c2c5f2", "sha256": "fa50ceb7a81ec930917cc07ed5d2e72a54f7c4ca01b8b1fad5a397e27467ac77" }, "downloads": -1, "filename": "streamio-0.0.3-py2.7.egg", "has_sig": false, "md5_digest": "4a153d09c79886fd457c2cc879c2c5f2", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 27588, "upload_time": "2013-11-21T11:50:55", "url": "https://files.pythonhosted.org/packages/3e/40/ed1492b411e581d920c610f2e167c31b5d9043046d1459fdbe4dcc5f9f5b/streamio-0.0.3-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "8a86ae53cfc503c304eb188d5ad6dc2a", "sha256": "3031b2c057225794b5d698b1b0534ba4436b1d4ffd20e8376b21f7ef44bec38c" }, "downloads": -1, "filename": "streamio-0.0.3.tar.gz", "has_sig": false, "md5_digest": "8a86ae53cfc503c304eb188d5ad6dc2a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 149932, "upload_time": "2013-11-21T11:50:51", "url": "https://files.pythonhosted.org/packages/4f/54/1083432a34e1140a43443e621f1a87404429ec93958d8e1719bbf673d119/streamio-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "76aba40a42da63593a57ac71133f6201", "sha256": "a137d7dca53a2a958d43c8de13d3e3e275dbe8579bb840b604774c2f9eb44aca" }, "downloads": -1, "filename": "streamio-0.0.4-py2.7.egg", "has_sig": false, "md5_digest": "76aba40a42da63593a57ac71133f6201", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 29586, "upload_time": "2013-11-22T01:40:15", "url": "https://files.pythonhosted.org/packages/7b/68/dc63087f6231abee398e81f2e9b7c120eec0cf8141aeafd87de78966faa6/streamio-0.0.4-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "8e2338bf887d72c802d0bb89961a7791", "sha256": "bee20aa6910e8a48f570ed45a402f5f67347d528f8a9d6118ba3a72a96c8c1d8" }, "downloads": -1, "filename": "streamio-0.0.4.tar.gz", "has_sig": false, "md5_digest": "8e2338bf887d72c802d0bb89961a7791", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 176192, "upload_time": "2013-11-22T01:40:13", "url": "https://files.pythonhosted.org/packages/e8/5e/48278127dffe7f94974d9d82b85e38dfa1ee713701accc22f896bc80d727/streamio-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "b804856b07f659a6769c818dcc52b769", "sha256": "03a4ee3a233d5f2eb8a7f6c643b8b63353c8dcd9d4f557e68febb13bfb9e70ef" }, "downloads": -1, "filename": "streamio-0.0.5-py2.7.egg", "has_sig": false, "md5_digest": "b804856b07f659a6769c818dcc52b769", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 30749, "upload_time": "2014-01-16T04:58:35", "url": "https://files.pythonhosted.org/packages/47/93/afbe0b779808f012950e5d09613e637333543fbce4dce35f154c38829fdb/streamio-0.0.5-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "0d32b0f3470c1ada360dad842be1b1ce", "sha256": "bde5609b0929f9afddc9aec0ff427e6dae5959caf39af7c65f09a3032708d741" }, "downloads": -1, "filename": "streamio-0.0.5.tar.gz", "has_sig": false, "md5_digest": "0d32b0f3470c1ada360dad842be1b1ce", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 173901, "upload_time": "2014-01-16T04:58:32", "url": "https://files.pythonhosted.org/packages/b1/ae/cc90bf9ade013fd148008bab727ef42476fae204e04560a4f19ea05eeaa1/streamio-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "e82c3a6a4173101848654bf8740ba441", "sha256": "a877a68c1d2c568e5933ab7aa9abbb1b870fc1128635027beaa928c999eaf157" }, "downloads": -1, "filename": "streamio-0.0.6-py2.7.egg", "has_sig": false, "md5_digest": "e82c3a6a4173101848654bf8740ba441", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 14501, "upload_time": "2014-01-29T02:52:11", "url": "https://files.pythonhosted.org/packages/af/1f/f2cb4808f99a8fb88eb077751aeb952380b9a9b38939359e9fea00f14acc/streamio-0.0.6-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "5a9ffd0bd290043364dc8586e12f5ff4", "sha256": "4791ac87828bcaeeddc314a1b51c90679bf5ff5cd2472d14d66c1a03b1728dd6" }, "downloads": -1, "filename": "streamio-0.0.6.tar.gz", "has_sig": false, "md5_digest": "5a9ffd0bd290043364dc8586e12f5ff4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13125, "upload_time": "2014-01-29T02:52:06", "url": "https://files.pythonhosted.org/packages/58/ef/174e4a4ed078130043f9052207f906aa2f723660669a5c0087ad20ec2075/streamio-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "35de0fae798642a2af02a8c90c609b0b", "sha256": "aa208b444536071ec78baf155a8069c68e6abf039724a6888c0ac327a6ab6dd8" }, "downloads": -1, "filename": "streamio-0.0.7-py2.7.egg", "has_sig": false, "md5_digest": "35de0fae798642a2af02a8c90c609b0b", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 14544, "upload_time": "2014-01-29T04:13:51", "url": "https://files.pythonhosted.org/packages/e5/4f/9daf559af9962fefa70b5f954683eac99f4baf41e1c460f13680f860185f/streamio-0.0.7-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "bf59d25ef72c0db1932d05c5412665fd", "sha256": "8ce71395cc8326a680a986f348835f7e052789a43809023bf2f985a0751f0812" }, "downloads": -1, "filename": "streamio-0.0.7.tar.gz", "has_sig": false, "md5_digest": "bf59d25ef72c0db1932d05c5412665fd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13287, "upload_time": "2014-01-29T04:13:46", "url": "https://files.pythonhosted.org/packages/4b/4f/2508e4eb73c9150c81090767bb15edda7f2c5143e89535a0b7c0d53bf29a/streamio-0.0.7.tar.gz" } ], "0.0.8": [ { "comment_text": "", "digests": { "md5": "e66c2a17b9d3f3e4ec6fa9f09feedb69", "sha256": "53207116e1204c12970250d32f8cd7fe70da4cdf02a28ea020d29b0a4d5639cc" }, "downloads": -1, "filename": "streamio-0.0.8-py2.7.egg", "has_sig": false, "md5_digest": "e66c2a17b9d3f3e4ec6fa9f09feedb69", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 14868, "upload_time": "2014-02-13T04:05:18", "url": "https://files.pythonhosted.org/packages/39/c5/2ea63bed701c78a692240f5404f3e603204aa3ae9d435d668ffbdec3580d/streamio-0.0.8-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "968b1e58922364ba39649f0a3e16a10c", "sha256": "dea713aa822becbb41c2b52bba2543ce294543f7a30b055b8bbb089468651c25" }, "downloads": -1, "filename": "streamio-0.0.8.tar.gz", "has_sig": false, "md5_digest": "968b1e58922364ba39649f0a3e16a10c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13596, "upload_time": "2014-02-13T04:05:14", "url": "https://files.pythonhosted.org/packages/15/af/dfbb31fff58292c9cb756bea7d5a593ad68354010129a06790e02c113931/streamio-0.0.8.tar.gz" } ], "0.0.9": [ { "comment_text": "", "digests": { "md5": "45151b9f9519b891218851a0d8ab89fb", "sha256": "371fbc90728878d58489cf82e1f88c4a708d099743d526f14e6776ee31770958" }, "downloads": -1, "filename": "streamio-0.0.9-py2.7.egg", "has_sig": false, "md5_digest": "45151b9f9519b891218851a0d8ab89fb", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 14900, "upload_time": "2014-02-27T23:01:18", "url": "https://files.pythonhosted.org/packages/99/dc/e7dfd636fd3457b6409a365b0e2e8ce74254129ef1be0f4d112cdb536b66/streamio-0.0.9-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "beca537544b5347dbb823bf5f8614261", "sha256": "02f4ddf6187e7e28ce22e44d3c21553ab78fc60f9af299fc59aef37d4b5228ef" }, "downloads": -1, "filename": "streamio-0.0.9.tar.gz", "has_sig": false, "md5_digest": "beca537544b5347dbb823bf5f8614261", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13674, "upload_time": "2014-02-27T23:01:15", "url": "https://files.pythonhosted.org/packages/4c/51/dbc87aae50ca9e74f51510c3f53d1f88b58a463a1cb6d05f6f31489cf5ad/streamio-0.0.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "45151b9f9519b891218851a0d8ab89fb", "sha256": "371fbc90728878d58489cf82e1f88c4a708d099743d526f14e6776ee31770958" }, "downloads": -1, "filename": "streamio-0.0.9-py2.7.egg", "has_sig": false, "md5_digest": "45151b9f9519b891218851a0d8ab89fb", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 14900, "upload_time": "2014-02-27T23:01:18", "url": "https://files.pythonhosted.org/packages/99/dc/e7dfd636fd3457b6409a365b0e2e8ce74254129ef1be0f4d112cdb536b66/streamio-0.0.9-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "beca537544b5347dbb823bf5f8614261", "sha256": "02f4ddf6187e7e28ce22e44d3c21553ab78fc60f9af299fc59aef37d4b5228ef" }, "downloads": -1, "filename": "streamio-0.0.9.tar.gz", "has_sig": false, "md5_digest": "beca537544b5347dbb823bf5f8614261", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13674, "upload_time": "2014-02-27T23:01:15", "url": "https://files.pythonhosted.org/packages/4c/51/dbc87aae50ca9e74f51510c3f53d1f88b58a463a1cb6d05f6f31489cf5ad/streamio-0.0.9.tar.gz" } ] }