{ "info": { "author": "Tom Arnfeld", "author_email": "tom@duedil.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "License :: OSI Approved :: Apache Software License", "Natural Language :: English", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Programming Language :: Python :: 3 :: Only" ], "description": "python3_lzo_indexer\n===================\n\n.. image:: https://img.shields.io/pypi/pyversions/python3_lzo_indexer.svg\n :target: https://pypi.python.org/pypi/python3_lzo_indexer\n.. image:: https://img.shields.io/pypi/v/python3_lzo_indexer.svg\n :target: https://pypi.python.org/pypi/python3_lzo_indexer\n.. image:: https://coveralls.io/repos/github/Orhideous/python3_lzo_indexer/badge.svg?branch=master\n :target: https://coveralls.io/github/Orhideous/python3_lzo_indexer?branch=master\n.. image:: https://img.shields.io/travis/Orhideous/python3_lzo_indexer.svg\n :target: https://travis-ci.org/Orhideous/python3_lzo_indexer\n.. image:: https://pyup.io/repos/github/Orhideous/python3_lzo_indexer/shield.svg\n :target: https://pyup.io/repos/github/Orhideous/python3_lzo_indexer/\n\n\nPython library for indexing block offsets within LZO compressed files.\nThe implementation is largely based on that of the `Hadoop Library`_.\nIndex files are used to allow Hadoop to split a single file compressed\nwith LZO into several chunks for parallel processing.\n\nSince LZO is a block based compression algorithm, we can split the file\nalong the lines of blocks and decompress each block on it\u2019s own. The\nindex is a file containing byte offsets for each block in the original\nLZO file.\n\nThis library is python3 fork of `python-lzo-indexer`_.\n\n\nExample\n-------\n\nThe python code below demonstrates how easy it is to index an LZO file.\nThis library also supports indexing a string, and a method to return the\nindividual block offsets should you need to create a file of your own\nformat.\n\n.. code:: python\n\n import lzo_indexer\n\n with open(\"my-file.lzo\", \"r\") as f, open(\"my-file.lzo.index\", \"rw\") as index:\n lzo_indexer.index_lzo_file(f, index)\n\nCommand-line Utility\n--------------------\n\nThis library also includes a utility for indexing multiple lzo files,\nusing the python indexer. This is a much faster alternative to the\ncommand line utility built into the hadoop-lzo library as it avoids the\nJVM.\n\n::\n\n $ lzo_indexer --help\n\n Usage: lzo_indexer [OPTIONS] \n\n Tool for indexing LZO compressed files\n\n Options:\n -t, --threads INTEGER Processing threads count\n -e, --extension TEXT Index file extension\n -f, --force Force re-creation of an index even if it exists\n -h, --help Show this message and exit.\n\nContributions\n-------------\n\nI welcome any contributions, though I request that any pull requests\ncome with test coverage.\n\n.. _Hadoop Library: https://github.com/twitter/hadoop-lzo\n.. _python-lzo-indexer: https://github.com/duedil-ltd/python-lzo-indexer\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Orhideous/python3_lzo_indexer", "keywords": "lzo,archive,indexing", "license": "Apache Software License", "maintainer": "Andriy Kushnir (Orhideous)", "maintainer_email": "me@orhideous.name", "name": "python3-lzo-indexer", "package_url": "https://pypi.org/project/python3-lzo-indexer/", "platform": "", "project_url": "https://pypi.org/project/python3-lzo-indexer/", "project_urls": { "Homepage": "https://github.com/Orhideous/python3_lzo_indexer" }, "release_url": "https://pypi.org/project/python3-lzo-indexer/0.3.0/", "requires_dist": [ "click (==7.0)" ], "requires_python": "", "summary": "Library for indexing LZO compressed files", "version": "0.3.0" }, "last_serial": 4320840, "releases": { "0.2.0": [ { "comment_text": "", "digests": { "md5": "2bd4a875302dd4c7af110afb622a278d", "sha256": "769d7bf8a6eb9144446a0b8c261317598cf1c1f6f65b4888f8af68ec40e20b51" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2bd4a875302dd4c7af110afb622a278d", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6592, "upload_time": "2018-09-28T17:21:55", "url": "https://files.pythonhosted.org/packages/3d/89/c598e10c5c4602928c93eecc6950ba096b60e81a60ac4f8ed2a2234323bc/python3_lzo_indexer-0.2.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "36e63e9d519f884c765d517befa2fa20", "sha256": "953920e652fcad59af345041ba611d36a2827e2414153377d733c2f75db6cdd5" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.0.tar.gz", "has_sig": false, "md5_digest": "36e63e9d519f884c765d517befa2fa20", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10744, "upload_time": "2018-09-28T17:21:56", "url": "https://files.pythonhosted.org/packages/da/6d/591be906635d4e2cb9b31c3851a50ed75ae3ac735ea021051bdee68a6e2a/python3_lzo_indexer-0.2.0.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "dc4e7b9a44d32ccd173cea7f03e9eb7f", "sha256": "a2462334ba2d00bcd4f184f721591c5e8a687be3156e2a1d13e6b694a8be0bef" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "dc4e7b9a44d32ccd173cea7f03e9eb7f", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6590, "upload_time": "2018-09-28T17:26:55", "url": "https://files.pythonhosted.org/packages/9c/a9/1947b5123e33df4f248591d9cd322c5f6d232881903fc4f4221247d32b8e/python3_lzo_indexer-0.2.1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4bd375e68ad66ba8139e18f099e3b0f0", "sha256": "1d1e1c824fe572d48aebff49de5213fb5907b2413601f85df310ae6b8fd41ff5" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.1.tar.gz", "has_sig": false, "md5_digest": "4bd375e68ad66ba8139e18f099e3b0f0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10748, "upload_time": "2018-09-28T17:26:56", "url": "https://files.pythonhosted.org/packages/a0/30/ee14de39deb91bdb16626f73f9c7d40536c79f9a2553eb720e16cff3c7a4/python3_lzo_indexer-0.2.1.tar.gz" } ], "0.2.2": [ { "comment_text": "", "digests": { "md5": "9f0e7037dda0a12a43afe90fff3d3b3f", "sha256": "dbbfd2e62225628ab6c0cf315b0782b6aa4a9957d78c26751a8eda4144cefa86" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "9f0e7037dda0a12a43afe90fff3d3b3f", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6589, "upload_time": "2018-09-28T17:28:53", "url": "https://files.pythonhosted.org/packages/62/cc/761b7876f9f817ef3deffe4afdbe4ea5aa1868e74cf88ea3ec072d0c56f7/python3_lzo_indexer-0.2.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "5b615ee317db3d68f2281b8524b32496", "sha256": "0c5ab2d0caf5488f4ae9000662e300e906f631dd26c539d7782ea0ce1f61e470" }, "downloads": -1, "filename": "python3_lzo_indexer-0.2.2.tar.gz", "has_sig": false, "md5_digest": "5b615ee317db3d68f2281b8524b32496", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10734, "upload_time": "2018-09-28T17:28:54", "url": "https://files.pythonhosted.org/packages/3f/ba/b2c61ffdb54023910dae66ddc6a877918afb2f460911740073db1ed4fa55/python3_lzo_indexer-0.2.2.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "2fcf0fc8d179104af5dc04f7df20eebc", "sha256": "8df8a388b3e8073dc384a90ec6bc52e1e18a2b8ec05db221374f47e514f6eca0" }, "downloads": -1, "filename": "python3_lzo_indexer-0.3.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2fcf0fc8d179104af5dc04f7df20eebc", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6586, "upload_time": "2018-09-28T17:38:26", "url": "https://files.pythonhosted.org/packages/30/ad/6ff63ecb4bc9f06b92aeb8a35bb50c0c999897d2ca98f0327ac48440fc51/python3_lzo_indexer-0.3.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4a3008350f3045ba4422b8a5a3f4060c", "sha256": "d7d061fdcd4a3b9383496066676fc95316b38f5e48e0cf8a08d0d9cd5ff446b9" }, "downloads": -1, "filename": "python3_lzo_indexer-0.3.0.tar.gz", "has_sig": false, "md5_digest": "4a3008350f3045ba4422b8a5a3f4060c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10730, "upload_time": "2018-09-28T17:38:28", "url": "https://files.pythonhosted.org/packages/85/6e/ac13753f3347b1e2a3e29bcb18edffdfd585d8497c479589805cf8a69161/python3_lzo_indexer-0.3.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "2fcf0fc8d179104af5dc04f7df20eebc", "sha256": "8df8a388b3e8073dc384a90ec6bc52e1e18a2b8ec05db221374f47e514f6eca0" }, "downloads": -1, "filename": "python3_lzo_indexer-0.3.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2fcf0fc8d179104af5dc04f7df20eebc", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6586, "upload_time": "2018-09-28T17:38:26", "url": "https://files.pythonhosted.org/packages/30/ad/6ff63ecb4bc9f06b92aeb8a35bb50c0c999897d2ca98f0327ac48440fc51/python3_lzo_indexer-0.3.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4a3008350f3045ba4422b8a5a3f4060c", "sha256": "d7d061fdcd4a3b9383496066676fc95316b38f5e48e0cf8a08d0d9cd5ff446b9" }, "downloads": -1, "filename": "python3_lzo_indexer-0.3.0.tar.gz", "has_sig": false, "md5_digest": "4a3008350f3045ba4422b8a5a3f4060c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10730, "upload_time": "2018-09-28T17:38:28", "url": "https://files.pythonhosted.org/packages/85/6e/ac13753f3347b1e2a3e29bcb18edffdfd585d8497c479589805cf8a69161/python3_lzo_indexer-0.3.0.tar.gz" } ] }