{ "info": { "author": "Arunkumar Ramanathan", "author_email": "rako.aka.arun@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7" ], "description": "A command line interface for exporting data from elasticsearch to local csv files\n=================================================================================\n\n.. image:: https://travis-ci.org/therako/parallel-es2csv.svg?branch=master\n :target: https://travis-ci.org/therako/parallel-es2csv\n :alt: Build Status\n\n.. image:: https://img.shields.io/pypi/v/parallel-es2csv.svg\n :target: https://pypi.python.org/pypi/parallel-es2csv/\n :alt: Latest Version\n\n.. image:: https://img.shields.io/pypi/pyversions/parallel-es2csv.svg\n :target: https://pypi.python.org/pypi/parallel-es2csv/\n :alt: Python versions\n\n.. image:: https://img.shields.io/pypi/status/parallel-es2csv.svg\n :target: https://pypi.python.org/pypi/parallel-es2csv/\n :alt: Package status\n\n.. image:: https://coveralls.io/repos/github/therako/parallel-es2csv/badge.svg?branch=master\n :target: https://coveralls.io/github/therako/parallel-es2csv?branch=master\n :alt: Package coverage\n\n\nThis project is to just have a simple cli command to export data from ES using the CPU's,\nand Elasticsearch's Sliced Scroll Search for fetching large datasets.\nIt's intended to be used in Data workflow for extracting data out.\n\nThe performance seems better when **no_of_workers == no_of_shards_for_the_index**.\n\nNote\n----\n\nThis is still early in the development and a bit rough around the edges.\nAny bug reports, feature suggestions, etc are greatly appreciated. :)\n\n\nInstallation and usage\n----------------------\n\n**Installation**\nSince this is a Python package available on PyPi you can install it like \nany other Python package.\n\n.. code-block:: shell\n\n # on modern systems with Python you can install with pip\n $ pip install parallel-es2csv\n # on older systems you can install using easy_install\n $ easy_install parallel-es2csv\n\n**Usage**\nThe commands should be mostly self-documenting in how they are defined,\nwhich is made available through the ``help`` command.\n\n.. code-block:: shell\n\n $ parallel-es2csv\n usage: parallel-es2csv -u -i <[list_of_index]> [-n ] [-o ]\n\n arguments:\n -h, --help show this help message and exit\n -i INDICES [INDICES ...], --indices INDICES [INDICES ...]\n ES indices to export.\n -u URL, --url URL Elasticsearch host URL. Default is\n http://localhost:9200.\n -a AUTH, --auth AUTH Elasticsearch basic authentication in the form of\n username:pwd.\n -D DOC_TYPE [DOC_TYPE ...], --doc_types DOC_TYPE [DOC_TYPE ...]\n Document type(s).\n -o OUTPUT_FOLDER, --output_folder OUTPUT_FOLDER\n Output folder path.\n -f FIELDS [FIELDS ...], --fields FIELDS [FIELDS ...]\n List of selected fields in output. Default is\n ['_all'].\n -m INTEGER, --max INTEGER\n Maximum number of results to return. Default is 0.\n -s INTEGER, --scroll_size INTEGER\n Scroll size for each batch of results. Default is 100.\n -t INTEGER, --timeout INTEGER\n Timeout in seconds. Default is 60.\n -e, --meta_fields Add meta-fields in output.\n -n NO_OF_WORKERS, --no_of_workers NO_OF_WORKERS\n No. or parallel scroll from Elasticsearch, using\n Multiprocess\n -v, --version Show version and exit.\n --debug Debug mode on.\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/therako/parallel-es2csv", "keywords": "", "license": "MIT License", "maintainer": "", "maintainer_email": "", "name": "parallel-es2csv", "package_url": "https://pypi.org/project/parallel-es2csv/", "platform": "", "project_url": "https://pypi.org/project/parallel-es2csv/", "project_urls": { "Homepage": "https://github.com/therako/parallel-es2csv" }, "release_url": "https://pypi.org/project/parallel-es2csv/0.1.10/", "requires_dist": [ "elasticsearch (<7.0.0,>=6.0.0)", "elasticsearch-dsl (<7.0.0,>=6.0.0)", "tqdm (==4.19.8)", "futures; python_version == \"2.7\"" ], "requires_python": "", "summary": "A CLI client for exporting elasticsearch data to csv", "version": "0.1.10" }, "last_serial": 3979972, "releases": { "0.1.10": [ { "comment_text": "", "digests": { "md5": "f9c46d4318c2c05e962fee6cda8a532e", "sha256": "cda74d7851455b2ed193b3d2ad4372d92ef7b977dbf92e0dbf8b711b5006ef96" }, "downloads": -1, "filename": "parallel_es2csv-0.1.10-py3-none-any.whl", "has_sig": false, "md5_digest": "f9c46d4318c2c05e962fee6cda8a532e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 7622, "upload_time": "2018-06-20T04:46:20", "url": "https://files.pythonhosted.org/packages/c3/bb/25d9447de1330da5ffdff6d8826f8e6fbdbc38cf9d758ff77377d1dad996/parallel_es2csv-0.1.10-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "ffac21f223a4d7119028f6b43ffc9986", "sha256": "ea90f366350db20887fc01ec0a478e1e7a4f86bd5573ff607f7f92996c1a83a1" }, "downloads": -1, "filename": "parallel-es2csv-0.1.10.tar.gz", "has_sig": false, "md5_digest": "ffac21f223a4d7119028f6b43ffc9986", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6189, "upload_time": "2018-06-20T04:46:21", "url": "https://files.pythonhosted.org/packages/5a/c5/d0cfb337d030f5cd8fb26d278f23f931dd68cdf0e7353a5ae467e38a3d2b/parallel-es2csv-0.1.10.tar.gz" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "1e5066d461e4fecba6957779cb4477a0", "sha256": "aedc076eafb631e82daa7fc62cf9d817cab5db42a5d7c1675bbfdeb10717a3de" }, "downloads": -1, "filename": "parallel_es2csv-0.1.2-py2-none-any.whl", "has_sig": false, "md5_digest": "1e5066d461e4fecba6957779cb4477a0", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 9024, "upload_time": "2018-03-20T09:28:14", "url": "https://files.pythonhosted.org/packages/c4/91/665253cb16f0b19f397489d85a27027271b59b288a32a51bfa6f296d8956/parallel_es2csv-0.1.2-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "c2cd1d23c29fcae35b15e1e31b2216f7", "sha256": "1b280c5f301aebbc188ee95c0dafdcf89f4bfaf06a472eaf1f136b0e7aa91bdc" }, "downloads": -1, "filename": "parallel-es2csv-0.1.2.tar.gz", "has_sig": false, "md5_digest": "c2cd1d23c29fcae35b15e1e31b2216f7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6067, "upload_time": "2018-03-20T09:28:16", "url": "https://files.pythonhosted.org/packages/6e/ee/e0347f4b2489af45a7cfba7f7904eb193022e19737ee52ce8961f8243cb0/parallel-es2csv-0.1.2.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "ede7484e5c6561152338e21579b0cee0", "sha256": "f74786c70f4c1bebed7ea45087fdd5da912739536ca34b94d1c165e6c5611f8d" }, "downloads": -1, "filename": "parallel_es2csv-0.1.3-py2-none-any.whl", "has_sig": false, "md5_digest": "ede7484e5c6561152338e21579b0cee0", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 9155, "upload_time": "2018-03-20T09:55:12", "url": "https://files.pythonhosted.org/packages/e6/76/bdda20852e364565d09c0ad4aa045c893a83ef7426da5e56ec99199b3572/parallel_es2csv-0.1.3-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "26a65e6db1b933893c3c09c4dbfd677b", "sha256": "c2f301900b10fe22c429c145c2cbe12555ca4c35e2b50c9447deae36e27e4b06" }, "downloads": -1, "filename": "parallel-es2csv-0.1.3.tar.gz", "has_sig": false, "md5_digest": "26a65e6db1b933893c3c09c4dbfd677b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6184, "upload_time": "2018-03-20T09:55:14", "url": "https://files.pythonhosted.org/packages/f8/3b/4f6d522eb148543afb87ef8a785fce65616ef2559c87dea29dc9f323512b/parallel-es2csv-0.1.3.tar.gz" } ], "0.1.4": [ { "comment_text": "", "digests": { "md5": "b77f6b98b3806cbe33b7a4c22680f79f", "sha256": "f6f824e6b1b982f53cc75d010999cb2a5729b08eb9c317b148e6ae6df8d01e3d" }, "downloads": -1, "filename": "parallel_es2csv-0.1.4-py2-none-any.whl", "has_sig": false, "md5_digest": "b77f6b98b3806cbe33b7a4c22680f79f", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 9164, "upload_time": "2018-03-22T03:41:15", "url": "https://files.pythonhosted.org/packages/f5/41/8d689387bace01f5549b204edda7f3b9f1879bf5b9873e6fcb7a26ac87d5/parallel_es2csv-0.1.4-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "414b150df97e7912f478b14d54671f0c", "sha256": "c6083f08503df08fc83522831d69b9b535104e603e0ee766003c1e9d714e29ad" }, "downloads": -1, "filename": "parallel-es2csv-0.1.4.tar.gz", "has_sig": false, "md5_digest": "414b150df97e7912f478b14d54671f0c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6185, "upload_time": "2018-03-22T03:41:17", "url": "https://files.pythonhosted.org/packages/7d/98/f66cdcf519a18dd3c13cda25c052adfca5578bb0aceb938345fe2a1fa52c/parallel-es2csv-0.1.4.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "dd64299e197a2f8f01feb195186ee5e1", "sha256": "574ba7938b7007f6a2d1378cb52a67c605687272a2c6d2779bd393933ee48ba2" }, "downloads": -1, "filename": "parallel_es2csv-0.1.5-py2-none-any.whl", "has_sig": false, "md5_digest": "dd64299e197a2f8f01feb195186ee5e1", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 8308, "upload_time": "2018-03-22T14:02:39", "url": "https://files.pythonhosted.org/packages/8e/87/64496d627054326c209d3a452f9935fcc1341ba97b7e7751f63fc6017bcc/parallel_es2csv-0.1.5-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "e91a024033d639d55e036f4fe488209e", "sha256": "6ac34ce375eea2dfcfe74fed65a2ae92e48234d2c9d2d9c50bf29ec41734523a" }, "downloads": -1, "filename": "parallel-es2csv-0.1.5.tar.gz", "has_sig": false, "md5_digest": "e91a024033d639d55e036f4fe488209e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5344, "upload_time": "2018-03-22T14:02:41", "url": "https://files.pythonhosted.org/packages/73/59/d235474a96be3aaf68f15a23d0022f503f985daa17d437a52eac1c254e37/parallel-es2csv-0.1.5.tar.gz" } ], "0.1.6": [ { "comment_text": "", "digests": { "md5": "41650175336f8addbec13c569bd51d1f", "sha256": "aa5104504cbf0a0cfda5b27d4c666f07212700643369bb22f80657097e9c3b27" }, "downloads": -1, "filename": "parallel_es2csv-0.1.6-py2-none-any.whl", "has_sig": false, "md5_digest": "41650175336f8addbec13c569bd51d1f", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 8444, "upload_time": "2018-03-24T02:01:34", "url": "https://files.pythonhosted.org/packages/b3/da/f2c56246b149dc1e458adcabcb70dadb33c4db4ee5bc2ae7de0972b63504/parallel_es2csv-0.1.6-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "6bdd4ac3d605e20f304d8fce204ad932", "sha256": "29b447e8e33154e460c43b37ebd0be51263fada6f8782d98b618d300ea991264" }, "downloads": -1, "filename": "parallel-es2csv-0.1.6.tar.gz", "has_sig": false, "md5_digest": "6bdd4ac3d605e20f304d8fce204ad932", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5490, "upload_time": "2018-03-24T02:01:35", "url": "https://files.pythonhosted.org/packages/25/56/ecc2ddb6e39f30284a250a1fbe14b1e0148dda0bcd1769433933be44efbb/parallel-es2csv-0.1.6.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "5f79ac78a8f42a5688e238e2ab2e6d25", "sha256": "305b4870ba841c4d34595636a18a9f49cf74d37357c47f8b14e6de9df0fa43fd" }, "downloads": -1, "filename": "parallel_es2csv-0.1.7-py2-none-any.whl", "has_sig": false, "md5_digest": "5f79ac78a8f42a5688e238e2ab2e6d25", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 8445, "upload_time": "2018-03-24T12:13:27", "url": "https://files.pythonhosted.org/packages/f6/3e/1003f856b91ed8f38959fbc3484b7d878dfee59c98d24baf5502bc571440/parallel_es2csv-0.1.7-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "04ecb9433202d0093e5ba77b953cffc4", "sha256": "4dec72ac9bcd64861c1ba017527bc3ffbcc9a57d1511e2fd0c43eabf6d1ca71e" }, "downloads": -1, "filename": "parallel-es2csv-0.1.7.tar.gz", "has_sig": false, "md5_digest": "04ecb9433202d0093e5ba77b953cffc4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5494, "upload_time": "2018-03-24T12:13:29", "url": "https://files.pythonhosted.org/packages/dc/ba/3e8f681b926546cb2d12daddc5ba32f1f3bb06211c40c54e44aa48b7cee4/parallel-es2csv-0.1.7.tar.gz" } ], "0.1.8": [ { "comment_text": "", "digests": { "md5": "5d85729547c47e87fc2e00ae0c9b4f6a", "sha256": "2b444b99e53b4e185d9a88ff56b29b20be6ea8ea9b36b8b68732e9660c1aed54" }, "downloads": -1, "filename": "parallel_es2csv-0.1.8-py2-none-any.whl", "has_sig": false, "md5_digest": "5d85729547c47e87fc2e00ae0c9b4f6a", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 9913, "upload_time": "2018-03-26T04:06:13", "url": "https://files.pythonhosted.org/packages/a4/5d/e31684e41f655e47022914628a8d419cd142a59c6262203f3c3b94b16a11/parallel_es2csv-0.1.8-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "e43e1738cd7c83689ad446c679ded8c4", "sha256": "f865e3bdedf164ac49476772c6588b257b1ef7b5f0e38ea037149ae7ab3fda47" }, "downloads": -1, "filename": "parallel-es2csv-0.1.8.tar.gz", "has_sig": false, "md5_digest": "e43e1738cd7c83689ad446c679ded8c4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6175, "upload_time": "2018-03-26T04:06:14", "url": "https://files.pythonhosted.org/packages/05/29/797ee7917c5ebbadf8e00e2dea6920044161e1ac716885b89ef5d7579f41/parallel-es2csv-0.1.8.tar.gz" } ], "0.1.9": [ { "comment_text": "", "digests": { "md5": "941f0b88632139d0839bf12001275aad", "sha256": "37f6dd7f6e59fa1d8f99ae73e09a2d3af33a3ef5d93b7649c0eb6ea42070fd7b" }, "downloads": -1, "filename": "parallel_es2csv-0.1.9-py2-none-any.whl", "has_sig": false, "md5_digest": "941f0b88632139d0839bf12001275aad", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 9913, "upload_time": "2018-03-26T04:13:25", "url": "https://files.pythonhosted.org/packages/6c/3b/60b8664e35c8a26f3dbe8f1406e60f629b1ad0a34edacb5e2cd5c690f89a/parallel_es2csv-0.1.9-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "c0c782738107a8212e9cdee692766ee6", "sha256": "d0cc48ad81d8971f2d2c173c76c105dd1156e6a12154094b5b3e6fc08529b369" }, "downloads": -1, "filename": "parallel-es2csv-0.1.9.tar.gz", "has_sig": false, "md5_digest": "c0c782738107a8212e9cdee692766ee6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6177, "upload_time": "2018-03-26T04:13:28", "url": "https://files.pythonhosted.org/packages/a8/77/ae1de0f48448c95b3447bc7590c613f67e18937f242e8b90b0ba1ba4f6f3/parallel-es2csv-0.1.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f9c46d4318c2c05e962fee6cda8a532e", "sha256": "cda74d7851455b2ed193b3d2ad4372d92ef7b977dbf92e0dbf8b711b5006ef96" }, "downloads": -1, "filename": "parallel_es2csv-0.1.10-py3-none-any.whl", "has_sig": false, "md5_digest": "f9c46d4318c2c05e962fee6cda8a532e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 7622, "upload_time": "2018-06-20T04:46:20", "url": "https://files.pythonhosted.org/packages/c3/bb/25d9447de1330da5ffdff6d8826f8e6fbdbc38cf9d758ff77377d1dad996/parallel_es2csv-0.1.10-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "ffac21f223a4d7119028f6b43ffc9986", "sha256": "ea90f366350db20887fc01ec0a478e1e7a4f86bd5573ff607f7f92996c1a83a1" }, "downloads": -1, "filename": "parallel-es2csv-0.1.10.tar.gz", "has_sig": false, "md5_digest": "ffac21f223a4d7119028f6b43ffc9986", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6189, "upload_time": "2018-06-20T04:46:21", "url": "https://files.pythonhosted.org/packages/5a/c5/d0cfb337d030f5cd8fb26d278f23f931dd68cdf0e7353a5ae467e38a3d2b/parallel-es2csv-0.1.10.tar.gz" } ] }