{ "info": { "author": "Jing Wang", "author_email": "jing@dropbox.com", "bugtrack_url": null, "classifiers": [ "Intended Audience :: Developers", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Topic :: Database :: Front-Ends" ], "description": ".. image:: https://travis-ci.org/dropbox/PyHive.svg?branch=master\n :target: https://travis-ci.org/dropbox/PyHive\n.. image:: https://img.shields.io/codecov/c/github/dropbox/PyHive.svg\n\n======\nPyHive\n======\n\nPyHive is a collection of Python `DB-API `_ and\n`SQLAlchemy `_ interfaces for `Presto `_ and\n`Hive `_.\n\nUsage\n=====\n\nDB-API\n------\n.. code-block:: python\n\n from pyhive import presto # or import hive\n cursor = presto.connect('localhost').cursor()\n cursor.execute('SELECT * FROM my_awesome_data LIMIT 10')\n print cursor.fetchone()\n print cursor.fetchall()\n\nDB-API (asynchronous)\n---------------------\n.. code-block:: python\n\n from pyhive import hive\n from TCLIService.ttypes import TOperationState\n cursor = hive.connect('localhost').cursor()\n cursor.execute('SELECT * FROM my_awesome_data LIMIT 10', async=True)\n\n status = cursor.poll().operationState\n while status in (TOperationState.INITIALIZED_STATE, TOperationState.RUNNING_STATE):\n logs = cursor.fetch_logs()\n for message in logs:\n print message\n\n # If needed, an asynchronous query can be cancelled at any time with:\n # cursor.cancel()\n\n status = cursor.poll().operationState\n\n print cursor.fetchall()\n\nIn Python 3.7 `async` became a keyword; you can use `async_` instead:\n\n.. code-block:: python\n\n cursor.execute('SELECT * FROM my_awesome_data LIMIT 10', async_=True)\n\n\nSQLAlchemy\n----------\nFirst install this package to register it with SQLAlchemy (see ``setup.py``).\n\n.. code-block:: python\n\n from sqlalchemy import *\n from sqlalchemy.engine import create_engine\n from sqlalchemy.schema import *\n # Presto\n engine = create_engine('presto://localhost:8080/hive/default')\n # Hive\n engine = create_engine('hive://localhost:10000/default')\n logs = Table('my_awesome_data', MetaData(bind=engine), autoload=True)\n print select([func.count('*')], from_obj=logs).scalar()\n\nNote: query generation functionality is not exhaustive or fully tested, but there should be no\nproblem with raw SQL.\n\nPassing session configuration\n-----------------------------\n\n.. code-block:: python\n\n # DB-API\n hive.connect('localhost', configuration={'hive.exec.reducers.max': '123'})\n presto.connect('localhost', session_props={'query_max_run_time': '1234m'})\n # SQLAlchemy\n create_engine(\n 'presto://user@host:443/hive',\n connect_args={'protocol': 'https',\n 'session_props': {'query_max_run_time': '1234m'}}\n )\n create_engine(\n 'hive://user@host:10000/database',\n connect_args={'configuration': {'hive.exec.reducers.max': '123'}},\n )\n # SQLAlchemy with LDAP\n create_engine(\n 'hive://user:password@host:10000/database',\n connect_args={'auth': 'LDAP'},\n )\n\nRequirements\n============\n\nInstall using\n\n- ``pip install pyhive[hive]`` for the Hive interface and\n- ``pip install pyhive[presto]`` for the Presto interface.\n\nPyHive works with\n\n- Python 2.7 / Python 3\n- For Presto: Presto install\n- For Hive: `HiveServer2 `_ daemon\n\nChangelog\n=========\nSee https://github.com/dropbox/PyHive/releases.\n\nContributing\n============\n- Please fill out the Dropbox Contributor License Agreement at https://opensource.dropbox.com/cla/ and note this in your pull request.\n- Changes must come with tests, with the exception of trivial things like fixing comments. See .travis.yml for the test environment setup.\n- Notes on project scope:\n\n - This project is intended to be a minimal Hive/Presto client that does that one thing and nothing else.\n Features that can be implemented on top of PyHive, such integration with your favorite data analysis library, are likely out of scope.\n - We prefer having a small number of generic features over a large number of specialized, inflexible features.\n For example, the Presto code takes an arbitrary ``requests_session`` argument for customizing HTTP calls, as opposed to having a separate parameter/branch for each ``requests`` option.\n\nTesting\n=======\n.. image:: https://travis-ci.org/dropbox/PyHive.svg\n :target: https://travis-ci.org/dropbox/PyHive\n.. image:: http://codecov.io/github/dropbox/PyHive/coverage.svg?branch=master\n :target: http://codecov.io/github/dropbox/PyHive?branch=master\n\nRun the following in an environment with Hive/Presto::\n\n ./scripts/make_test_tables.sh\n virtualenv --no-site-packages env\n source env/bin/activate\n pip install -e .\n pip install -r dev_requirements.txt\n py.test\n\nWARNING: This drops/creates tables named ``one_row``, ``one_row_complex``, and ``many_rows``, plus a\ndatabase called ``pyhive_test_database``.\n\nUpdating TCLIService\n====================\n\nThe TCLIService module is autogenerated using a ``TCLIService.thrift`` file. To update it, the\n``generate.py`` file can be used: ``python generate.py ``. When left blank, the\nversion for Hive 2.3 will be downloaded.", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/dropbox/PyHive", "keywords": "", "license": "Apache License, Version 2.0", "maintainer": "", "maintainer_email": "", "name": "PyHive", "package_url": "https://pypi.org/project/PyHive/", "platform": "", "project_url": "https://pypi.org/project/PyHive/", "project_urls": { "Homepage": "https://github.com/dropbox/PyHive" }, "release_url": "https://pypi.org/project/PyHive/0.6.1/", "requires_dist": null, "requires_python": "", "summary": "Python interface to Hive", "version": "0.6.1" }, "last_serial": 4258365, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "91f3e34eebdf656d5f539ac688d4949b", "sha256": "e31a69f0790d92da69ad521e173498e5c896b89debddb8ddb00a46d1a5234653" }, "downloads": -1, "filename": "PyHive-0.1.0.tar.gz", "has_sig": true, "md5_digest": "91f3e34eebdf656d5f539ac688d4949b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20372, "upload_time": "2014-03-29T02:16:23", "url": "https://files.pythonhosted.org/packages/ed/a8/ba659a03c22fd0577ca673348a890ef9039efe87ed82f3ca67ea3d68c0f3/PyHive-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "ffcaf3f00bfba47ab6aedca32eeeb2df", "sha256": "a690d1e8732c053d5f54acfd0feeda4acce6be7ec5e29349e1758735ace8120c" }, "downloads": -1, "filename": "PyHive-0.1.1.tar.gz", "has_sig": true, "md5_digest": "ffcaf3f00bfba47ab6aedca32eeeb2df", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20674, "upload_time": "2014-09-26T19:40:05", "url": "https://files.pythonhosted.org/packages/7e/77/0a4c40a2d625487d482df5cefd2f63afc2bc825348abe6d1298eb2e9def3/PyHive-0.1.1.tar.gz" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "082ab2cb3c8a9c5303674c5fbd187116", "sha256": "1c7ad215979be0b7b4121706d052a1a20d9aa53139bbe417762fd30df64a4a31" }, "downloads": -1, "filename": "PyHive-0.1.2.tar.gz", "has_sig": true, "md5_digest": "082ab2cb3c8a9c5303674c5fbd187116", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20775, "upload_time": "2014-10-03T04:48:13", "url": "https://files.pythonhosted.org/packages/bc/89/dfb91f2e30907ca90030ae76cc0d88db9295cb85379704efc8e09553aa6d/PyHive-0.1.2.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "61219e399241f2aaa60d6bd4a9d55c5e", "sha256": "1ded8a09822f01e4aaec08f7a8ae1cb90a987d1fb654d312854bfd0e3b8bad01" }, "downloads": -1, "filename": "PyHive-0.1.3.tar.gz", "has_sig": true, "md5_digest": "61219e399241f2aaa60d6bd4a9d55c5e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20827, "upload_time": "2015-01-06T09:58:57", "url": "https://files.pythonhosted.org/packages/da/eb/69ec75aa3be5b9893353667e66fc6ad406b88f6b44a63de2485739e4c159/PyHive-0.1.3.tar.gz" } ], "0.1.4": [ { "comment_text": "", "digests": { "md5": "059ae3efa3a4ab929eeef91a5f471e69", "sha256": "90988a81363a53ec866c2ccc77c2e5e325513973bbaffd19527180a366292b17" }, "downloads": -1, "filename": "PyHive-0.1.4.tar.gz", "has_sig": true, "md5_digest": "059ae3efa3a4ab929eeef91a5f471e69", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 21043, "upload_time": "2015-01-31T21:39:12", "url": "https://files.pythonhosted.org/packages/66/dc/51b536dd30e1f2e8b267d17d62cebe5b3e2b9578342d5370d3237922c3cb/PyHive-0.1.4.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "8875dee4919c67907fc05cb61a1f828d", "sha256": "fec1d1dc78a7e0729553cfdc5a7a56f47d086b388d5779c8d3bfe957eb6144a4" }, "downloads": -1, "filename": "PyHive-0.1.5.tar.gz", "has_sig": true, "md5_digest": "8875dee4919c67907fc05cb61a1f828d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 19825, "upload_time": "2015-03-23T07:16:40", "url": "https://files.pythonhosted.org/packages/45/98/e36d293cc5c95ebcd98322a2ece2050952cc1e3b85634ed4655db973341d/PyHive-0.1.5.tar.gz" } ], "0.1.6": [ { "comment_text": "", "digests": { "md5": "01e9f879c6f17b05dead3083fc9bf562", "sha256": "9ce3994bf7b2fd8e178932b7f89401524743b529a3515381a58d1b73a7857328" }, "downloads": -1, "filename": "PyHive-0.1.6.tar.gz", "has_sig": true, "md5_digest": "01e9f879c6f17b05dead3083fc9bf562", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 39647, "upload_time": "2015-10-02T00:50:40", "url": "https://files.pythonhosted.org/packages/ad/58/4f68e44384035584bba40af6b7c8a0f10213dd0df7f03ea80575d442e90a/PyHive-0.1.6.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "a85f65779d14fec264dc037a796c480c", "sha256": "e7be627b023ddc17a029bd841f655b4dd072da57b350079f6bd5a4a87f2e9699" }, "downloads": -1, "filename": "PyHive-0.1.7.tar.gz", "has_sig": true, "md5_digest": "a85f65779d14fec264dc037a796c480c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 40266, "upload_time": "2016-03-29T07:27:43", "url": "https://files.pythonhosted.org/packages/64/a9/f6ae893a4161ed2b6232cecb5309c85068a84ae14fb1781ded98199a381c/PyHive-0.1.7.tar.gz" } ], "0.1.8": [ { "comment_text": "", "digests": { "md5": "0bcf8f857c4db2f03da82665f1635b63", "sha256": "bf7c7156076111a1a8bab61ca04ba28950257d43341488efb6cef28dbbedb932" }, "downloads": -1, "filename": "PyHive-0.1.8.tar.gz", "has_sig": true, "md5_digest": "0bcf8f857c4db2f03da82665f1635b63", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 39524, "upload_time": "2016-05-19T02:24:57", "url": "https://files.pythonhosted.org/packages/c9/e8/dbaea48b33eb56fda9fc9f969660f411744110d91f07651596a144fc1484/PyHive-0.1.8.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "9492f03312612190ceac90650f50d342", "sha256": "66075caf9ad8c8cfed948531b69655e490fdff9e0f1172d081a8e72267207a9d" }, "downloads": -1, "filename": "PyHive-0.2.0.tar.gz", "has_sig": true, "md5_digest": "9492f03312612190ceac90650f50d342", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 41933, "upload_time": "2016-06-02T04:17:20", "url": "https://files.pythonhosted.org/packages/1d/8c/015c003c3c70cc6b9ae4ff754be998f679b22518aaa09152403b335e44e2/PyHive-0.2.0.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "ec9acfaa1b14311431f87b7c1fa19127", "sha256": "8d3de3c0bf231c2190a565eaadc10b97fe11349f351b1157b75d0863bd4c0ddb" }, "downloads": -1, "filename": "PyHive-0.2.1.tar.gz", "has_sig": true, "md5_digest": "ec9acfaa1b14311431f87b7c1fa19127", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 42015, "upload_time": "2016-06-25T03:25:54", "url": "https://files.pythonhosted.org/packages/53/ae/6fd8c247622d988095098051050d26e9888681cdffd58553472de8bad062/PyHive-0.2.1.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "3def0dbdd186de050a0b5d2ebaf79543", "sha256": "e9c6776a80ee7a11235363fde74e3fe9347cc4f06d1faba01df50cb30f634403" }, "downloads": -1, "filename": "PyHive-0.3.0.tar.gz", "has_sig": true, "md5_digest": "3def0dbdd186de050a0b5d2ebaf79543", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 44237, "upload_time": "2017-04-23T04:37:50", "url": "https://files.pythonhosted.org/packages/6a/da/b76f91c8f5ded20f6575cfd5e0fb669e6ba7ab85725fdfb8dbc1e38e783d/PyHive-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "def868d3c04e6f1b84bf6f6d4be3ea67", "sha256": "320cc6d5e20791c2b25a46c3c8b310a499ad323a6738b115a6d278fe0f34989f" }, "downloads": -1, "filename": "PyHive-0.4.0.tar.gz", "has_sig": true, "md5_digest": "def868d3c04e6f1b84bf6f6d4be3ea67", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 43925, "upload_time": "2017-07-17T04:24:02", "url": "https://files.pythonhosted.org/packages/5f/84/ce9e22679cbe6e40e2b9a341ec69cc188f08abf441216f8993fa6b048903/PyHive-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "8e2cbbf7898df97995586f0e8eb34650", "sha256": "df3864ab2b6e59dd4ac2378ad32f06d33b0abcd8b28b700fedb592fc81e85dd4" }, "downloads": -1, "filename": "PyHive-0.5.0.tar.gz", "has_sig": true, "md5_digest": "8e2cbbf7898df97995586f0e8eb34650", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 40097, "upload_time": "2017-09-02T03:54:43", "url": "https://files.pythonhosted.org/packages/1f/7e/507119f318a317078d36bdc308d31dec3a42d5edbeff69e7c3cc3ca865bd/PyHive-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "055f6cf20a109253251314a777c71ae9", "sha256": "4b75e4dcca7c869daa3d461c567f236f3b7db4ece7731fa51ff297354282f15c" }, "downloads": -1, "filename": "PyHive-0.5.1.tar.gz", "has_sig": true, "md5_digest": "055f6cf20a109253251314a777c71ae9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 41221, "upload_time": "2018-02-15T23:53:24", "url": "https://files.pythonhosted.org/packages/37/3b/0d7213e2b9765056100bb48f89722df3c78605ae84c0fbd999ca8081a78b/PyHive-0.5.1.tar.gz" } ], "0.5.2": [ { "comment_text": "", "digests": { "md5": "d940f6110a3cafb3aba628b5823bc611", "sha256": "420ab64dd3305d99f2f8615be6c8ad05864f68b3f926efb2376d190f46341e8f" }, "downloads": -1, "filename": "PyHive-0.5.2.tar.gz", "has_sig": false, "md5_digest": "d940f6110a3cafb3aba628b5823bc611", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 40500, "upload_time": "2018-05-14T17:26:24", "url": "https://files.pythonhosted.org/packages/2c/53/ffa8f72a694c6e71f4fe3bb4f330d55a5bf83628fb98737862127eca3cf0/PyHive-0.5.2.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "a6e2dc5c5d67cbf307a3ebba74592988", "sha256": "f754edd5089d742d2080978e773b18c67dc75f9e25cd416b6564516bf20c4385" }, "downloads": -1, "filename": "PyHive-0.6.0.tar.gz", "has_sig": false, "md5_digest": "a6e2dc5c5d67cbf307a3ebba74592988", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 41170, "upload_time": "2018-06-12T00:13:22", "url": "https://files.pythonhosted.org/packages/52/f5/2a582d7e35b0f3148375f49afadafb25dc2da735876a8b53b6862f0966f3/PyHive-0.6.0.tar.gz" } ], "0.6.1": [ { "comment_text": "", "digests": { "md5": "749bdfaecec0e4bfe7287f87971999bd", "sha256": "a5f2b2f8bcd85a8cd80ab64ff8fbfe1c09515d266650a56f789a8d89ad66d7f4" }, "downloads": -1, "filename": "PyHive-0.6.1.tar.gz", "has_sig": false, "md5_digest": "749bdfaecec0e4bfe7287f87971999bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 41633, "upload_time": "2018-09-10T16:46:24", "url": "https://files.pythonhosted.org/packages/4e/26/de91125c0d9e8947d48f387f4d1f2e7a22aa92a30771ad02f63a5653361b/PyHive-0.6.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "749bdfaecec0e4bfe7287f87971999bd", "sha256": "a5f2b2f8bcd85a8cd80ab64ff8fbfe1c09515d266650a56f789a8d89ad66d7f4" }, "downloads": -1, "filename": "PyHive-0.6.1.tar.gz", "has_sig": false, "md5_digest": "749bdfaecec0e4bfe7287f87971999bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 41633, "upload_time": "2018-09-10T16:46:24", "url": "https://files.pythonhosted.org/packages/4e/26/de91125c0d9e8947d48f387f4d1f2e7a22aa92a30771ad02f63a5653361b/PyHive-0.6.1.tar.gz" } ] }