{ "info": { "author": "andy.xs", "author_email": "helloworld.xs@foxmail.com", "bugtrack_url": null, "classifiers": [], "description": "Datahub Python SDK\n==================\n\n|PyPI version| |Docs| |License| |Implementation|\n\nElegent way to access Datahub Python SDK API.\n`Documentation `__\n\nInstallation\n------------\n\nThe quick way:\n\n.. code:: shell\n\n $ sudo pip install pydatahub\n\nThe dependencies will be installed automatically.\n\nIf network is not available, requirements are in dependency folder:\n\n.. code:: shell\n\n $ cd dependency\n $ pip install -r dependency.txt\n\n\nOr from source code:\n\n.. code:: shell\n\n $ virtualenv pydatahub_env\n $ source pydatahub_env/bin/activate\n $ git clone pydatahub\n $ cd pydatahub\n $ sudo python setup.py install\n\nPython Version\n-------------------\n\nTested on Python 2.7, 3.3, 3.4, 3.5, 3.6 and pypy, Python 3.6 recommended\n\nDependencies\n---------------\n\n- setuptools (>=3.0)\n- requests (>=2.4.0)\n- simplejson(>=3.3.0)\n- six(>=1.1.0)\n- enum34(>=1.1.5 for python_version < '3.4')\n\nRun Tests\n---------\n\n- install tox:\n\n.. code:: shell\n\n $ pip install -U tox\n\n- fill datahub/tests/datahub.ini with your configuration\n- run shell\n\n.. code:: shell\n\n $ tox\n\nUsage\n-----\n\n.. code:: python\n\n from datahub import DataHub\n dh = DataHub('**your-access-id**', '**your-secret-access-key**', endpoint='**your-end-point**')\n\n # ============================= create project =============================\n\n project_name = 'my_project_name'\n comment = 'my project'\n dh.create_project(project_name, comment)\n\n # ============================= get project =============================\n\n project_result = dh.get_project('pydatahub_test')\n print(project_result)\n\n # ============================= create tuple topic =============================\n\n from datahub.models import RecordSchema, FieldType\n topic_name='tuple_topic_test'\n shard_count = 3\n life_cycle = 7\n comment = 'tuple topic'\n record_schema = RecordSchema.from_lists(['bigint_field', 'string_field', 'double_field', 'bool_field', 'time_field'],\n [FieldType.BIGINT, FieldType.STRING, FieldType.DOUBLE, FieldType.BOOLEAN, FieldType.TIMESTAMP])\n dh.create_tuple_topic(project_name, topic_name, shard_count, life_cycle, record_schema, comment)\n\n # ============================= create blob topic =============================\n\n topic_name='blob_topic_test'\n shard_count = 3\n life_cycle = 7\n comment = 'blob topic'\n dh.create_tuple_topic(project_name, topic_name, shard_count, life_cycle, comment)\n\n # ============================= get topic =============================\n\n topic_result = dh.get_topic(project_name, topic_name)\n print(topic_result)\n print(topic_result.record_schema)\n\n # ============================= list shard =============================\n\n shards_result = dh.list_shards(project_name, topic_name)\n print(shards_result)\n\n # ============================= put tuple records =============================\n\n from datahub.models import TupleRecord\n records0 = []\n record0 = TupleRecord(schema=topic.record_schema, values=[1, 'yc1', 10.01, True, 1455869335000000])\n record0.shard_id = '0'\n record0.put_attribute('AK', '47')\n records0.append(record0)\n put_result = dh.put_records('pydatahub_test', 'tuple_topic_test', records0)\n print(put_result)\n\n # ============================= put tuple records =============================\n\n from datahub.models import BlobRecord\n data = None\n with open(os.path.join(root_path, 'tests/resources/datahub.png'), 'rb') as f:\n data = f.read()\n records1 = []\n record1 = BlobRecord(blob_data=data)\n record1.shard_id = '0'\n record1.put_attribute('a', 'b')\n records1.append(record1)\n put_result = dh.put_records('pydatahub_test', 'blob_topic_test', records1)\n print(put_result)\n\n # ============================= get cursor =============================\n\n from datahub.models import CursorType\n cursor_result = dh.get_cursor(project_name, topic_name, '0', CursorType.OLDEST)\n print(cursor_result)\n\n # ============================= get blob records =============================\n\n get_result = dh.get_blob_records(project_name, topic_name, '0', cursor, 10)\n print(get_result)\n print(get_result.records)\n print(get_result.records[0])\n\n # ============================= get tuple records =============================\n\n get_result = dh.get_tuple_records(project_name, topic_name, '0', record_schema, cursor, 10)\n print(get_result)\n print(get_result.records)\n print(get_result.records[0].values)\n\nExamples\n-----------\n\nsee more examples in `examples `__\n\nRelease\n--------\n\nUpdate `changelog `__, then use `bumpversion `__ to update version:\n\n1. bugfix: ``bumpversion patch``\n2. small feature\uff1a``bumpversion minor``\n3. breaking change\uff1a``bumpversion major``\n\nContributing\n------------\n\nFor a development install, clone the repository and then install from\nsource:\n\n::\n\n git clone https://github.com/aliyun/aliyun-datahub-sdk-python.git\n\nLicense\n-------\n\nLicensed under the `Apache License\n2.0 `__\n\n.. |PyPI version| image:: https://img.shields.io/pypi/v/pydatahub.svg?style=flat-square\n :target: https://pypi.python.org/pypi/pydatahub\n.. |Docs| image:: https://img.shields.io/badge/docs-latest-brightgreen.svg?style=flat-square\n :target: http://pydatahub.readthedocs.io/zh_CN/latest/\n.. |License| image:: https://img.shields.io/pypi/l/pydatahub.svg?style=flat-square\n :target: https://github.com/aliyun/aliyun-datahub-sdk-python/blob/master/LICENSE\n.. |Implementation| image:: https://img.shields.io/pypi/implementation/pydatahub.svg?style=flat-square\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/aliyun/aliyun-datahub-sdk-python", "keywords": "pydatahub", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "pydatahub-beta", "package_url": "https://pypi.org/project/pydatahub-beta/", "platform": "", "project_url": "https://pypi.org/project/pydatahub-beta/", "project_urls": { "Homepage": "https://github.com/aliyun/aliyun-datahub-sdk-python" }, "release_url": "https://pypi.org/project/pydatahub-beta/0.0.6/", "requires_dist": null, "requires_python": "", "summary": "Datahub Python SDK", "version": "0.0.6" }, "last_serial": 3988346, "releases": { "0.0.0": [ { "comment_text": "", "digests": { "md5": "1bf4c9a0d476d6de691d6273c58f1881", "sha256": "93916f776c6b7ebfc5a727ae4a303d7946795179755d598ba49bcd15054d19df" }, "downloads": -1, "filename": "pydatahub-beta-0.0.0.tar.gz", "has_sig": false, "md5_digest": "1bf4c9a0d476d6de691d6273c58f1881", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 38478, "upload_time": "2018-05-28T12:50:25", "url": "https://files.pythonhosted.org/packages/8b/c1/8153d68dc9d86e3b7f9ea25ad292744c759d1db6af3a1998f0e1ff1d90e7/pydatahub-beta-0.0.0.tar.gz" } ], "0.0.1": [ { "comment_text": "", "digests": { "md5": "c45186e75d28c80ce4bb40c053e8f79e", "sha256": "505af7539a69c49e2e7e7a4e0d3552f2789bbae94c7dfb6f2fd75c0575b4f43e" }, "downloads": -1, "filename": "pydatahub-beta-0.0.1.tar.gz", "has_sig": false, "md5_digest": "c45186e75d28c80ce4bb40c053e8f79e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 39249, "upload_time": "2018-05-28T12:52:37", "url": "https://files.pythonhosted.org/packages/48/b9/72a54c94a611da3cd395966c3c47831d38a1ef832858f63e7fb036c6c30f/pydatahub-beta-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "19465101878f9a75caa721197a8c0efb", "sha256": "72651682f5e9b716233203ca774aa15c8a03ab364d5875284022b3e90cf78653" }, "downloads": -1, "filename": "pydatahub-beta-0.0.2.tar.gz", "has_sig": false, "md5_digest": "19465101878f9a75caa721197a8c0efb", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 37823, "upload_time": "2018-05-28T13:30:33", "url": "https://files.pythonhosted.org/packages/65/5a/6c0b973f0acf01d81f3c052d962cd8b3b072c1fb5cbdfa6b376338a00560/pydatahub-beta-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "58da0aa7963cd3c7a126c1ed3ff330bf", "sha256": "b759c50b6b791cc7b4182ac9273169e7bbc21abbb3e58679146a0a6bcdb999b1" }, "downloads": -1, "filename": "pydatahub-beta-0.0.3.tar.gz", "has_sig": false, "md5_digest": "58da0aa7963cd3c7a126c1ed3ff330bf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 38770, "upload_time": "2018-05-28T13:37:15", "url": "https://files.pythonhosted.org/packages/55/77/588fb45f80e50374a722f3b3f413ca34011bda2caa2f296ddf788eec7fc2/pydatahub-beta-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "9a347971c27af152088ad9c8e2c75fdc", "sha256": "0e6a6d42fa459a5b6ebee576f93240f8a4f0ad910a521b08fb953f1ce14484e4" }, "downloads": -1, "filename": "pydatahub-beta-0.0.4.tar.gz", "has_sig": false, "md5_digest": "9a347971c27af152088ad9c8e2c75fdc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 38875, "upload_time": "2018-05-28T13:38:28", "url": "https://files.pythonhosted.org/packages/8f/a4/67b1fdead36aeb28d6995522d0f0122fbcb7c69e602ca35d58c4489ff1b6/pydatahub-beta-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "1f82c74de73cb62873dedd86215dc5b5", "sha256": "d99c582cc936a81d499545a3023314a14a786c4dc222692003983125b3af8a71" }, "downloads": -1, "filename": "pydatahub-beta-0.0.5.tar.gz", "has_sig": false, "md5_digest": "1f82c74de73cb62873dedd86215dc5b5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 38891, "upload_time": "2018-05-28T13:39:04", "url": "https://files.pythonhosted.org/packages/0c/0f/dc870f4bbdb05b2ca996c25dd53759cd0642a4a02e0e74ea4c5ca84d8714/pydatahub-beta-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "cbaba54aeda2431d4be550e54f2208db", "sha256": "f92639e82a6a74adc1db3cc7e384c94baa09f6589541be0eaa15bdfa43033bdb" }, "downloads": -1, "filename": "pydatahub-beta-0.0.6.tar.gz", "has_sig": false, "md5_digest": "cbaba54aeda2431d4be550e54f2208db", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 42156, "upload_time": "2018-06-22T07:05:33", "url": "https://files.pythonhosted.org/packages/0f/b3/60a7f930453ae24ec3b4ee98bfae4d21cb13c88792565ea8c58108d6cf0f/pydatahub-beta-0.0.6.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "cbaba54aeda2431d4be550e54f2208db", "sha256": "f92639e82a6a74adc1db3cc7e384c94baa09f6589541be0eaa15bdfa43033bdb" }, "downloads": -1, "filename": "pydatahub-beta-0.0.6.tar.gz", "has_sig": false, "md5_digest": "cbaba54aeda2431d4be550e54f2208db", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 42156, "upload_time": "2018-06-22T07:05:33", "url": "https://files.pythonhosted.org/packages/0f/b3/60a7f930453ae24ec3b4ee98bfae4d21cb13c88792565ea8c58108d6cf0f/pydatahub-beta-0.0.6.tar.gz" } ] }