{
"info": {
"author": "andy.xs",
"author_email": "helloworld.xs@foxmail.com",
"bugtrack_url": null,
"classifiers": [],
"description": "Datahub Python SDK\n==================\n\n|PyPI version| |Docs| |License| |Implementation|\n\nElegent way to access Datahub Python SDK API.\n`Documentation `__\n\nInstallation\n------------\n\nThe quick way:\n\n.. code:: shell\n\n $ sudo pip install pydatahub\n\nThe dependencies will be installed automatically.\n\nIf network is not available, requirements are in dependency folder:\n\n.. code:: shell\n\n $ cd dependency\n $ pip install -r dependency.txt\n\n\nOr from source code:\n\n.. code:: shell\n\n $ virtualenv pydatahub_env\n $ source pydatahub_env/bin/activate\n $ git clone pydatahub\n $ cd pydatahub\n $ sudo python setup.py install\n\nPython Version\n-------------------\n\nTested on Python 2.7, 3.3, 3.4, 3.5, 3.6 and pypy, Python 3.6 recommended\n\nDependencies\n---------------\n\n- setuptools (>=3.0)\n- requests (>=2.4.0)\n- simplejson(>=3.3.0)\n- six(>=1.1.0)\n- enum34(>=1.1.5 for python_version < '3.4')\n\nRun Tests\n---------\n\n- install tox:\n\n.. code:: shell\n\n $ pip install -U tox\n\n- fill datahub/tests/datahub.ini with your configuration\n- run shell\n\n.. code:: shell\n\n $ tox\n\nUsage\n-----\n\n.. code:: python\n\n from datahub import DataHub\n dh = DataHub('**your-access-id**', '**your-secret-access-key**', endpoint='**your-end-point**')\n\n # ============================= create project =============================\n\n project_name = 'my_project_name'\n comment = 'my project'\n dh.create_project(project_name, comment)\n\n # ============================= get project =============================\n\n project_result = dh.get_project('pydatahub_test')\n print(project_result)\n\n # ============================= create tuple topic =============================\n\n from datahub.models import RecordSchema, FieldType\n topic_name='tuple_topic_test'\n shard_count = 3\n life_cycle = 7\n comment = 'tuple topic'\n record_schema = RecordSchema.from_lists(['bigint_field', 'string_field', 'double_field', 'bool_field', 'time_field'],\n [FieldType.BIGINT, FieldType.STRING, FieldType.DOUBLE, FieldType.BOOLEAN, FieldType.TIMESTAMP])\n dh.create_tuple_topic(project_name, topic_name, shard_count, life_cycle, record_schema, comment)\n\n # ============================= create blob topic =============================\n\n topic_name='blob_topic_test'\n shard_count = 3\n life_cycle = 7\n comment = 'blob topic'\n dh.create_tuple_topic(project_name, topic_name, shard_count, life_cycle, comment)\n\n # ============================= get topic =============================\n\n topic_result = dh.get_topic(project_name, topic_name)\n print(topic_result)\n print(topic_result.record_schema)\n\n # ============================= list shard =============================\n\n shards_result = dh.list_shards(project_name, topic_name)\n print(shards_result)\n\n # ============================= put tuple records =============================\n\n from datahub.models import TupleRecord\n records0 = []\n record0 = TupleRecord(schema=topic.record_schema, values=[1, 'yc1', 10.01, True, 1455869335000000])\n record0.shard_id = '0'\n record0.put_attribute('AK', '47')\n records0.append(record0)\n put_result = dh.put_records('pydatahub_test', 'tuple_topic_test', records0)\n print(put_result)\n\n # ============================= put tuple records =============================\n\n from datahub.models import BlobRecord\n data = None\n with open(os.path.join(root_path, 'tests/resources/datahub.png'), 'rb') as f:\n data = f.read()\n records1 = []\n record1 = BlobRecord(blob_data=data)\n record1.shard_id = '0'\n record1.put_attribute('a', 'b')\n records1.append(record1)\n put_result = dh.put_records('pydatahub_test', 'blob_topic_test', records1)\n print(put_result)\n\n # ============================= get cursor =============================\n\n from datahub.models import CursorType\n cursor_result = dh.get_cursor(project_name, topic_name, '0', CursorType.OLDEST)\n print(cursor_result)\n\n # ============================= get blob records =============================\n\n get_result = dh.get_blob_records(project_name, topic_name, '0', cursor, 10)\n print(get_result)\n print(get_result.records)\n print(get_result.records[0])\n\n # ============================= get tuple records =============================\n\n get_result = dh.get_tuple_records(project_name, topic_name, '0', record_schema, cursor, 10)\n print(get_result)\n print(get_result.records)\n print(get_result.records[0].values)\n\nExamples\n-----------\n\nsee more examples in `examples `__\n\nRelease\n--------\n\nUpdate `changelog `__, then use `bumpversion `__ to update version:\n\n1. bugfix: ``bumpversion patch``\n2. small feature\uff1a``bumpversion minor``\n3. breaking change\uff1a``bumpversion major``\n\nContributing\n------------\n\nFor a development install, clone the repository and then install from\nsource:\n\n::\n\n git clone https://github.com/aliyun/aliyun-datahub-sdk-python.git\n\nLicense\n-------\n\nLicensed under the `Apache License\n2.0 `__\n\n.. |PyPI version| image:: https://img.shields.io/pypi/v/pydatahub.svg?style=flat-square\n :target: https://pypi.python.org/pypi/pydatahub\n.. |Docs| image:: https://img.shields.io/badge/docs-latest-brightgreen.svg?style=flat-square\n :target: http://pydatahub.readthedocs.io/zh_CN/latest/\n.. |License| image:: https://img.shields.io/pypi/l/pydatahub.svg?style=flat-square\n :target: https://github.com/aliyun/aliyun-datahub-sdk-python/blob/master/LICENSE\n.. |Implementation| image:: https://img.shields.io/pypi/implementation/pydatahub.svg?style=flat-square\n",
"description_content_type": "",
"docs_url": null,
"download_url": "",
"downloads": {
"last_day": -1,
"last_month": -1,
"last_week": -1
},
"home_page": "https://github.com/aliyun/aliyun-datahub-sdk-python",
"keywords": "pydatahub",
"license": "Apache License 2.0",
"maintainer": "",
"maintainer_email": "",
"name": "pydatahub-beta",
"package_url": "https://pypi.org/project/pydatahub-beta/",
"platform": "",
"project_url": "https://pypi.org/project/pydatahub-beta/",
"project_urls": {
"Homepage": "https://github.com/aliyun/aliyun-datahub-sdk-python"
},
"release_url": "https://pypi.org/project/pydatahub-beta/0.0.6/",
"requires_dist": null,
"requires_python": "",
"summary": "Datahub Python SDK",
"version": "0.0.6"
},
"last_serial": 3988346,
"releases": {
"0.0.0": [
{
"comment_text": "",
"digests": {
"md5": "1bf4c9a0d476d6de691d6273c58f1881",
"sha256": "93916f776c6b7ebfc5a727ae4a303d7946795179755d598ba49bcd15054d19df"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.0.tar.gz",
"has_sig": false,
"md5_digest": "1bf4c9a0d476d6de691d6273c58f1881",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 38478,
"upload_time": "2018-05-28T12:50:25",
"url": "https://files.pythonhosted.org/packages/8b/c1/8153d68dc9d86e3b7f9ea25ad292744c759d1db6af3a1998f0e1ff1d90e7/pydatahub-beta-0.0.0.tar.gz"
}
],
"0.0.1": [
{
"comment_text": "",
"digests": {
"md5": "c45186e75d28c80ce4bb40c053e8f79e",
"sha256": "505af7539a69c49e2e7e7a4e0d3552f2789bbae94c7dfb6f2fd75c0575b4f43e"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.1.tar.gz",
"has_sig": false,
"md5_digest": "c45186e75d28c80ce4bb40c053e8f79e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 39249,
"upload_time": "2018-05-28T12:52:37",
"url": "https://files.pythonhosted.org/packages/48/b9/72a54c94a611da3cd395966c3c47831d38a1ef832858f63e7fb036c6c30f/pydatahub-beta-0.0.1.tar.gz"
}
],
"0.0.2": [
{
"comment_text": "",
"digests": {
"md5": "19465101878f9a75caa721197a8c0efb",
"sha256": "72651682f5e9b716233203ca774aa15c8a03ab364d5875284022b3e90cf78653"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.2.tar.gz",
"has_sig": false,
"md5_digest": "19465101878f9a75caa721197a8c0efb",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 37823,
"upload_time": "2018-05-28T13:30:33",
"url": "https://files.pythonhosted.org/packages/65/5a/6c0b973f0acf01d81f3c052d962cd8b3b072c1fb5cbdfa6b376338a00560/pydatahub-beta-0.0.2.tar.gz"
}
],
"0.0.3": [
{
"comment_text": "",
"digests": {
"md5": "58da0aa7963cd3c7a126c1ed3ff330bf",
"sha256": "b759c50b6b791cc7b4182ac9273169e7bbc21abbb3e58679146a0a6bcdb999b1"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.3.tar.gz",
"has_sig": false,
"md5_digest": "58da0aa7963cd3c7a126c1ed3ff330bf",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 38770,
"upload_time": "2018-05-28T13:37:15",
"url": "https://files.pythonhosted.org/packages/55/77/588fb45f80e50374a722f3b3f413ca34011bda2caa2f296ddf788eec7fc2/pydatahub-beta-0.0.3.tar.gz"
}
],
"0.0.4": [
{
"comment_text": "",
"digests": {
"md5": "9a347971c27af152088ad9c8e2c75fdc",
"sha256": "0e6a6d42fa459a5b6ebee576f93240f8a4f0ad910a521b08fb953f1ce14484e4"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.4.tar.gz",
"has_sig": false,
"md5_digest": "9a347971c27af152088ad9c8e2c75fdc",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 38875,
"upload_time": "2018-05-28T13:38:28",
"url": "https://files.pythonhosted.org/packages/8f/a4/67b1fdead36aeb28d6995522d0f0122fbcb7c69e602ca35d58c4489ff1b6/pydatahub-beta-0.0.4.tar.gz"
}
],
"0.0.5": [
{
"comment_text": "",
"digests": {
"md5": "1f82c74de73cb62873dedd86215dc5b5",
"sha256": "d99c582cc936a81d499545a3023314a14a786c4dc222692003983125b3af8a71"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.5.tar.gz",
"has_sig": false,
"md5_digest": "1f82c74de73cb62873dedd86215dc5b5",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 38891,
"upload_time": "2018-05-28T13:39:04",
"url": "https://files.pythonhosted.org/packages/0c/0f/dc870f4bbdb05b2ca996c25dd53759cd0642a4a02e0e74ea4c5ca84d8714/pydatahub-beta-0.0.5.tar.gz"
}
],
"0.0.6": [
{
"comment_text": "",
"digests": {
"md5": "cbaba54aeda2431d4be550e54f2208db",
"sha256": "f92639e82a6a74adc1db3cc7e384c94baa09f6589541be0eaa15bdfa43033bdb"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.6.tar.gz",
"has_sig": false,
"md5_digest": "cbaba54aeda2431d4be550e54f2208db",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 42156,
"upload_time": "2018-06-22T07:05:33",
"url": "https://files.pythonhosted.org/packages/0f/b3/60a7f930453ae24ec3b4ee98bfae4d21cb13c88792565ea8c58108d6cf0f/pydatahub-beta-0.0.6.tar.gz"
}
]
},
"urls": [
{
"comment_text": "",
"digests": {
"md5": "cbaba54aeda2431d4be550e54f2208db",
"sha256": "f92639e82a6a74adc1db3cc7e384c94baa09f6589541be0eaa15bdfa43033bdb"
},
"downloads": -1,
"filename": "pydatahub-beta-0.0.6.tar.gz",
"has_sig": false,
"md5_digest": "cbaba54aeda2431d4be550e54f2208db",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 42156,
"upload_time": "2018-06-22T07:05:33",
"url": "https://files.pythonhosted.org/packages/0f/b3/60a7f930453ae24ec3b4ee98bfae4d21cb13c88792565ea8c58108d6cf0f/pydatahub-beta-0.0.6.tar.gz"
}
]
}