{ "info": { "author": "phData inc", "author_email": "brian@phdata.io, tony@phdata.io", "bugtrack_url": null, "classifiers": [], "description": "sdctool\n=======\n\nA set of utilities to help with management of Streamsets pipelines.\n\nInstallation\n-----------\n\n``pip install sdctool``\n\nConfiguration\n-------------\n\nsdc-hosts.yml\n^^^^^^^^^^^^^\n\nCreate a YAML file called ``sdc-hosts.yml`` in the root of the project\nand fill in with details of the instances you plan to use with these\nutilities. See the ``template-sdc-hosts.yml`` for an example of the\nrequired formatting.\n\n``template-sdc-hosts.yml``:\n\n::\n\n instances:\n production:\n protocol: https\n host: production-sdc-host\n port: 18630\n verify_ssl: True\n stage:\n protocol: https\n host: stage-sdc-host\n port: 18630\n verify_ssl: True\n development:\n protocol: http\n host: dev-sdc-host\n port: 18630\n\ncreds.yml\n^^^^^^^^^\n\nCreate a YAML file called ``creds.yml`` in the root of the project and\nfill in with credentials of the instances you plan to use with these\nutilities. See the ``template-creds.yml`` for an example of the required\nformatting.\n\n``template-creds.yml``:\n\n::\n\n instances:\n production:\n user: admin\n pass: s3cr3t\n stage:\n user: admin\n pass: s35am3\n development:\n user: admin\n pass: adm1n15trat0r\n\nUsage\n^^^^^\n\nThe script ``sdc-tool`` includes help docs with details on the script\narguments.\n\nPromote Pipeline\n^^^^^^^^^^^^^^^^\n\nMigrate one pipeline from one SDC environment to another. SDC\nadministrator credentials are required to execute these commands. If a\n``destPipelineId`` is not specified, a new pipeline will be created with\nthe same name and description as the exported pipeline. Currently,\norigin offset values are not part of the exported configuration, so no\nmanipulation of the destination's offset is required.\n\n.. code:: bash\n\n $ sdc-tool pipeline promote --src dev \\\n --srcPipelineId ESImport77337a4f-74c5-45d1-91fd-7ce746f1bdfd \\\n --dest stage \\\n --destPipelineId ESImport48b1200f-c270-4937-a226-b3443ce850f3`\n\nExport Pipeline\n^^^^^^^^^^^^^^^\n\nExport pipeline to ``--out`` path.\n\n.. code:: bash\n\n $ sdc-tool pipeline export --src dev \\\n --out sdc.json \\\n --pipelineId StreamManagerConsumerV06fa7c3d3-458f-4446-9f51-398899118b73\n\nImport Pipeline\n^^^^^^^^^^^^^^^\n\nImport pipeline from ``--pipelineJson`` path.\n\n.. code:: bash\n\n $ sdc-tool pipeline import --dest production \\\n --pipelineJson testpipeline.json \\\n --pipelineId firstpipe\n\nStart Pipeline\n^^^^^^^^^^^^^^\n\n.. code:: bash\n\n $ sdc-tool pipeline start \\\n --pipelineId firstpipe \\\n --host production\n\nStop Pipeline\n^^^^^^^^^^^^^\n\n.. code:: bash\n\n $ sdc-tool pipeline stop \\\n --pipelineId firstpipe \\\n --host production\n\nValidate Pipeline\n^^^^^^^^^^^^^^^^^\n\nValidate pipleine and return issues.\n\n.. code:: bash\n\n $ sdc-tool pipeline validate \\\n --pipelineId firstpipe \\\n --host production\n\nDeveloping\n----------\n\nThis project depends on Python and Docker Compose Installing required\nlibraries\n\n.. code:: bash\n\n pip install -r requirements.txt", "description_content_type": "", "docs_url": null, "download_url": "https://github.com/phdata/sdc-api-tool/tree/master/dist/sdc-tool-0.11.0.tar.gz", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/phdata/sdc-api-tool", "keywords": "streamsets,api,pipeline,cli", "license": "", "maintainer": "", "maintainer_email": "", "name": "sdctool", "package_url": "https://pypi.org/project/sdctool/", "platform": "", "project_url": "https://pypi.org/project/sdctool/", "project_urls": { "Download": "https://github.com/phdata/sdc-api-tool/tree/master/dist/sdc-tool-0.11.0.tar.gz", "Homepage": "https://github.com/phdata/sdc-api-tool" }, "release_url": "https://pypi.org/project/sdctool/0.11.0/", "requires_dist": null, "requires_python": "", "summary": "Streamsets DataCollector API utility", "version": "0.11.0" }, "last_serial": 3827231, "releases": { "0.10.1": [ { "comment_text": "", "digests": { "md5": "0e34174fded10d090f27172fa5ef5e9e", "sha256": "a22cc1325c2e0cb5a08f61979714f692029ee0684d015f96cf746c57ef9b90fb" }, "downloads": -1, "filename": "sdctool-0.10.1.tar.gz", "has_sig": false, "md5_digest": "0e34174fded10d090f27172fa5ef5e9e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9195, "upload_time": "2017-10-12T18:58:16", "url": "https://files.pythonhosted.org/packages/25/4e/15f7b395f698a644607d5d886e02b5566febb3bb5bfea8707e547df1f766/sdctool-0.10.1.tar.gz" } ], "0.11.0": [ { "comment_text": "", "digests": { "md5": "3c52cea31707428e0c601828423fe9e6", "sha256": "8f54d12b6e9baffd273467499a62491ed8458fd21e24859e058d555e5a1b088d" }, "downloads": -1, "filename": "sdctool-0.11.0.tar.gz", "has_sig": false, "md5_digest": "3c52cea31707428e0c601828423fe9e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8715, "upload_time": "2018-05-02T14:11:15", "url": "https://files.pythonhosted.org/packages/dc/ac/654be88056f12e7c9897500281d2bfec3f40cc4d83ac68ae7b1537641d39/sdctool-0.11.0.tar.gz" } ], "0.9.4": [ { "comment_text": "", "digests": { "md5": "05d3f8c74f6ae4748e759f6b48c88a85", "sha256": "6ef033d691baa508996d68c136f97d8121b80afa25394951a3bf13c142aad70f" }, "downloads": -1, "filename": "sdctool-0.9.4.tar.gz", "has_sig": false, "md5_digest": "05d3f8c74f6ae4748e759f6b48c88a85", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8888, "upload_time": "2017-09-07T23:55:32", "url": "https://files.pythonhosted.org/packages/3f/7c/12a0c2ad13e2e5cb1fc6988eaa64a48ac0c3aeb8627cdfd4bda1d4f6a8bf/sdctool-0.9.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "3c52cea31707428e0c601828423fe9e6", "sha256": "8f54d12b6e9baffd273467499a62491ed8458fd21e24859e058d555e5a1b088d" }, "downloads": -1, "filename": "sdctool-0.11.0.tar.gz", "has_sig": false, "md5_digest": "3c52cea31707428e0c601828423fe9e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8715, "upload_time": "2018-05-02T14:11:15", "url": "https://files.pythonhosted.org/packages/dc/ac/654be88056f12e7c9897500281d2bfec3f40cc4d83ac68ae7b1537641d39/sdctool-0.11.0.tar.gz" } ] }