{ "info": { "author": "Surreal AI", "author_email": "", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Programming Language :: Python :: 3" ], "description": "Cloudwise\n=========\n\n| `Installation <#installation>`__\n| `Usage <#usage>`__\n| `FAQs <#faqs>`__\n\n--------------\n\n``cloudwise`` is Surreal\u2019s cloud infrastructure provisioner based on\nTerraform. Surreal\u2019s `website `__ and\n`github `__.\n\nIt prepares a kubernetes cluster using terraform. It generates\n``.tf.json`` files that are also recognized by\n`Symphony `__.\n\nInstallation\n============\n\n- Cloud wise runs in python 3\n- Do\n ``git clone git@github.com:SurrealAI/cloudwise.git && cd cloudwise``\n- Run ``pip install -e .`` in this directory.\n- Install ``terraform`` following instructions\n `here `__\n- Install ``kubectl`` following instructions\n `here `__\n\nUsage\n=====\n\n- (Optional, Recommended) Create and work in a clean directory as\n running terraform would generate relevant files.\n\n.. code:: bash\n\n > mkdir surreal\n > cd surreal\n\nGoogle Cloud\n------------\n\n- You first need to setup credentials for ``terraform`` to access\n google cloud. See guide\n `here `__.\n Choose one of the two methods:\n\n - Run the following command\n\n .. code:: bash\n\n gcloud auth application-default login\n\n or\n\n - Go to the api key management page\n https://console.cloud.google.com/apis/credentials/serviceaccountkey\n and select **Create new service account**. You would need to give\n the service account sufficient permissions to do things properly.\n **Project editor** would suffice but is also more than enough. You\n can then generate and download the key, (*json* format is fine).\n Put the path to the ``.json`` file into the commandline argument\n when prompted.\n\n- Follow the instructions in the commandline tool.\n\n.. code:: bash\n\n > cloudwise-gke\n\nIt will provide instructions and generate a ``.tf.json``\nfile which terraform recognizes. If you have generated a ``.json``\ncredential file, you should provide it when prompted. \\*\n``terraform init && terraform plan`` describes changes to be made. \\*\n``terraform apply`` makes the changes to your cloud project. \\* After\ncluster creation, obtain credentials for kubectl.\n\n.. code:: bash\n\n > gcloud container clusters get-credentials \n\n- If you have GPUs in your cluster, create the daemon set to install\n drivers, see\n `documentation `__.\n\n.. code:: bash\n\n > kubectl apply -f https://raw.githubusercontent.com/GoogleCloudPlatform/container-engine-accelerators/stable/nvidia-driver-installer/cos/daemonset-preloaded.yaml\n\n- The generated ``.tf.json`` is also recognized by\n `Symphony `__\\ \u2019s scheduling\n mechanism and ``Surreal``. So you may want to link to it\n- If you want to remove everything, run ``terraform destroy``\n\nAWS\n---\n\nStay tuned\n\nAzure\n-----\n\nStay tuned\n\nFAQs:\n=====\n\n- Terraform install fails.\n\n - If you are seeing error:\n ``... API has not been used in project...``: during\n ``terraform apply``, go to the Kubernetes Engine tab and/or\n Compute Engine tab on your google cloud console to enable their\n APIs.\n\n- GPU nodes are not scaling up.\n\n - Check if the driver installation daemon set is running (see\n `documentation `__).\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://github.com/SurrealAI/cloudwise", "keywords": "machine learning,cloud computing,distributed computing,terraform,kubernetes", "license": "GPLv3", "maintainer": "", "maintainer_email": "", "name": "cloudwise", "package_url": "https://pypi.org/project/cloudwise/", "platform": "", "project_url": "https://pypi.org/project/cloudwise/", "project_urls": { "Homepage": "http://github.com/SurrealAI/cloudwise" }, "release_url": "https://pypi.org/project/cloudwise/0.1.1/", "requires_dist": null, "requires_python": ">=3.5", "summary": "Set up a Kubernetes cluster for distributed AI research", "version": "0.1.1" }, "last_serial": 4425221, "releases": { "0.0.0": [ { "comment_text": "", "digests": { "md5": "4accc5b600e2ec2d4740ab391464e931", "sha256": "e168d132c63fe80a36102d709ae4985e2e085652091144fd743e5d7a1b96d970" }, "downloads": -1, "filename": "cloudwise-0.0.0-py3-none-any.whl", "has_sig": false, "md5_digest": "4accc5b600e2ec2d4740ab391464e931", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 1294, "upload_time": "2018-06-22T23:46:40", "url": "https://files.pythonhosted.org/packages/a1/63/4c38309648b00ed47d14c38f8370a814e8bc95e809d803baac1d0dc6e408/cloudwise-0.0.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "60102ba9c0e245d8cb5e80ecf3b85b4d", "sha256": "32b94b94772bb7e5ff7945ccc31f9c6b1b5182bfb8f20eca6980e185808270cb" }, "downloads": -1, "filename": "cloudwise-0.0.0.tar.gz", "has_sig": false, "md5_digest": "60102ba9c0e245d8cb5e80ecf3b85b4d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1028, "upload_time": "2018-06-22T23:46:41", "url": "https://files.pythonhosted.org/packages/fb/ba/1119c3c8bc00d2e944daaafb74fe7ef3c99d5f61c8ca052e3f890a899d96/cloudwise-0.0.0.tar.gz" } ], "0.1": [ { "comment_text": "", "digests": { "md5": "2faec3dbe638b0de7673ff5043eb4647", "sha256": "72c0c8617e55e703f438251d3cb0674085e9f0da7cfa45ea51565b9c759ae0d0" }, "downloads": -1, "filename": "cloudwise-0.1-py3-none-any.whl", "has_sig": false, "md5_digest": "2faec3dbe638b0de7673ff5043eb4647", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.5", "size": 3108, "upload_time": "2018-10-28T20:44:52", "url": "https://files.pythonhosted.org/packages/14/f8/fe9da35313429a9557ae4bc7da65324a0b241570bc14650ed5178f959782/cloudwise-0.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "55b358b7c80dee4c7505ef721efe906d", "sha256": "2c85e4f5aa7166c50b8a5eb314b14d6e028847300daeb56940a4f691ed396547" }, "downloads": -1, "filename": "cloudwise-0.1.tar.gz", "has_sig": false, "md5_digest": "55b358b7c80dee4c7505ef721efe906d", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 3633, "upload_time": "2018-10-28T20:44:53", "url": "https://files.pythonhosted.org/packages/d4/b9/68dddfed0e799b4b0067c87ea10b414f3c84d18a2cfdbcf587be2617899e/cloudwise-0.1.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "759551f9802653959238f1e10113f047", "sha256": "b19b5d29f42f8d91a45bc2fbba3185e6e7b699b919a165a1d9f7ebd35aeaa8de" }, "downloads": -1, "filename": "cloudwise-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "759551f9802653959238f1e10113f047", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.5", "size": 9041, "upload_time": "2018-10-28T20:48:28", "url": "https://files.pythonhosted.org/packages/ed/85/ee86a4dd11894820b9be5983625e09e10d5fc79cb4b873b098b0725ce6ed/cloudwise-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1abd7d7fb45a4297b4c6779d2130d488", "sha256": "0cf1758321d4191caed367369c01976e15e98259d890b69fbed0f95052529f3d" }, "downloads": -1, "filename": "cloudwise-0.1.1.tar.gz", "has_sig": false, "md5_digest": "1abd7d7fb45a4297b4c6779d2130d488", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 9079, "upload_time": "2018-10-28T20:48:29", "url": "https://files.pythonhosted.org/packages/30/d3/734b2449ae6b66c7f91bb5ffd2af344b8ef016a36e58b6cf211ea3dbdcb6/cloudwise-0.1.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "759551f9802653959238f1e10113f047", "sha256": "b19b5d29f42f8d91a45bc2fbba3185e6e7b699b919a165a1d9f7ebd35aeaa8de" }, "downloads": -1, "filename": "cloudwise-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "759551f9802653959238f1e10113f047", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.5", "size": 9041, "upload_time": "2018-10-28T20:48:28", "url": "https://files.pythonhosted.org/packages/ed/85/ee86a4dd11894820b9be5983625e09e10d5fc79cb4b873b098b0725ce6ed/cloudwise-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1abd7d7fb45a4297b4c6779d2130d488", "sha256": "0cf1758321d4191caed367369c01976e15e98259d890b69fbed0f95052529f3d" }, "downloads": -1, "filename": "cloudwise-0.1.1.tar.gz", "has_sig": false, "md5_digest": "1abd7d7fb45a4297b4c6779d2130d488", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 9079, "upload_time": "2018-10-28T20:48:29", "url": "https://files.pythonhosted.org/packages/30/d3/734b2449ae6b66c7f91bb5ffd2af344b8ef016a36e58b6cf211ea3dbdcb6/cloudwise-0.1.1.tar.gz" } ] }