{ "info": { "author": "SErAphLi, taibende", "author_email": "", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "License :: OSI Approved :: Apache Software License", "Operating System :: POSIX :: Linux", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy", "Topic :: Software Development :: Object Brokering", "Topic :: System :: Distributed Computing" ], "description": "# ![Waldorf](docs/figures/WaldorfLogo.png)\n\nWaldorf is an efficient, parallel task execution framework written in Python.\nIt was developed for research into [reinforcement learning](https://en.wikipedia.org/wiki/Reinforcement_learning)\nalgorithms at [our startup company](http://www.levelup.ai/) in Beijing, China.\n\nWaldorf is based on the [Celery distributed task queue](https://github.com/celery/celery),\nand takes its name from [Waldorf salad](https://en.wikipedia.org/wiki/Waldorf_salad),\nwhich also has celery as an ingredient.\n\nIt can speed up algorithms such as [Monte Carlo Tree Search (MCTS)](https://en.wikipedia.org/wiki/Monte_Carlo_tree_search) by\nspreading concurrent sub-tasks, written as Python functions, across multiple\nmachines and automating the collection of outputs. Waldorf can also be used\nto implement MapReduce-style work-flows.\n\nAlthough Waldorf can be deployed on cloud servers, our emphasis at the moment\nis on utilizing the spare CPU capacity of a commodity PC cluster (e.g. normal\noffice workstations). Support for GPUs may be included in a future release.\n\n## Features\n\n1. Waldorf uses a master node to pass messages between a client and\nslave nodes.\n\n2. A client can create a task as a Python function on his or her local machine.\nWaldorf sends tasks to a network of slave machines for execution using the\nCelery task queue. When Celery is used on its own, tasks typically must be\ndefined in advance, but Waldorf allows tasks to be defined dynamically\nwithout any slave restarts required.\n\n3. Multiple clients can run their tasks simultaneously without conflict.\n\n4. Clients can adjust how many CPU cores are used on slave machines to\nperform calculations. This can be done dynamically from the Waldorf\nadministration webpage.\n\n![Screenshot of Waldorf admin webpage](docs/figures/waldorf_admin_webpage.png)\n\n## Basic Usage\n\nYou can use Waldorf on any task that requires parallel computing.\n\nOne of its many uses is to compute rollouts in an MCTS simulation (for\nexample, in game-playing AIs).\n\nHere is a simple illustration:\n\n```python\ndef rollout(args):\n # Do one rollout\n ...\n\ndef backup(result):\n # Backup and handle result\n ...\n\ndef mcts_search():\n for _ in range(iter):\n # Select action\n action = select()\n ...\n # Submit rollout job to waldorf client\n client.submit(rollout, args, callback=backup)\n ...\n # More code\n ...\n```\n\nFor a more complex example, check out [the gym demo](example/gym_demo.py).\n\n## Quick Start\n\nInstall Waldorf using [the installation guide](docs/installation.md) and\ncheck out [the gym demo](example/gym_demo.py).\n\n## Disclaimer\n\nWaldorf is still research code, so it may be slightly lacking in terms of\ndocumentation and support. Any feedback is welcomed.\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/levelupai/waldorf.git", "keywords": "", "license": "Apache", "maintainer": "", "maintainer_email": "", "name": "waldorf", "package_url": "https://pypi.org/project/waldorf/", "platform": "", "project_url": "https://pypi.org/project/waldorf/", "project_urls": { "Homepage": "https://github.com/levelupai/waldorf.git" }, "release_url": "https://pypi.org/project/waldorf/0.6.0.post1/", "requires_dist": [ "virtualenv (>=16.5.0)", "psutil (>=5.6.2)", "aiohttp (==3.1.3)", "celery (>=4.3.0)", "python-socketio (>=4.0.1)", "tqdm (>=4.23.3)", "requests (>=2.21.0)", "redis (>=3.2.1)", "pycryptodome (>=3.8.1)", "pexpect (>=4.7.0)", "jsonpickle (>=1.1)", "tabulate (>=0.8.3)" ], "requires_python": "", "summary": "Waldorf, a distribution computing package based on celery", "version": "0.6.0.post1" }, "last_serial": 5450504, "releases": { "0.6.0.post1": [ { "comment_text": "", "digests": { "md5": "76b489345642879685697a093d1835ca", "sha256": "58ae08b9922f931875437d24f5eb677f0a4cac9f75cc0ec1c305887682844c22" }, "downloads": -1, "filename": "waldorf-0.6.0.post1-py3-none-any.whl", "has_sig": false, "md5_digest": "76b489345642879685697a093d1835ca", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 219319, "upload_time": "2019-06-26T09:05:46", "url": "https://files.pythonhosted.org/packages/3a/a1/75896b08b74765c7d2038edad2659c9bdc337f54f2debbccbedbfa0b46dc/waldorf-0.6.0.post1-py3-none-any.whl" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "76b489345642879685697a093d1835ca", "sha256": "58ae08b9922f931875437d24f5eb677f0a4cac9f75cc0ec1c305887682844c22" }, "downloads": -1, "filename": "waldorf-0.6.0.post1-py3-none-any.whl", "has_sig": false, "md5_digest": "76b489345642879685697a093d1835ca", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 219319, "upload_time": "2019-06-26T09:05:46", "url": "https://files.pythonhosted.org/packages/3a/a1/75896b08b74765c7d2038edad2659c9bdc337f54f2debbccbedbfa0b46dc/waldorf-0.6.0.post1-py3-none-any.whl" } ] }