{ "info": { "author": "", "author_email": "", "bugtrack_url": null, "classifiers": [], "description": "Dask-XGBoost\n============\n\nDistributed training with XGBoost and Dask.distributed\n\nThis repository enables you to perform distributed training with XGBoost on\nDask.array and Dask.dataframe collections.\n\n::\n\n pip install dask-xgboost\n\nExample\n-------\n\n.. code-block:: python\n\n from dask.distributed import Client\n client = Client('scheduler-address:8786') # connect to cluster\n\n import dask.dataframe as dd\n df = dd.read_csv('...') # use dask.dataframe to load and\n df_train = ... # preprocess data\n labels_train = ...\n\n import dask_xgboost as dxgb\n params = {'objective': 'binary:logistic', ...} # use normal xgboost params\n bst = dxgb.train(client, params, df_train, labels_train)\n\n >>> bst # Get back normal XGBoost result\n \n\n predictions = dxgb.predict(client, bsg, data_test)\n\n\nHow this works\n--------------\n\nFor more information on using Dask.dataframe for preprocessing see the\n`Dask.dataframe documentation `_.\n\nOnce you have created suitable data and labels we are ready for distributed\ntraining with XGBoost. Every Dask worker sets up an XGBoost slave and gives\nthem enough information to find each other. Then Dask workers hand their\nin-memory Pandas dataframes to XGBoost (one Dask dataframe is just many Pandas\ndataframes spread around the memory of many machines). XGBoost handles\ndistributed training on its own without Dask interference. XGBoost then hands\nback a single ``xgboost.Booster`` result object.\n\n\nLarger Example\n--------------\n\nFor a more serious example see\n\n- `This blogpost `_\n- `This notebook `_\n- `This screencast `_\n\nHistory\n-------\n\nConversation during development happened at `dmlc/xgboost #2032\n`_\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/dask/dask-xgboost", "keywords": "", "license": "BSD", "maintainer": "Matthew Rocklin", "maintainer_email": "mrocklin@continuum.io", "name": "dask-xgboost", "package_url": "https://pypi.org/project/dask-xgboost/", "platform": "", "project_url": "https://pypi.org/project/dask-xgboost/", "project_urls": { "Homepage": "https://github.com/dask/dask-xgboost" }, "release_url": "https://pypi.org/project/dask-xgboost/0.1.9/", "requires_dist": [ "xgboost", "dask", "distributed (>=1.15.2)", "sparse ; extra == 'sparse'", "scipy ; extra == 'sparse'" ], "requires_python": "", "summary": "Interactions between Dask and XGBoost", "version": "0.1.9" }, "last_serial": 5985088, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "651b6878707f85d29de625a3fee8c9d1", "sha256": "2b381395fd1dff1ee144f3340b85cbe559df3e641fb5c2ebd20ceb1944cf21b9" }, "downloads": -1, "filename": "dask_xgboost-0.1.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "651b6878707f85d29de625a3fee8c9d1", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 10905, "upload_time": "2017-02-27T20:45:22", "url": "https://files.pythonhosted.org/packages/33/d3/ba9dcfacb52f7059268797c689845a3e9cd663d049ffc897893ed1bdcd11/dask_xgboost-0.1.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4554e9640fb6b327feeb61e885fa2f6d", "sha256": "eb0258422b7071f6f184672310dc48d35f2bb4358621fa9c8b5992501fabb02d" }, "downloads": -1, "filename": "dask-xgboost-0.1.0.tar.gz", "has_sig": false, "md5_digest": "4554e9640fb6b327feeb61e885fa2f6d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8667, "upload_time": "2017-02-27T20:45:23", "url": "https://files.pythonhosted.org/packages/8b/97/94902ba5a64cb9f8a2df92d949c0f86a1e1382d899494e636f02bbd1c491/dask-xgboost-0.1.0.tar.gz" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "01df044f8b647c2b76b7632707120315", "sha256": "f5f69a6d0ba8ec2c116e09e785b618d5e71757c5801c8f1e8783149dea22071b" }, "downloads": -1, "filename": "dask_xgboost-0.1.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "01df044f8b647c2b76b7632707120315", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 11082, "upload_time": "2017-03-28T21:58:33", "url": "https://files.pythonhosted.org/packages/5a/58/5259a559ec776ce69cb7b4d95dca3c0af5a1d0931f3eab6f142d995e0b33/dask_xgboost-0.1.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "23a41ea8cbb734a71607dd6c1f10f357", "sha256": "2df70c9bf70a287f26c7a69b82959d078b2f661af46876a9b3b43c0f939f2938" }, "downloads": -1, "filename": "dask-xgboost-0.1.2.tar.gz", "has_sig": false, "md5_digest": "23a41ea8cbb734a71607dd6c1f10f357", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8739, "upload_time": "2017-03-28T21:58:34", "url": "https://files.pythonhosted.org/packages/8a/df/737413c5aef1e3cf69db57882098635b93d72656bfa80ee33625238a46fe/dask-xgboost-0.1.2.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "f1aef1afa847afe752109fffa92b6217", "sha256": "315d774179ad82be301b9d87e119757d1c937f046fe9340b32ad7dc08545be20" }, "downloads": -1, "filename": "dask_xgboost-0.1.3-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "f1aef1afa847afe752109fffa92b6217", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 11081, "upload_time": "2017-04-03T16:05:45", "url": "https://files.pythonhosted.org/packages/71/62/1374455839b504fa67ec837d074b6a9210cf60934b2c17402b288f4daf20/dask_xgboost-0.1.3-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "f26ecf1addfc274b705af773a3fd0b9e", "sha256": "88a3281a90408c01719735774f583004ff2a0ad99c36f43c624cb02a11eaab5d" }, "downloads": -1, "filename": "dask-xgboost-0.1.3.tar.gz", "has_sig": false, "md5_digest": "f26ecf1addfc274b705af773a3fd0b9e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10475, "upload_time": "2017-04-03T16:05:47", "url": "https://files.pythonhosted.org/packages/35/be/0343d81c916f0d2b34497bf9ccc08f42c50bccad77e37a77165ba14fd2e4/dask-xgboost-0.1.3.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "8f9317d8f2994102deb41a5c810e2606", "sha256": "bea11a461790d4153918486c53bc020a3aeacfc7c9ed920a3ea563bf5775ffd7" }, "downloads": -1, "filename": "dask_xgboost-0.1.5-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "8f9317d8f2994102deb41a5c810e2606", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 11887, "upload_time": "2019-06-26T03:14:50", "url": "https://files.pythonhosted.org/packages/ca/e2/2aca20f6d99cafb6e614b73ff685eedf91cbebf3e557806f78a1188a1e28/dask_xgboost-0.1.5-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4d2b7b3a217eacd92791a4386c002918", "sha256": "1860d06965fe68def1c83b9195130a92050fd4bc28bf2be689898a3a74ee1316" }, "downloads": -1, "filename": "dask-xgboost-0.1.5.tar.gz", "has_sig": false, "md5_digest": "4d2b7b3a217eacd92791a4386c002918", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11514, "upload_time": "2017-11-17T21:37:34", "url": "https://files.pythonhosted.org/packages/da/3b/d4cd935dae08e83ff7c8efc2cf16a5e4103e5a0cfc5eebd37ec3bbce32fd/dask-xgboost-0.1.5.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "cf28ba4560c484ecd3d801728520a27f", "sha256": "8b122c15d3180dd318afe4ddf0862d93add71c34c12ad87853c87f92067e990d" }, "downloads": -1, "filename": "dask_xgboost-0.1.7-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "cf28ba4560c484ecd3d801728520a27f", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 11886, "upload_time": "2019-06-26T03:16:44", "url": "https://files.pythonhosted.org/packages/9f/0a/717a74df509093abffca80bdae0b1f23c8728172598ea406d54a2667aaea/dask_xgboost-0.1.7-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "efb0b4c99961a8385b4330fe83aed1c4", "sha256": "c4eb7989e0b4bcab956c5ab5f89c3419016615ad1ca8f6596ca471e402aae43b" }, "downloads": -1, "filename": "dask-xgboost-0.1.7.tar.gz", "has_sig": false, "md5_digest": "efb0b4c99961a8385b4330fe83aed1c4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 14512, "upload_time": "2019-06-26T03:16:46", "url": "https://files.pythonhosted.org/packages/2a/6e/d072c0ab938ae46ce5e3d196f33cc5492e98302c1ccc16661da1557fe1b3/dask-xgboost-0.1.7.tar.gz" } ], "0.1.9": [ { "comment_text": "", "digests": { "md5": "45e72d3ce7333a73f1d520e9987ced0a", "sha256": "63db4a006a155c80b06d3c1a5bb7cc7dd249e9bba8cd2373e84a4c85ad82ca93" }, "downloads": -1, "filename": "dask_xgboost-0.1.9-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "45e72d3ce7333a73f1d520e9987ced0a", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 13008, "upload_time": "2019-10-16T16:20:59", "url": "https://files.pythonhosted.org/packages/1c/bd/d69f0546e7652daa7717aa44ef5346e023e7dd6cc6a50e397872dee27add/dask_xgboost-0.1.9-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "c22275ea95a37255d4b0b65a40b075bd", "sha256": "6faeeed044112151e28770b69fb1ad06b026597726ce8dc185fd3ae45363d0c0" }, "downloads": -1, "filename": "dask-xgboost-0.1.9.tar.gz", "has_sig": false, "md5_digest": "c22275ea95a37255d4b0b65a40b075bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 15533, "upload_time": "2019-10-16T16:21:01", "url": "https://files.pythonhosted.org/packages/a7/b5/a2f11219838919ccb78cf7a839fb59acaabdc2a11ee2b5df21f04e131acd/dask-xgboost-0.1.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "45e72d3ce7333a73f1d520e9987ced0a", "sha256": "63db4a006a155c80b06d3c1a5bb7cc7dd249e9bba8cd2373e84a4c85ad82ca93" }, "downloads": -1, "filename": "dask_xgboost-0.1.9-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "45e72d3ce7333a73f1d520e9987ced0a", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 13008, "upload_time": "2019-10-16T16:20:59", "url": "https://files.pythonhosted.org/packages/1c/bd/d69f0546e7652daa7717aa44ef5346e023e7dd6cc6a50e397872dee27add/dask_xgboost-0.1.9-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "c22275ea95a37255d4b0b65a40b075bd", "sha256": "6faeeed044112151e28770b69fb1ad06b026597726ce8dc185fd3ae45363d0c0" }, "downloads": -1, "filename": "dask-xgboost-0.1.9.tar.gz", "has_sig": false, "md5_digest": "c22275ea95a37255d4b0b65a40b075bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 15533, "upload_time": "2019-10-16T16:21:01", "url": "https://files.pythonhosted.org/packages/a7/b5/a2f11219838919ccb78cf7a839fb59acaabdc2a11ee2b5df21f04e131acd/dask-xgboost-0.1.9.tar.gz" } ] }