{ "info": { "author": "CyberZHG", "author_email": "CyberZHG@users.noreply.github.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3.6" ], "description": "# Keras RAdam\n\n[![Travis](https://travis-ci.org/CyberZHG/keras-radam.svg)](https://travis-ci.org/CyberZHG/keras-radam)\n[![Coverage](https://coveralls.io/repos/github/CyberZHG/keras-radam/badge.svg?branch=master)](https://coveralls.io/github/CyberZHG/keras-radam)\n[![Version](https://img.shields.io/pypi/v/keras-rectified-adam.svg)](https://pypi.org/project/keras-rectified-adam/)\n![Downloads](https://img.shields.io/pypi/dm/keras-rectified-adam.svg)\n![License](https://img.shields.io/pypi/l/keras-rectified-adam.svg)\n\n![](https://img.shields.io/badge/keras-tensorflow-blue.svg)\n![](https://img.shields.io/badge/keras-theano-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras/eager-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras/2.0_beta-blue.svg)\n\n\\[[\u4e2d\u6587](https://github.com/CyberZHG/keras-radam/blob/master/README.zh-CN.md)|[English](https://github.com/CyberZHG/keras-radam/blob/master/README.md)\\]\n\nUnofficial implementation of [RAdam](https://arxiv.org/pdf/1908.03265v1.pdf) in Keras and TensorFlow. \n\n## Install\n\n```bash\npip install keras-rectified-adam\n```\n\n## External Link\n\n- [tensorflow/addons:RectifiedAdam](https://github.com/tensorflow/addons/blob/master/tensorflow_addons/optimizers/rectified_adam.py)\n\n## Usage\n\n```python\nimport keras\nimport numpy as np\nfrom keras_radam import RAdam\n\n# Build toy model with RAdam optimizer\nmodel = keras.models.Sequential()\nmodel.add(keras.layers.Dense(input_shape=(17,), units=3))\nmodel.compile(RAdam(), loss='mse')\n\n# Generate toy data\nx = np.random.standard_normal((4096 * 30, 17))\nw = np.random.standard_normal((17, 3))\ny = np.dot(x, w)\n\n# Fit\nmodel.fit(x, y, epochs=5)\n```\n\n### TensorFlow without Keras\n\n```python\nfrom keras_radam.training import RAdamOptimizer\n\nRAdamOptimizer(learning_rate=1e-3)\n```\n\n### Use Warmup\n\n```python\nfrom keras_radam import RAdam\n\nRAdam(total_steps=10000, warmup_proportion=0.1, min_lr=1e-5)\n```\n\n## Q & A\n\n### About Correctness\n\nThe optimizer produces similar losses and weights to the official optimizer after 500 steps.\n\n### Use `tf.keras` or `tf-2.0`\n\nAdd `TF_KERAS=1` to environment variables to use `tensorflow.python.keras`.\n\n### Use `theano` Backend\n\nAdd `KERAS_BACKEND=theano` to environment variables to enable `theano` backend.", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/CyberZHG/keras-radam", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "keras-radam", "package_url": "https://pypi.org/project/keras-radam/", "platform": "", "project_url": "https://pypi.org/project/keras-radam/", "project_urls": { "Homepage": "https://github.com/CyberZHG/keras-radam" }, "release_url": "https://pypi.org/project/keras-radam/0.15.0/", "requires_dist": null, "requires_python": "", "summary": "RAdam implemented in Keras & TensorFlow", "version": "0.15.0" }, "last_serial": 5873055, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "4a1aa482905f9d420025684f33dc2168", "sha256": "7f45ca368d5f27b35ec4fc56414906268ef3c3b1ab386cbd983ccb1aa15b4500" }, "downloads": -1, "filename": "keras-radam-0.1.0.tar.gz", "has_sig": false, "md5_digest": "4a1aa482905f9d420025684f33dc2168", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6548, "upload_time": "2019-08-16T16:39:13", "url": "https://files.pythonhosted.org/packages/ef/1d/1957316b072bd8a09764e8635fdc385938ce32e555949ef4f7a61992f398/keras-radam-0.1.0.tar.gz" } ], "0.10.0": [ { "comment_text": "", "digests": { "md5": "58f83482b59e78036e6cc2175f9860fd", "sha256": "8c851c98d05b590c38684274ab100860c20f5af8f8632a841c2785e8d9a5109a" }, "downloads": -1, "filename": "keras-radam-0.10.0.tar.gz", "has_sig": false, "md5_digest": "58f83482b59e78036e6cc2175f9860fd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11309, "upload_time": "2019-08-27T15:15:37", "url": "https://files.pythonhosted.org/packages/d5/b9/40016f6e882be739b233383f458c543fc375f24cfa05b048b22c681ec0a9/keras-radam-0.10.0.tar.gz" } ], "0.11.0": [ { "comment_text": "", "digests": { "md5": "7d3f13fd11141d9b139811f3e64faf2f", "sha256": "3e5faafe81f4db4f9a92b255b7bc968b9258cbbdafe559bf9d778a8bb92d7774" }, "downloads": -1, "filename": "keras-radam-0.11.0.tar.gz", "has_sig": false, "md5_digest": "7d3f13fd11141d9b139811f3e64faf2f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11344, "upload_time": "2019-08-29T15:21:20", "url": "https://files.pythonhosted.org/packages/ef/bc/28a66ce0325df27ce38e8713b044b7d594f8f64b19c517d932e597cd7e06/keras-radam-0.11.0.tar.gz" } ], "0.12.0": [ { "comment_text": "", "digests": { "md5": "9ac6d642e533c0baeaf3d66b21421966", "sha256": "80134a338829fee24ea4234936c44d827ccbbd3cb85152d38d73e36175ae6c4c" }, "downloads": -1, "filename": "keras-radam-0.12.0.tar.gz", "has_sig": false, "md5_digest": "9ac6d642e533c0baeaf3d66b21421966", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11329, "upload_time": "2019-08-30T10:55:30", "url": "https://files.pythonhosted.org/packages/46/a2/5e7675410a187a8f35f321f3d3bf9e5116aec64a4b37ab34e07353fe30a3/keras-radam-0.12.0.tar.gz" } ], "0.14.0": [ { "comment_text": "", "digests": { "md5": "10380b92bdb52f12114a4a96e319f9a0", "sha256": "a87c96ab239ab30a08bcda76fdb1cdb2f3f0e40e9caef023baa031a1bc3de991" }, "downloads": -1, "filename": "keras-radam-0.14.0.tar.gz", "has_sig": false, "md5_digest": "10380b92bdb52f12114a4a96e319f9a0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11552, "upload_time": "2019-09-19T02:34:07", "url": "https://files.pythonhosted.org/packages/33/a3/66c848744c3e887437df16ebc112700b45db55a28d8f0c77995815b9b9dc/keras-radam-0.14.0.tar.gz" } ], "0.15.0": [ { "comment_text": "", "digests": { "md5": "ab795e4df7f0933150f646fbff8aefa0", "sha256": "4a0bbcaa3bcd20e0a7a05192a15fcf490fe26f4cfc677b65a056155b866d58e1" }, "downloads": -1, "filename": "keras-radam-0.15.0.tar.gz", "has_sig": false, "md5_digest": "ab795e4df7f0933150f646fbff8aefa0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11740, "upload_time": "2019-09-23T11:31:52", "url": "https://files.pythonhosted.org/packages/46/8d/b83ccaa94253fbc920b21981f038393041d92236bb541751b98a66a2ac1d/keras-radam-0.15.0.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "8178d8fa03ed6b80ebbcfc65a5014da6", "sha256": "bb1c6f39cb4c06ed56187e238d918a890f8a365dce878f6cbf3acd7226f8bb2f" }, "downloads": -1, "filename": "keras-radam-0.2.0.tar.gz", "has_sig": false, "md5_digest": "8178d8fa03ed6b80ebbcfc65a5014da6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6428, "upload_time": "2019-08-17T02:55:52", "url": "https://files.pythonhosted.org/packages/13/19/9745dd937fbba2907f21e75ac669447f6e43d95f2de7dcfb6c53d9690b0a/keras-radam-0.2.0.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "19e6c0d16be115f9a7c9321710e5b21f", "sha256": "49558cac3037b4f9e22f9fa6b078ee77e87c9bafdd1445bc8e0e61b20a32826e" }, "downloads": -1, "filename": "keras-radam-0.3.0.tar.gz", "has_sig": false, "md5_digest": "19e6c0d16be115f9a7c9321710e5b21f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6430, "upload_time": "2019-08-18T14:57:04", "url": "https://files.pythonhosted.org/packages/b7/e0/01eaa5f4b655952693f144514b16ef88532b0dccb493f76056a7f1b3f083/keras-radam-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "b706425fae253269083d4fe34245cbd2", "sha256": "aeef02c389b98007735aed25dba5b83a18562581075485804ff797d5296f1ca0" }, "downloads": -1, "filename": "keras-radam-0.4.0.tar.gz", "has_sig": false, "md5_digest": "b706425fae253269083d4fe34245cbd2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8109, "upload_time": "2019-08-19T04:19:12", "url": "https://files.pythonhosted.org/packages/0c/c6/4bed07438df1dc0904f61d68e763ae7ee000b8db39bed653e9d773c6c555/keras-radam-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "de620a1ff61c1d9df5f068d859a2c1e8", "sha256": "57c6d4e07e1cf0a3a1e475c031f7a8b9447c1edaf331c82ac1b35cd2df812e93" }, "downloads": -1, "filename": "keras-radam-0.5.0.tar.gz", "has_sig": false, "md5_digest": "de620a1ff61c1d9df5f068d859a2c1e8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8130, "upload_time": "2019-08-20T16:01:56", "url": "https://files.pythonhosted.org/packages/bb/9a/9d915db845a116ff893d23584df127cc4da251b5c87c3f1b31dc08dfffac/keras-radam-0.5.0.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "0d56223061ee0124462851fba977936d", "sha256": "3bb1a88726ea3cf27c99946c0cd44a3e5523889355ce973ae22438b3703f0aec" }, "downloads": -1, "filename": "keras-radam-0.6.0.tar.gz", "has_sig": false, "md5_digest": "0d56223061ee0124462851fba977936d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8566, "upload_time": "2019-08-20T17:03:29", "url": "https://files.pythonhosted.org/packages/96/51/3528b7999fe753422e8737c0badb319fb13a1b072b69ea27882a3310583f/keras-radam-0.6.0.tar.gz" } ], "0.7.0": [ { "comment_text": "", "digests": { "md5": "96c71707a2279740c8cafd37158c0c99", "sha256": "4d9a4bf6aa86064ae91d7ba6e67803c57ae6ed68815de9fd91f1e460f0792a4c" }, "downloads": -1, "filename": "keras-radam-0.7.0.tar.gz", "has_sig": false, "md5_digest": "96c71707a2279740c8cafd37158c0c99", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8571, "upload_time": "2019-08-21T11:59:54", "url": "https://files.pythonhosted.org/packages/1c/b7/28dd0197868e82b2f4a027c28293b1f81778459590652b7e73bde98f1752/keras-radam-0.7.0.tar.gz" } ], "0.8.0": [ { "comment_text": "", "digests": { "md5": "106dc89fb8d4a6f212e4ca56aba76d4b", "sha256": "553443937368494c693f3ae91ac428830898d09bf19547e33f65a513908d551e" }, "downloads": -1, "filename": "keras-radam-0.8.0.tar.gz", "has_sig": false, "md5_digest": "106dc89fb8d4a6f212e4ca56aba76d4b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11031, "upload_time": "2019-08-21T15:02:38", "url": "https://files.pythonhosted.org/packages/6c/8e/b50859f029b4e83a849e1b35a3ebe92bdb53b958113a985a2dd664a6248f/keras-radam-0.8.0.tar.gz" } ], "0.9.0": [ { "comment_text": "", "digests": { "md5": "2f3ba1db1f9547caa01a68beba2372fb", "sha256": "aa87d10b8aca3415daa11080e3f68a42247e248f0af20296e5b9c0d7e14cd37f" }, "downloads": -1, "filename": "keras-radam-0.9.0.tar.gz", "has_sig": false, "md5_digest": "2f3ba1db1f9547caa01a68beba2372fb", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11277, "upload_time": "2019-08-21T17:42:44", "url": "https://files.pythonhosted.org/packages/9d/cd/ce986c2558390f907d358cc0162be0d441babd1048f79636929cbc7aa741/keras-radam-0.9.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ab795e4df7f0933150f646fbff8aefa0", "sha256": "4a0bbcaa3bcd20e0a7a05192a15fcf490fe26f4cfc677b65a056155b866d58e1" }, "downloads": -1, "filename": "keras-radam-0.15.0.tar.gz", "has_sig": false, "md5_digest": "ab795e4df7f0933150f646fbff8aefa0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11740, "upload_time": "2019-09-23T11:31:52", "url": "https://files.pythonhosted.org/packages/46/8d/b83ccaa94253fbc920b21981f038393041d92236bb541751b98a66a2ac1d/keras-radam-0.15.0.tar.gz" } ] }