{ "info": { "author": "CyberZHG", "author_email": "CyberZHG@users.noreply.github.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3.6" ], "description": "# Keras RAdam\n\n[![Travis](https://travis-ci.org/CyberZHG/keras-radam.svg)](https://travis-ci.org/CyberZHG/keras-radam)\n[![Coverage](https://coveralls.io/repos/github/CyberZHG/keras-radam/badge.svg?branch=master)](https://coveralls.io/github/CyberZHG/keras-radam)\n[![Version](https://img.shields.io/pypi/v/keras-rectified-adam.svg)](https://pypi.org/project/keras-rectified-adam/)\n![Downloads](https://img.shields.io/pypi/dm/keras-rectified-adam.svg)\n![License](https://img.shields.io/pypi/l/keras-rectified-adam.svg)\n\n![](https://img.shields.io/badge/keras-tensorflow-blue.svg)\n![](https://img.shields.io/badge/keras-theano-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras/eager-blue.svg)\n![](https://img.shields.io/badge/keras-tf.keras/2.0_beta-blue.svg)\n\n\\[[\u4e2d\u6587](https://github.com/CyberZHG/keras-radam/blob/master/README.zh-CN.md)|[English](https://github.com/CyberZHG/keras-radam/blob/master/README.md)\\]\n\nUnofficial implementation of [RAdam](https://arxiv.org/pdf/1908.03265v1.pdf) in Keras and TensorFlow. \n\n## Install\n\n```bash\npip install keras-rectified-adam\n```\n\n## External Link\n\n- [tensorflow/addons:RectifiedAdam](https://github.com/tensorflow/addons/blob/master/tensorflow_addons/optimizers/rectified_adam.py)\n\n## Usage\n\n```python\nimport keras\nimport numpy as np\nfrom keras_radam import RAdam\n\n# Build toy model with RAdam optimizer\nmodel = keras.models.Sequential()\nmodel.add(keras.layers.Dense(input_shape=(17,), units=3))\nmodel.compile(RAdam(), loss='mse')\n\n# Generate toy data\nx = np.random.standard_normal((4096 * 30, 17))\nw = np.random.standard_normal((17, 3))\ny = np.dot(x, w)\n\n# Fit\nmodel.fit(x, y, epochs=5)\n```\n\n### TensorFlow without Keras\n\n```python\nfrom keras_radam.training import RAdamOptimizer\n\nRAdamOptimizer(learning_rate=1e-3)\n```\n\n### Use Warmup\n\n```python\nfrom keras_radam import RAdam\n\nRAdam(total_steps=10000, warmup_proportion=0.1, min_lr=1e-5)\n```\n\n## Q & A\n\n### About Correctness\n\nThe optimizer produces similar losses and weights to the official optimizer after 500 steps.\n\n### Use `tf.keras` or `tf-2.0`\n\nAdd `TF_KERAS=1` to environment variables to use `tensorflow.python.keras`.\n\n### Use `theano` Backend\n\nAdd `KERAS_BACKEND=theano` to environment variables to enable `theano` backend.", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/CyberZHG/keras-radam", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "keras-rectified-adam", "package_url": "https://pypi.org/project/keras-rectified-adam/", "platform": "", "project_url": "https://pypi.org/project/keras-rectified-adam/", "project_urls": { "Homepage": "https://github.com/CyberZHG/keras-radam" }, "release_url": "https://pypi.org/project/keras-rectified-adam/0.17.0/", "requires_dist": null, "requires_python": "", "summary": "RAdam implemented in Keras & TensorFlow", "version": "0.17.0" }, "last_serial": 5883966, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "763d681db248aa83214d5621ccf89899", "sha256": "db3234196b381656729b052155c8018709bcf12eb331d9ea5abd56154bf7969c" }, "downloads": -1, "filename": "keras-rectified-adam-0.1.0.tar.gz", "has_sig": false, "md5_digest": "763d681db248aa83214d5621ccf89899", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6561, "upload_time": "2019-08-16T16:39:40", "url": "https://files.pythonhosted.org/packages/6e/ea/bfbc5ba621f58426579741964fc86833a7f73206326f84058fa933b5653f/keras-rectified-adam-0.1.0.tar.gz" } ], "0.10.0": [ { "comment_text": "", "digests": { "md5": "15ce84dc64f228aaa2457291aeabaa9f", "sha256": "48a4cecce1b9c8024ca9dfcb1c7e893ef21d503da2c075ccdf7dd1f272ce360e" }, "downloads": -1, "filename": "keras-rectified-adam-0.10.0.tar.gz", "has_sig": false, "md5_digest": "15ce84dc64f228aaa2457291aeabaa9f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11329, "upload_time": "2019-08-27T15:15:27", "url": "https://files.pythonhosted.org/packages/9d/e4/d0ff34bde0d2c89af9a814ec30235bb6f6f116b7c38a3a433b1a36d3c397/keras-rectified-adam-0.10.0.tar.gz" } ], "0.11.0": [ { "comment_text": "", "digests": { "md5": "56588f04dbeaf3ddba619c7ae3a76b42", "sha256": "33036db1594f8ca671416c950b90238b5b7a0fdb8cb180765d69d6e167e642fc" }, "downloads": -1, "filename": "keras-rectified-adam-0.11.0.tar.gz", "has_sig": false, "md5_digest": "56588f04dbeaf3ddba619c7ae3a76b42", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11362, "upload_time": "2019-08-29T15:21:02", "url": "https://files.pythonhosted.org/packages/1e/2b/1aa0e92da7fb5131f03fd3e401204485e6a5e96e2f415687e61a4561f349/keras-rectified-adam-0.11.0.tar.gz" } ], "0.11.0a0": [ { "comment_text": "", "digests": { "md5": "43b5ca1a9b9428398f94623989397eef", "sha256": "7ac2b9ead53e9cd18e414b39b02f3a3243135edfa562601d2a94b40c6299fbb8" }, "downloads": -1, "filename": "keras-rectified-adam-0.11.0a0.tar.gz", "has_sig": false, "md5_digest": "43b5ca1a9b9428398f94623989397eef", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11328, "upload_time": "2019-08-30T10:11:51", "url": "https://files.pythonhosted.org/packages/ae/4a/ceb2adc605ca753440df21d17cd1c7726d90aca180cff81da11722e05118/keras-rectified-adam-0.11.0a0.tar.gz" } ], "0.12.0": [ { "comment_text": "", "digests": { "md5": "ec798531f265fdd935fd18ba7c36c2a4", "sha256": "ea0ecfb517ef6723c668d0b47412d9edd28e9bf4dbf2031f7e9083823ab82a91" }, "downloads": -1, "filename": "keras-rectified-adam-0.12.0.tar.gz", "has_sig": false, "md5_digest": "ec798531f265fdd935fd18ba7c36c2a4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11344, "upload_time": "2019-08-30T10:55:21", "url": "https://files.pythonhosted.org/packages/91/a5/c14b197e7c207086d47bd4fa56426a9d5bd3c03f1a7e9b9839241a5d2f2a/keras-rectified-adam-0.12.0.tar.gz" } ], "0.14.0": [ { "comment_text": "", "digests": { "md5": "98ef73aa0c0c1e264b08b98274793d4f", "sha256": "827f027d75de130c812b6ea0020080340a115611d9ddeb85ef09cd22a86a30bd" }, "downloads": -1, "filename": "keras-rectified-adam-0.14.0.tar.gz", "has_sig": false, "md5_digest": "98ef73aa0c0c1e264b08b98274793d4f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11564, "upload_time": "2019-09-19T02:33:54", "url": "https://files.pythonhosted.org/packages/36/ee/7300b3b51037d63cb8e1890501a27584f932abaa2d5a625836ec26e3f86d/keras-rectified-adam-0.14.0.tar.gz" } ], "0.15.0": [ { "comment_text": "", "digests": { "md5": "9b6a9ef2f21753f6b2adde7b75dadcfc", "sha256": "aed014651a1550d307dbbaad04e5a2389d60bd217695ec9044ee56752d26982c" }, "downloads": -1, "filename": "keras-rectified-adam-0.15.0.tar.gz", "has_sig": false, "md5_digest": "9b6a9ef2f21753f6b2adde7b75dadcfc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11753, "upload_time": "2019-09-23T11:31:15", "url": "https://files.pythonhosted.org/packages/5f/ce/cbb871c95594c4d780afc63c13ea256ca1cbc0b03863ad6b209fa56dab77/keras-rectified-adam-0.15.0.tar.gz" } ], "0.16.0": [ { "comment_text": "", "digests": { "md5": "f3af731334c2448dd84e889530d789a1", "sha256": "1cac715e823d29fa8389b5cf891c7b627fb4c043e61cd03675a679b483ad91ed" }, "downloads": -1, "filename": "keras-rectified-adam-0.16.0.tar.gz", "has_sig": false, "md5_digest": "f3af731334c2448dd84e889530d789a1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11784, "upload_time": "2019-09-23T14:00:07", "url": "https://files.pythonhosted.org/packages/af/5b/bba5cac18923244cab67babf3f1895b84351ee4d2995de11e7376cd7ed4b/keras-rectified-adam-0.16.0.tar.gz" } ], "0.17.0": [ { "comment_text": "", "digests": { "md5": "cb6e0253e596c46b9a64a5f8ffa22905", "sha256": "8adab980575bfdf50ec2683dabf2293092bd28fbb8b7c0365561101a91a3bca7" }, "downloads": -1, "filename": "keras-rectified-adam-0.17.0.tar.gz", "has_sig": false, "md5_digest": "cb6e0253e596c46b9a64a5f8ffa22905", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11776, "upload_time": "2019-09-25T08:52:01", "url": "https://files.pythonhosted.org/packages/21/79/9521f66b92186702cb58a214c1b923b416266381cd824e15a1733f6a5b06/keras-rectified-adam-0.17.0.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "b9ccacea96a812a4aaa6cee9b4d843f9", "sha256": "21160667ce66e41719d57bd8b1b436151b517369a7ecf6147bf4ef3e70fb242f" }, "downloads": -1, "filename": "keras-rectified-adam-0.2.0.tar.gz", "has_sig": false, "md5_digest": "b9ccacea96a812a4aaa6cee9b4d843f9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6450, "upload_time": "2019-08-17T02:55:33", "url": "https://files.pythonhosted.org/packages/09/49/68853275497bd8e52316b4a27f75b1706cfe052b24897b9086d886732818/keras-rectified-adam-0.2.0.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "4a4f2b08b7bcf3d3b522120037be5fc4", "sha256": "37e8ad66c6c5a7e33f781c0c2f3c6df85c8c89a5ea54c2af813b481422b37fc5" }, "downloads": -1, "filename": "keras-rectified-adam-0.3.0.tar.gz", "has_sig": false, "md5_digest": "4a4f2b08b7bcf3d3b522120037be5fc4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6456, "upload_time": "2019-08-18T14:56:42", "url": "https://files.pythonhosted.org/packages/dc/05/2bc41116bc49f5e0cc07f2c8eadc5b9aeb5c0b7e5982b9b76d8ac151130a/keras-rectified-adam-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "e4be260a695e011ab6b3413af5c11c60", "sha256": "bd4cd285a10ff2fd26da64fcb156df9b2bdb30a6febc2e59a61ab4e2f9a6ff44" }, "downloads": -1, "filename": "keras-rectified-adam-0.4.0.tar.gz", "has_sig": false, "md5_digest": "e4be260a695e011ab6b3413af5c11c60", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8131, "upload_time": "2019-08-19T04:18:58", "url": "https://files.pythonhosted.org/packages/96/ff/6ae23a7c0bd27df5bdb6dd6f989fe325d2a0b776b0af05ae0b326b4c8f87/keras-rectified-adam-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "8fb0816d0fb5648ad38c1bff5ce0ea48", "sha256": "640a248eeb5062d9f50c0b40a8f0dd15802891139dc6cdbb8f3faddd77464b22" }, "downloads": -1, "filename": "keras-rectified-adam-0.5.0.tar.gz", "has_sig": false, "md5_digest": "8fb0816d0fb5648ad38c1bff5ce0ea48", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8149, "upload_time": "2019-08-20T16:01:39", "url": "https://files.pythonhosted.org/packages/93/87/e558ed7169a815579bd2ef7bccf1934c005b8f573eda8a6338ee43aafe98/keras-rectified-adam-0.5.0.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "73407a58b881e6e94eed02f1048b8873", "sha256": "f3354e1b163a4ad9b293405964162c9093be1244a7bf057ab9c2fb41a695a053" }, "downloads": -1, "filename": "keras-rectified-adam-0.6.0.tar.gz", "has_sig": false, "md5_digest": "73407a58b881e6e94eed02f1048b8873", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8579, "upload_time": "2019-08-20T17:03:12", "url": "https://files.pythonhosted.org/packages/c6/07/f33698ef12e014310a4feb638bdd3a184613ff22e5e9d1e7dce0abe23205/keras-rectified-adam-0.6.0.tar.gz" } ], "0.7.0": [ { "comment_text": "", "digests": { "md5": "88cb951e7025bc5e2eb018a2e58e88cb", "sha256": "d391b67a0eb58d53c14ee96ce0540ad4bc1d76016826488145a95639fca65b56" }, "downloads": -1, "filename": "keras-rectified-adam-0.7.0.tar.gz", "has_sig": false, "md5_digest": "88cb951e7025bc5e2eb018a2e58e88cb", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8596, "upload_time": "2019-08-21T11:59:44", "url": "https://files.pythonhosted.org/packages/b8/a3/893380c9215d57e46c8307e25ff1d441ab547dd678b39730239ff5d98cd1/keras-rectified-adam-0.7.0.tar.gz" } ], "0.8.0": [ { "comment_text": "", "digests": { "md5": "a3aebc378bf02cc062d294de9eb6bc82", "sha256": "86b0dca33f19faa4cc0502e8ea08d90ad4f63409f569c7f67b146646c6625b9d" }, "downloads": -1, "filename": "keras-rectified-adam-0.8.0.tar.gz", "has_sig": false, "md5_digest": "a3aebc378bf02cc062d294de9eb6bc82", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11042, "upload_time": "2019-08-21T15:02:28", "url": "https://files.pythonhosted.org/packages/65/49/fb3023a375769c3e6db8bd093113fd34ef8f13d2add8e58fbb133a8ee20b/keras-rectified-adam-0.8.0.tar.gz" } ], "0.9.0": [ { "comment_text": "", "digests": { "md5": "f80c10d4ec559428c54e1af104fb66da", "sha256": "6f335faebbf2ff8beea5352c4e33179b052e17c72a7b5aaa30d9d5b836c0a067" }, "downloads": -1, "filename": "keras-rectified-adam-0.9.0.tar.gz", "has_sig": false, "md5_digest": "f80c10d4ec559428c54e1af104fb66da", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11294, "upload_time": "2019-08-21T17:42:32", "url": "https://files.pythonhosted.org/packages/6c/e0/63c01452f1f38bf6ee1df90e5a195b902b6aa126bd3b2b845f4475430d05/keras-rectified-adam-0.9.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "cb6e0253e596c46b9a64a5f8ffa22905", "sha256": "8adab980575bfdf50ec2683dabf2293092bd28fbb8b7c0365561101a91a3bca7" }, "downloads": -1, "filename": "keras-rectified-adam-0.17.0.tar.gz", "has_sig": false, "md5_digest": "cb6e0253e596c46b9a64a5f8ffa22905", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11776, "upload_time": "2019-09-25T08:52:01", "url": "https://files.pythonhosted.org/packages/21/79/9521f66b92186702cb58a214c1b923b416266381cd824e15a1733f6a5b06/keras-rectified-adam-0.17.0.tar.gz" } ] }