{ "info": { "author": "Daniel Rasmussen", "author_email": "daniel.rasmussen@appliedbrainresearch.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Science/Research", "License :: OSI Approved :: BSD License", "Operating System :: Microsoft :: Windows", "Operating System :: Unix", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.5", "Topic :: Scientific/Engineering" ], "description": ".. image:: https://travis-ci.org/drasmuss/hessianfree.svg?branch=master\n :target: https://travis-ci.org/drasmuss/hessianfree\n :alt: Travis-CI build status\n \n.. image:: https://ci.appveyor.com/api/projects/status/mytincgjvboav37o/branch/master?svg=true\n :target: https://ci.appveyor.com/project/drasmuss/hessianfree\n :alt: AppVeyor build status\n \n.. image:: https://img.shields.io/pypi/v/hessianfree.svg\n :target: https://pypi.python.org/pypi/hessianfree\n :alt: Latest PyPI version\n\n.. image:: https://img.shields.io/pypi/dm/hessianfree.svg\n :target: https://pypi.python.org/pypi/hessianfree\n :alt: Number of PyPI downloads\n\n*******************************************\nHessian-free optimization for deep networks\n*******************************************\n\nSetup\n=====\n\nQuick start\n-----------\n\nInstall the package via:\n\n.. code-block:: bash\n\n pip install hessianfree\n \nTo make sure things are working, open a python interpreter and enter:\n\n.. code-block:: python\n \n import hessianfree as hf\n hf.demos.xor()\n \nA simple xor training example will run, at the end of which it will display\nthe target and actual outputs from the network.\n\n\nDeveloper install\n-----------------\n\nUse this if you want to track the latest changes from the repository:\n\n.. code-block:: bash\n\n git clone https://github.com/drasmuss/hessianfree.git\n cd hessianfree\n python setup.py develop --user\n\nRequirements\n------------\n\n* python 2.7 or 3.5\n* numpy 1.9.2\n* matplotlib 1.3.1\n* optional: scipy 0.15.1, pycuda 2015.1.3, scikit-cuda 0.5.1, pytest 2.7.0\n\n(older versions may work, but are untested)\n\nFeatures\n========\n\nAll the standard features of Hessian-free optimization from Martens (2010) and \nMartens and Sutskever (2011) are implemented (Gauss-Newton approximation, early \ntermination, CG backtracking, Tikhonov damping, structural damping, etc.). In \naddition, the code has been designed to make it easy to customize the network \nyou want to train, without having to modify the internal computations of the \noptimization process.\n\n* Works for feedforward and recurrent deep networks (or mixtures of the two)\n* Standard nonlinearities built in (e.g., logistic, tanh, ReLU, softmax), and \n support for custom nonlinearities\n* Standard loss functions (squared error, cross entropy, sparsity constraints), \n and support for custom loss functions\n* Various weight initialization methods (although Hessian-free optimization \n doesn't usually require much tweaking)\n* Customizable connectivity between layers (e.g., skip connections)\n* Efficient implementation, taking advantage of things like activity caching\n* Optional GPU acceleration if PyCUDA and scikit-cuda are installed\n* Gradient checking (and Gauss-Newton matrix checking) implemented to help with \n debugging\n* Inputs can be predefined or generated dynamically by some other system (like \n an environmental simulation)\n* Different optimizers can be swapped out for comparison (e.g., Hessian-free \n versus SGD)\n\nDocumentation\n=============\n\nView the documentation at http://pythonhosted.org/hessianfree/\n\nIn addition, examples illustrating the main features of the code can be found\nin ``demos.py``.", "description_content_type": null, "docs_url": "https://pythonhosted.org/hessianfree/", "download_url": "https://github.com/drasmuss/hessianfree/tarball/0.4.0", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/drasmuss/hessianfree", "keywords": "neural network,hessian free,deep learning", "license": "BSD", "maintainer": null, "maintainer_email": null, "name": "hessianfree", "package_url": "https://pypi.org/project/hessianfree/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/hessianfree/", "project_urls": { "Download": "https://github.com/drasmuss/hessianfree/tarball/0.4.0", "Homepage": "https://github.com/drasmuss/hessianfree" }, "release_url": "https://pypi.org/project/hessianfree/0.4.0/", "requires_dist": null, "requires_python": null, "summary": "Hessian-free optimization for deep networks", "version": "0.4.0" }, "last_serial": 2135626, "releases": { "0.1.1": [ { "comment_text": "", "digests": { "md5": "14f96a40a9548cfdc1885a38410496f7", "sha256": "de798561ec4c9650854f769fdf8085aa2a8e45d038c552f4dfa6e23d4ecfbbb1" }, "downloads": -1, "filename": "hessianfree-0.1.1.zip", "has_sig": false, "md5_digest": "14f96a40a9548cfdc1885a38410496f7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 22804, "upload_time": "2015-09-24T22:10:01", "url": "https://files.pythonhosted.org/packages/72/f6/5c1ee0997d917b554d4d3ddb3c2d4ec2b9c80cc6132fab8bdff0a3ab355b/hessianfree-0.1.1.zip" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "a5a6494806c186b7f9f40a407bb9cd58", "sha256": "a3b7388cebadddc0b03b054db48b3d56c587d16c21c61cff200697b62468b85d" }, "downloads": -1, "filename": "hessianfree-0.1.2.zip", "has_sig": false, "md5_digest": "a5a6494806c186b7f9f40a407bb9cd58", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 27341, "upload_time": "2015-09-24T22:43:50", "url": "https://files.pythonhosted.org/packages/34/a5/beed94b2fd0da7f26f9b75895a88b4d65e5bb3d463277acef120f7802913/hessianfree-0.1.2.zip" } ], "0.1.4": [ { "comment_text": "", "digests": { "md5": "f46b916e70be7c0b8c02bd4e41737f2e", "sha256": "acd7ffc3da98a5afe42ae72e30281c7e96bff14436b5d613d05ab55b0c704f99" }, "downloads": -1, "filename": "hessianfree-0.1.4.zip", "has_sig": false, "md5_digest": "f46b916e70be7c0b8c02bd4e41737f2e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 27859, "upload_time": "2015-09-25T00:03:32", "url": "https://files.pythonhosted.org/packages/7a/0e/ca827abec2a585ead7512e0e5ae70044131a5ac26260114739b432a59887/hessianfree-0.1.4.zip" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "62caf22447185a2eedab00206829d2f1", "sha256": "dc9d1fb06b4d830e46d136c1351c1752319bee8c21828c6898c850554ce7160b" }, "downloads": -1, "filename": "hessianfree-0.1.5.zip", "has_sig": false, "md5_digest": "62caf22447185a2eedab00206829d2f1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 27863, "upload_time": "2015-09-25T03:05:04", "url": "https://files.pythonhosted.org/packages/2b/86/c7e6a446c7d7112c8fbde969e4c5a345d7456b59a1cc3bb1b7a4b3539350/hessianfree-0.1.5.zip" } ], "0.1.6": [ { "comment_text": "", "digests": { "md5": "560acb7376a8807685b771fe2ab1fad4", "sha256": "10cf8f9458ff497ea92783f0a6bfc144d243cbc4585714f74e7910643d0a6c8a" }, "downloads": -1, "filename": "hessianfree-0.1.6.zip", "has_sig": false, "md5_digest": "560acb7376a8807685b771fe2ab1fad4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 27887, "upload_time": "2015-09-25T21:29:58", "url": "https://files.pythonhosted.org/packages/7f/9c/5c18cd726e7a6ae77a2c57ad899185ab60809f91f9de655edaba15a46fd0/hessianfree-0.1.6.zip" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "77b21b6af771453884f39bd4712b2a5e", "sha256": "ca00760974bdc5efbf891cd68cbe8254865f49cf820cb4a59b90143420e72a45" }, "downloads": -1, "filename": "hessianfree-0.2.0.zip", "has_sig": false, "md5_digest": "77b21b6af771453884f39bd4712b2a5e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 31944, "upload_time": "2015-10-27T21:22:00", "url": "https://files.pythonhosted.org/packages/87/cf/2d3b29a744be3ba98c70add820c02f02637caca542d25f6d2a38acb7c12b/hessianfree-0.2.0.zip" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "03ff4516950849d352c6c4e9b371fba4", "sha256": "b63abdfee4e04aeb1f22e139097648786ab877f3f9f8cc2b8dae68fa277fb73d" }, "downloads": -1, "filename": "hessianfree-0.2.1.zip", "has_sig": false, "md5_digest": "03ff4516950849d352c6c4e9b371fba4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 35792, "upload_time": "2015-10-27T21:38:19", "url": "https://files.pythonhosted.org/packages/48/5d/ff6d7f78fedd16457d9b38057a9606a73dfc62098aae23e5450c4f3365d9/hessianfree-0.2.1.zip" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "1d7cf3ef60e38574ba29e7c2d312c798", "sha256": "1256c124c7fbaa3f0cf65cd488b5564cf55d0726128428e4be98061b508ec461" }, "downloads": -1, "filename": "hessianfree-0.3.0.zip", "has_sig": false, "md5_digest": "1d7cf3ef60e38574ba29e7c2d312c798", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 49465, "upload_time": "2015-12-09T22:15:53", "url": "https://files.pythonhosted.org/packages/bd/93/a41274646efe4d764e199e265b96dc5bc0e59c4b2aec89e270e7e53881c7/hessianfree-0.3.0.zip" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "8722b4aa27aebd806c898e56c932cd38", "sha256": "67a788b0911c393b9d9eca312c6eb373238e7e30727b9da197d87a3becd0ece1" }, "downloads": -1, "filename": "hessianfree-0.3.1.zip", "has_sig": false, "md5_digest": "8722b4aa27aebd806c898e56c932cd38", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 48282, "upload_time": "2015-12-11T01:21:37", "url": "https://files.pythonhosted.org/packages/ee/fd/995ec106717c441db9cd0f2b34e7516fd64411be505b2d682365a02b351f/hessianfree-0.3.1.zip" } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "920d08e90a23ce8bc33afb7c6c11382a", "sha256": "0d31385f0157c678377feaa87c2a1aa0dac7966f56ada36b1ccb0689385f7cd2" }, "downloads": -1, "filename": "hessianfree-0.3.2.zip", "has_sig": false, "md5_digest": "920d08e90a23ce8bc33afb7c6c11382a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 49903, "upload_time": "2015-12-15T19:15:32", "url": "https://files.pythonhosted.org/packages/50/f5/f33e3ecd2e5a7b826e7cc3fd070d0418fbefc78f1112e1cd85a2b55a43e1/hessianfree-0.3.2.zip" } ], "0.3.3": [ { "comment_text": "", "digests": { "md5": "459535691c98494d517e059aad9ad0f4", "sha256": "b0f298180a8046b4d991d0cabbbde29583fe9c70d6f79402fd3ae6ffae56a43e" }, "downloads": -1, "filename": "hessianfree-0.3.3.zip", "has_sig": false, "md5_digest": "459535691c98494d517e059aad9ad0f4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 50364, "upload_time": "2015-12-15T20:59:07", "url": "https://files.pythonhosted.org/packages/62/00/45e98cec10b7f3c542fa20a5d963cbabac8709b9a6a648fccafe0a33a3f9/hessianfree-0.3.3.zip" } ], "0.3.4": [ { "comment_text": "", "digests": { "md5": "77a2d5aed9fdd899e8dcb0e247362e9e", "sha256": "47bb6cbef0ac31afcaeaa19d01c49eb11baf1d0275b091c80c978c2d8c2c5188" }, "downloads": -1, "filename": "hessianfree-0.3.4.zip", "has_sig": false, "md5_digest": "77a2d5aed9fdd899e8dcb0e247362e9e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 51827, "upload_time": "2015-12-17T21:34:29", "url": "https://files.pythonhosted.org/packages/47/d9/e9cb614f4fd17d842dbd76769723cfec4f08b979ce26f8220a0aa8fabbfb/hessianfree-0.3.4.zip" } ], "0.3.5": [ { "comment_text": "", "digests": { "md5": "26b18eee890a9383c5c9ad767d4a9c46", "sha256": "e802983a9fb60a26befa024f5c64ad1485e9824319e01127252c28105938ed22" }, "downloads": -1, "filename": "hessianfree-0.3.5.zip", "has_sig": false, "md5_digest": "26b18eee890a9383c5c9ad767d4a9c46", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 56273, "upload_time": "2015-12-31T20:43:15", "url": "https://files.pythonhosted.org/packages/2d/2d/f7dc0e7e990e5f6d41217544d1f3fbaebc80985402c0905bda0bdc5e768b/hessianfree-0.3.5.zip" } ], "0.3.6": [ { "comment_text": "", "digests": { "md5": "bb0c09459c3ceff5f5cb714f850d752b", "sha256": "86d5527f95a75cf71185f139ea25e862a5fe27881b90154b440d0015a6aedef0" }, "downloads": -1, "filename": "hessianfree-0.3.6.zip", "has_sig": false, "md5_digest": "bb0c09459c3ceff5f5cb714f850d752b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 56286, "upload_time": "2015-12-31T20:48:00", "url": "https://files.pythonhosted.org/packages/f3/06/af6bad42eb45ae150e25f297bd5b93675ce56cbdfeaebc528bb3df48b865/hessianfree-0.3.6.zip" } ], "0.3.7": [ { "comment_text": "", "digests": { "md5": "6b02d30ce045acab6877e7e2eabfbc76", "sha256": "f8d66979399c6aa363c64bc665f84a2fe3f59f5f19967ed6a88e9cf8ccc1b132" }, "downloads": -1, "filename": "hessianfree-0.3.7.zip", "has_sig": false, "md5_digest": "6b02d30ce045acab6877e7e2eabfbc76", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 56392, "upload_time": "2016-01-02T16:58:02", "url": "https://files.pythonhosted.org/packages/19/87/136aef55724f35adbf1748849b341f49330b3c985fb24d808cdd0bb6e030/hessianfree-0.3.7.zip" } ], "0.3.8": [ { "comment_text": "", "digests": { "md5": "5e46d4127f88c6883511e06e431b299d", "sha256": "bb4de2138c13c043735d8ee248a18ef22370da9ac17902460340be807767ff23" }, "downloads": -1, "filename": "hessianfree-0.3.8.zip", "has_sig": false, "md5_digest": "5e46d4127f88c6883511e06e431b299d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 63851, "upload_time": "2016-02-23T00:31:05", "url": "https://files.pythonhosted.org/packages/35/cb/bc55c3b77519c6b61cea8bde627bc75c7967ba72505de50fcf886d03e936/hessianfree-0.3.8.zip" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "7b30ed1329b1fc9298c757ac13f0cbc4", "sha256": "faacb0906e38fd2e878d0bc2c68167fca6b24319c0283be99c7643a42a6b694b" }, "downloads": -1, "filename": "hessianfree-0.4.0.zip", "has_sig": false, "md5_digest": "7b30ed1329b1fc9298c757ac13f0cbc4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 64334, "upload_time": "2016-05-26T20:18:10", "url": "https://files.pythonhosted.org/packages/f7/b3/e1e31f20d363abe6c3882920392d83ad85cec1bbac64d3223ef2ef8f9bc8/hessianfree-0.4.0.zip" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "7b30ed1329b1fc9298c757ac13f0cbc4", "sha256": "faacb0906e38fd2e878d0bc2c68167fca6b24319c0283be99c7643a42a6b694b" }, "downloads": -1, "filename": "hessianfree-0.4.0.zip", "has_sig": false, "md5_digest": "7b30ed1329b1fc9298c757ac13f0cbc4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 64334, "upload_time": "2016-05-26T20:18:10", "url": "https://files.pythonhosted.org/packages/f7/b3/e1e31f20d363abe6c3882920392d83ad85cec1bbac64d3223ef2ef8f9bc8/hessianfree-0.4.0.zip" } ] }