{ "info": { "author": "Max Woolf", "author_email": "max@minimaxir.com", "bugtrack_url": null, "classifiers": [], "description": "A simple Python package that wraps existing model fine-tuning and generation scripts for OpenAI GPT-2 text generation model (specifically the \"small\", 124M hyperparameter version). Additionally, this package allows easier generation of text, generating to a file for easy curation, allowing for prefixes to force the text to start with a given phrase.\n\n## Usage\n\nAn example for downloading the model to the local system, fineturning it on a dataset. and generating some text.\n\nWarning: the pretrained model, and thus any finetuned model, is 500 MB!\n\n```python\nimport gpt_2_simple as gpt2\n\ngpt2.download_gpt2() # model is saved into current directory under /models/124M/\n\nsess = gpt2.start_tf_sess()\ngpt2.finetune(sess, 'shakespeare.txt', steps=1000) # steps is max number of training steps\n\ngpt2.generate(sess)\n```\n\nThe generated model checkpoints are by default in `/checkpoint/run1`. If you want to load a model from that folder and generate text from it:\n\n```python\nimport gpt_2_simple as gpt2\n\nsess = gpt2.start_tf_sess()\ngpt2.load_gpt2(sess)\n\ngpt2.generate(sess)\n```\n\nAs with textgenrnn, you can generate and save text for later use (e.g. an API or a bot) by using the `return_as_list` parameter.\n\n```python\nsingle_text = gpt2.generate(sess, return_as_list=True)[0]\nprint(single_text)\n```\n\nYou can pass a `run_name` parameter to `finetune` and `load_gpt2` if you want to store/load multiple models in a `checkpoint` folder.\n\nNB: *Restart the Python session first* if you want to finetune on another dataset or load another model.", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/minimaxir/gpt-2-simple", "keywords": "deep learning,tensorflow,text generation", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "gpt-2-simple", "package_url": "https://pypi.org/project/gpt-2-simple/", "platform": "", "project_url": "https://pypi.org/project/gpt-2-simple/", "project_urls": { "Homepage": "https://github.com/minimaxir/gpt-2-simple" }, "release_url": "https://pypi.org/project/gpt-2-simple/0.6/", "requires_dist": null, "requires_python": ">=3.5", "summary": "Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts.", "version": "0.6" }, "last_serial": 5743937, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "4d5a6a5b2c4601c7e6ed01fbf5304c7a", "sha256": "d61643ea031b286dfb84443a25cfe472948385fb617145ee2ef9a13cd2b0e41e" }, "downloads": -1, "filename": "gpt_2_simple-0.1.tar.gz", "has_sig": false, "md5_digest": "4d5a6a5b2c4601c7e6ed01fbf5304c7a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 15869, "upload_time": "2019-04-19T00:19:08", "url": "https://files.pythonhosted.org/packages/cc/46/74c43ed6a8167f0095989d818631e271de82b4f32a4a8066cd9ca7cd6a06/gpt_2_simple-0.1.tar.gz" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "ed81faf82fcd332cfd70226b4fa6aaed", "sha256": "2ad442d3a45a62dff17089ca90cbc5c13e31882834e6533d83adf32205afed19" }, "downloads": -1, "filename": "gpt_2_simple-0.2.tar.gz", "has_sig": false, "md5_digest": "ed81faf82fcd332cfd70226b4fa6aaed", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16331, "upload_time": "2019-04-20T17:38:50", "url": "https://files.pythonhosted.org/packages/b6/cf/4003c7d85425af353e15d938bc0d87a0bdedd6b00229e1f7808c2524b518/gpt_2_simple-0.2.tar.gz" } ], "0.3": [ { "comment_text": "", "digests": { "md5": "5193ec278cfa1acde7e91209010386ae", "sha256": "a47ee87df663d2fce64bbac97fc545606d2d57b7b6b0223768a6b1606b19af88" }, "downloads": -1, "filename": "gpt_2_simple-0.3.tar.gz", "has_sig": false, "md5_digest": "5193ec278cfa1acde7e91209010386ae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18246, "upload_time": "2019-04-21T17:10:54", "url": "https://files.pythonhosted.org/packages/97/38/58c79ba0bb928f0772bf0596bf3257b98d917d6c90a878088759c9b19fa9/gpt_2_simple-0.3.tar.gz" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "9d517a24e889a52139089c3dc7bb61c4", "sha256": "880e655c2c47ff2e46dce1a1e2b89ffe37cad9ed139c602a62528b26ef1edf54" }, "downloads": -1, "filename": "gpt_2_simple-0.3.1.tar.gz", "has_sig": false, "md5_digest": "9d517a24e889a52139089c3dc7bb61c4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18277, "upload_time": "2019-04-23T03:31:14", "url": "https://files.pythonhosted.org/packages/ac/24/f95d06a9ae05f4bd1a240a327525835b07c16cb2391db2ebd009e74ea54f/gpt_2_simple-0.3.1.tar.gz" } ], "0.4": [ { "comment_text": "", "digests": { "md5": "09a3b21c6d632fe1ba3b73838d0ad720", "sha256": "b8cd3f7ae86c26c8a05e48f4deab9ca41f4bd898aa3d322d9e46a84e3d00229b" }, "downloads": -1, "filename": "gpt_2_simple-0.4.tar.gz", "has_sig": false, "md5_digest": "09a3b21c6d632fe1ba3b73838d0ad720", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23713, "upload_time": "2019-05-05T05:36:31", "url": "https://files.pythonhosted.org/packages/d7/a3/0602b40fd860d5696a61026bf8de7c9ed24eb95236d298f9f52ad98fda9d/gpt_2_simple-0.4.tar.gz" } ], "0.4.1": [ { "comment_text": "", "digests": { "md5": "cf8811c3dadc93e713f67b6cd2d363fe", "sha256": "86c105ea262016da462d6f74824575f46138c21bdac7a39a3b6896e8d0d1075b" }, "downloads": -1, "filename": "gpt_2_simple-0.4.1.tar.gz", "has_sig": false, "md5_digest": "cf8811c3dadc93e713f67b6cd2d363fe", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23965, "upload_time": "2019-05-05T16:31:13", "url": "https://files.pythonhosted.org/packages/61/e3/d0aa315e4c342bc86ba6af09d2f30e32c7a6da907df08c593a62190f134a/gpt_2_simple-0.4.1.tar.gz" } ], "0.4.2": [ { "comment_text": "", "digests": { "md5": "5d8e2ae331e5ed0ac1cc522e166483e3", "sha256": "39fc9a5e34d40e65bb6ee3d5f80beed36cf398f59c09b72e312e8e9e7e86e629" }, "downloads": -1, "filename": "gpt_2_simple-0.4.2.tar.gz", "has_sig": false, "md5_digest": "5d8e2ae331e5ed0ac1cc522e166483e3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 24031, "upload_time": "2019-05-05T22:48:35", "url": "https://files.pythonhosted.org/packages/10/fa/9ff4ce16abea04d2069d9065da862990b4036d85a5d061ea21ca5e441120/gpt_2_simple-0.4.2.tar.gz" } ], "0.5": [ { "comment_text": "", "digests": { "md5": "17f15bc4ecd217b02590fef42920d7c2", "sha256": "eee204147c4d974eab9a2997c5be5bd28a838b3249944b551ee7e1827ad46cfd" }, "downloads": -1, "filename": "gpt_2_simple-0.5.tar.gz", "has_sig": false, "md5_digest": "17f15bc4ecd217b02590fef42920d7c2", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 25028, "upload_time": "2019-05-20T03:38:40", "url": "https://files.pythonhosted.org/packages/bc/7d/1ea4c2a54ecdda5e57e45686e5cdf1ccc45809841ab50c89bc63638c5553/gpt_2_simple-0.5.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "0f251ee581cff8853c64c8af3f6a8ff2", "sha256": "be77809b531d67a29b4b3fe8204ee77c472181bd9ab6e7a394a3e860f4e5a6f2" }, "downloads": -1, "filename": "gpt_2_simple-0.5.1.tar.gz", "has_sig": false, "md5_digest": "0f251ee581cff8853c64c8af3f6a8ff2", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 25515, "upload_time": "2019-06-16T03:17:11", "url": "https://files.pythonhosted.org/packages/dc/29/e6c962d660207ee0fa1dab92816a9581eb65aec44b9e4387fc89ff43046e/gpt_2_simple-0.5.1.tar.gz" } ], "0.5.2": [ { "comment_text": "", "digests": { "md5": "5a429552e1efb9d664d30fa1f7d16985", "sha256": "9253c6468de6b0699a5e179e73c83c6e623e762a16d6e09a7702a2dad7ddb428" }, "downloads": -1, "filename": "gpt_2_simple-0.5.2.tar.gz", "has_sig": false, "md5_digest": "5a429552e1efb9d664d30fa1f7d16985", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 25547, "upload_time": "2019-06-18T03:59:12", "url": "https://files.pythonhosted.org/packages/38/3b/19e1dff9f0a15983cae8b380bdf0935403d013e2e4d59883cee55b7f384c/gpt_2_simple-0.5.2.tar.gz" } ], "0.5.3": [ { "comment_text": "", "digests": { "md5": "87682c5fa472c102829a40d04be23baa", "sha256": "d35b1a58b3c97b62264f8aed770851e88547d1b08b498985e39138e6701eb48e" }, "downloads": -1, "filename": "gpt_2_simple-0.5.3-py3.7.egg", "has_sig": false, "md5_digest": "87682c5fa472c102829a40d04be23baa", "packagetype": "bdist_egg", "python_version": "3.7", "requires_python": ">=3.5", "size": 51367, "upload_time": "2019-06-19T05:32:34", "url": "https://files.pythonhosted.org/packages/4d/20/6e2b9f79d5d9777882b3de22da55e603302db5708e18074352c3bb9b0c78/gpt_2_simple-0.5.3-py3.7.egg" }, { "comment_text": "", "digests": { "md5": "0075513eb17c60b6a36ef3bfdb1c59b8", "sha256": "b8b4e4dc71c2876a6c03638848de0e419ec2314eeeee2e54a7eac2167ae54d56" }, "downloads": -1, "filename": "gpt_2_simple-0.5.3.tar.gz", "has_sig": false, "md5_digest": "0075513eb17c60b6a36ef3bfdb1c59b8", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 25537, "upload_time": "2019-06-19T05:34:06", "url": "https://files.pythonhosted.org/packages/05/84/785cae5fffe8752d1175216d5b653e36c289f0cf0b58017144ff9e7a11c3/gpt_2_simple-0.5.3.tar.gz" } ], "0.5.4": [ { "comment_text": "", "digests": { "md5": "2205318a8c2b2b6944bf4a3b6c5bf0d7", "sha256": "dc4ea086872ee88e9eef25aae16d33885a44ffa99d96392710c6ca054e58df48" }, "downloads": -1, "filename": "gpt_2_simple-0.5.4.tar.gz", "has_sig": false, "md5_digest": "2205318a8c2b2b6944bf4a3b6c5bf0d7", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 25187, "upload_time": "2019-07-29T00:03:58", "url": "https://files.pythonhosted.org/packages/ce/a9/e1545c0a96cfc5653ebb9e621cd00aca50ad0733a47e3f47ee211569fbd0/gpt_2_simple-0.5.4.tar.gz" } ], "0.6": [ { "comment_text": "", "digests": { "md5": "ec8f90ad96158e3f609e22370056e4ef", "sha256": "bfb08e6887306250231a015ea948ca5844608c315a120d1e399cc49879eace7e" }, "downloads": -1, "filename": "gpt_2_simple-0.6.tar.gz", "has_sig": false, "md5_digest": "ec8f90ad96158e3f609e22370056e4ef", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 26296, "upload_time": "2019-08-28T17:03:48", "url": "https://files.pythonhosted.org/packages/75/2f/4b2d933decca7f79e3ae2eb3859e2b30bb1f572634d2c84f925d765e3b8e/gpt_2_simple-0.6.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ec8f90ad96158e3f609e22370056e4ef", "sha256": "bfb08e6887306250231a015ea948ca5844608c315a120d1e399cc49879eace7e" }, "downloads": -1, "filename": "gpt_2_simple-0.6.tar.gz", "has_sig": false, "md5_digest": "ec8f90ad96158e3f609e22370056e4ef", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 26296, "upload_time": "2019-08-28T17:03:48", "url": "https://files.pythonhosted.org/packages/75/2f/4b2d933decca7f79e3ae2eb3859e2b30bb1f572634d2c84f925d765e3b8e/gpt_2_simple-0.6.tar.gz" } ] }