{ "info": { "author": "Sun Yan", "author_email": "sunyanhust@163.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy" ], "description": "\n# BERT+ TF Keras For NLP Tasks\n**\u8bf4\u660e**\uff1a\u672c\u9879\u76ee\u5904\u4e8e\u5f00\u53d1\u9636\u6bb5\uff0c\u6682\u65f6\u4e0d\u53ef\u7528\n\n**\u7b80\u4ecb**\uff1a\u4ee5Tensorflow\u7684Keras\u548cTensorflow hub\u7684Bert\u9884\u8bad\u7ec3\u6a21\u578b\u5f00\u53d1NLP\u7684\u5404\u79cd\u4efb\u52a1\u3002\n\n**\u9879\u76ee\u7279\u70b9**\n- \u4e0b\u8f7d\u7a33\u5b9a\uff0c\u8f83\u4e3a\u5178\u578b\u7684\u6d4b\u8bd5\u6570\u636e\uff0c\u9644\u5e26\u8be6\u7ec6\u4ecb\u7ecd\n- \u6570\u636e\u63a5\u53e3\u5c01\u88c5\uff0c\u51cf\u5c11\u6570\u636e\u7684\u5904\u7406\u5de5\u4f5c\n- \u6a21\u578b\u91c7\u7528tf.keras\u5b8c\u6210\uff0c\u65b9\u4fbf\u5feb\u6377\u4e0d\u5931\u7075\u6d3b\n- \u65b9\u4fbf\u7684\u4fdd\u5b58\u6a21\u578b\u548c\u90e8\u7f72\n\n## \u73af\u5883\n- Tensorflow:1.13.1\n- Tensorflow-hub\n\n## TODO List \n### \u53e5\u5b50\u5411\u91cf\u5316\n- [x] ~~\u4f46\u662f\u5b58\u5728\u4e00\u4e2a\u91cd\u590d\u52a0\u8f7d\u8ba1\u7b97\u56fe\u5bfc\u81f4\u901f\u5ea6\u53d8\u6162\u7684\u95ee\u9898\uff0c\u4f53\u9a8c\u4e0d\u4f73\uff0c\u540e\u7eed\u5c06\u6539\u8fdb\u3002~~ \n\u5df2\u89e3\u51b3,\u89e3\u51b3\u65b9\u6cd5\u662f\u76f4\u63a5\u4f7f\u7528BERT\u7684\u5206\u8bcd\u5668,\u4e0d\u4ecehub\u91cd\u65b0\u52a0\u8f7d,\u6492\u82b1!\n- [ ] \u6027\u80fd\u6d4b\u8bd5\n- [x] Batch\u8f93\u5165\n### \u6587\u672c\u5206\u7c7b\n- [x] \u4e8c\u5206\u7c7b\u4efb\u52a1\n\n\u5df2\u5b8c\u6210\u3002\u6570\u636e\u91cf\u4e0d\u5927\u7684\u60c5\u51b5\u4e0b\u53ef\u4ee5\u4e0d\u4f7f\u7528\u5fae\u8c03\uff0c\u5426\u5219\u53c2\u6570\u91cf\u589e\u5927\u53ef\u80fd\u4f1a\u8fc7\u62df\u5408\u3002\n- [ ] \u591a\u5206\u7c7b\u4efb\u52a1\nBERT\u7684\u591a\u5206\u7c7b\u4efb\u52a1\u548c\u4e8c\u5206\u7c7b\u7c7b\u4f3c\uff0c\u53ea\u9700\u8981\u4fee\u6539\u6807\u7b7e\uff0c\u7136\u540esigmod\u6362softmax,\u635f\u5931\u51fd\u6570\u4e5f\u6362\u6210\u591a\u5206\u7c7b\u4ea4\u53c9\u71b5\u5373\u53ef\u3002\u76ee\u524d\u6ca1\u6709\u7a33\u5b9a\u7684\u5916\u94fe\u6570\u636e\uff0c\u6240\u4ee5\u6ca1\u5199example\u3002\n- [ ] \u591a\u6807\u7b7e\u4efb\u52a1\n\n### \u5e8f\u5217\u6807\u6ce8\n- [ ] NER\n\n\u5f00\u53d1\u4e2d\n### \u9605\u8bfb\u7406\u89e3\n- [ ] \u65af\u5766\u798fSQUAD\u7c7b\u4f3c\u7684\u4e2d\u6587\u68c0\u7d22\u5f0f\u9605\u8bfb\u7406\u89e3\n\n\u672a\u5b8c\u6210\n### \u6a21\u578b\u4fdd\u5b58\u548c\u90e8\u7f72\n- [x] h5\u8f6csaved_model\u3002\n- [ ] \u6700\u597d\u7684\u65b9\u5f0f\u662f\u53ef\u4ee5\u4f7f\u7528`tf.keras.experimental.export_saved_model`\u5bfc\u51fa\u6a21\u578b\uff0c\u7136\u540e\u76f4\u63a5\u4f7f\u7528TF serving\u90e8\u7f72\u3002\n\n### TF Data\u8f93\u5165\n- [x] \u591a\u8f93\u5165\u7684TF Data\u5199\u6cd5\n- [x] GPU\u5229\u7528\u7387\u7684\u6bd4\u8f83\n\n### \u5176\u4ed6\u8ba1\u5212\n - [ ] Tensorflow hub\u52a0\u8f7d\u672c\u5730\u8def\u5f84\n - [ ] Windows\u6d4b\u8bd5\n\n## \u5176\u4ed6\u8bf4\u660e\n- \u4e3a\u4ec0\u4e48\u7528tf.keras\u800c\u4e0d\u662fkeras\ntf.keras\u6210\u4e3aTF2.0\u7684\u4e3b\u8981\u6a21\u5f0f\uff0c\u7531TF\u56e2\u961f\u5f00\u53d1\uff0c\u652f\u6301\u66f4\u591aTF\u7684\u7279\u6027\u5305\u62ectf.data\u4ee5\u53catf serving\uff0cTF2.0\u51fa\u4e86\u4e4b\u540e\u9879\u76ee\u4f1a\u8fc1\u79fb\u5230TF2.0\uff0c\u800ckeras\u5df2\u7ecf\u8f83\u957f\u65f6\u95f4\u6ca1\u6709\u91cd\u5927\u66f4\u65b0\u4e86\uff0c\u6240\u4ee5tf.keras\u662f\u66f4\u597d\u7684\u9009\u62e9\u3002\n- \u7531\u4e8e\u7f51\u7edc\u539f\u56e0\uff0c\u65e0\u6cd5\u4e0b\u8f7dTensorflow hub\u7684BERT\u6a21\u578b\n\u8fd9\u91cc\u6709\u4e00\u4efd\u767e\u5ea6\u4e91\u7684\uff0c[\u94fe\u63a5](https://pan.baidu.com/s/1Gm9Hcs4ysJGITKUoPZJxNg)\uff0c \u63d0\u53d6\u7801:4pcq\uff0c\u5927\u5c0f\u4e3a364.1M\uff0clinux\u4e0b\u8f7d\u89e3\u538b\u540e\u62f7\u8d1d\u5230`/tmp/`\uff0c\u5b8c\u6210\u540e\u7684\u8def\u5f84\u4e3a`/tmp/tfhub_modules`\n\n## \u53c2\u8003\u9879\u76ee\n- [keras-bert](https://github.com/strongio/keras-bert)\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/SunYanCN/bert-text", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "bert-text", "package_url": "https://pypi.org/project/bert-text/", "platform": "", "project_url": "https://pypi.org/project/bert-text/", "project_urls": { "Homepage": "https://github.com/SunYanCN/bert-text" }, "release_url": "https://pypi.org/project/bert-text/0.1.0/", "requires_dist": [ "tensorflow-gpu", "numpy", "pandas" ], "requires_python": ">=3.6.0", "summary": "tf.keras bert", "version": "0.1.0" }, "last_serial": 5829314, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "0954f0e7137b554cea55213124f3d103", "sha256": "4bab374cf3fd03cc58ec7f7f8330dbbce7f823c71f400656b6c5c0df683bc5fc" }, "downloads": -1, "filename": "bert_text-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "0954f0e7137b554cea55213124f3d103", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6.0", "size": 2638, "upload_time": "2019-09-14T13:54:55", "url": "https://files.pythonhosted.org/packages/0e/90/271a67bfa4940c5a7d763a5e2091076d476da6dcd2af89c38847b5933f5b/bert_text-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "6fd34e47076067625d4e055f1233a0f6", "sha256": "a294fc2f10974459006e5827bff9a122d0767ce66d36aa72789125d73342bd85" }, "downloads": -1, "filename": "bert-text-0.1.0.tar.gz", "has_sig": false, "md5_digest": "6fd34e47076067625d4e055f1233a0f6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6.0", "size": 4121, "upload_time": "2019-09-14T13:54:58", "url": "https://files.pythonhosted.org/packages/cb/17/0be97f9d254414f516c7b97a15542aa6c8be89964c69d9ba560147f80034/bert-text-0.1.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "0954f0e7137b554cea55213124f3d103", "sha256": "4bab374cf3fd03cc58ec7f7f8330dbbce7f823c71f400656b6c5c0df683bc5fc" }, "downloads": -1, "filename": "bert_text-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "0954f0e7137b554cea55213124f3d103", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6.0", "size": 2638, "upload_time": "2019-09-14T13:54:55", "url": "https://files.pythonhosted.org/packages/0e/90/271a67bfa4940c5a7d763a5e2091076d476da6dcd2af89c38847b5933f5b/bert_text-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "6fd34e47076067625d4e055f1233a0f6", "sha256": "a294fc2f10974459006e5827bff9a122d0767ce66d36aa72789125d73342bd85" }, "downloads": -1, "filename": "bert-text-0.1.0.tar.gz", "has_sig": false, "md5_digest": "6fd34e47076067625d4e055f1233a0f6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6.0", "size": 4121, "upload_time": "2019-09-14T13:54:58", "url": "https://files.pythonhosted.org/packages/cb/17/0be97f9d254414f516c7b97a15542aa6c8be89964c69d9ba560147f80034/bert-text-0.1.0.tar.gz" } ] }