{ "info": { "author": "Ryuya Ikeda", "author_email": "rikeda71@gmail.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Topic :: Text Processing" ], "description": "# miNER\n\nA python library for NER (Named Entity Recognition) evaluation\n\nWe can evaluate the performance of NER by distinguishing between known entities and unknown entities using this library.\n\n\n## Support\n\n- Tagging Scheme\n - IOB2\n - BIOES\n - BIOUL\n- metrics\n - precision\n - recall\n - f1\n\n\n## Requirements\n\n- python3\n- cython\n\n\n## Installation\n\n```shell\npip install mi-ner\n```\n\n\n## Usage\n\n#### Sample\n\n```python\n>>> from miner import Miner\n>>> answers = [\n 'B-PSN O O B-LOC O O O O'.split(' '),\n 'B-PSN I-PSN O O B-LOC I-LOC O O O O'.split(' '),\n 'S-PSN O O S-PSN O O B-LOC I-LOC E-LOC O O O O'.split(' ')\n]\n>>> predicts = [\n 'B-PSN O O B-LOC O O O O'.split(' '),\n 'B-PSN B-PSN O O B-LOC I-LOC O O O O'.split(' '),\n 'S-PSN O O O O O B-LOC I-LOC E-LOC O O O O'.split(' ')\n]\n>>> sentences = [\n '\u82b1\u5b50 \u3055\u3093 \u306f \u6771\u4eac \u306b \u884c\u304d \u307e\u3057 \u305f'.split(' '),\n '\u5c71\u7530 \u592a\u90ce \u541b \u306f \u6771\u4eac \u99c5 \u306b \u5411\u304b\u3044 \u307e\u3057 \u305f'.split(' '),\n '\u82b1\u5b50 \u3055\u3093 \u3068 \u30dc\u30d6 \u304f\u3093 \u306f \u6771\u4eac \u30b9\u30ab\u30a4 \u30c4\u30ea\u30fc \u306b \u884c\u304d \u307e\u3057 \u305f'.split(' '),\n]\n>>> knowns = {'PSN': ['\u82b1\u5b50'], 'LOC': ['\u6771\u4eac']} # known words (words included in training data)\n>>> m = Miner(answers, predicts, sentences, knowns)\n>>> m.default_report(True)\n\tprecision recall f1_score num\nPSN\t 0.500 0.500 0.500 4\nLOC\t 1.000 1.000 1.000 3\n{'PSN': {'precision': 0.5, 'recall': 0.5, 'f1_score': 0.5, 'num': 4}, 'LOC': {'precision': 1.0, 'recall': 1.0, 'f1_score': 1.0, 'num': 3}}\n>>> m.return_predict_named_entities()\n{'known': {'PSN': ['\u82b1\u5b50'], 'LOC': ['\u6771\u4eac']}, 'unknown': {'PSN': ['\u592a\u90ce', '\u5c71\u7530'], 'LOC': ['\u6771\u4eac\u99c5', '\u6771\u4eac\u30b9\u30ab\u30a4\u30c4\u30ea\u30fc']}}\n```\n\n#### Methods\n\n| method | description |\n| ---- | ---- |\n| default\\_report(print\\_) | return result of named entity recognition. if print\\_=True, showing result |\n| known\\_only\\_report(print\\_) | return result of known named entity recognition. |\n| unknown\\_only\\_report(print\\_) | return result of unknown named entity recognition. |\n| return\\_predict\\_named\\_entities() | return named entities along predicted label(predicts). |\n| return\\_answer\\_named\\_entities() | return named entities along answer label(answer). |\n| return\\_miss\\_labelings() | return miss labeling sentences. |\n| segmentation\\_score(mode) | show parcentages of matching answer and predict labels. if `known` or` unknown` for `mode`, return labeling accuracy for known or unknown NE. |\n\n\n## License\n\nMIT\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Andolab/miNER", "keywords": "named entity recognition,nlp,natural language processing", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "mi-ner", "package_url": "https://pypi.org/project/mi-ner/", "platform": "", "project_url": "https://pypi.org/project/mi-ner/", "project_urls": { "Homepage": "https://github.com/Andolab/miNER" }, "release_url": "https://pypi.org/project/mi-ner/0.5.1/", "requires_dist": [ "cython" ], "requires_python": "", "summary": "A python library for named entity recognition evaluation", "version": "0.5.1" }, "last_serial": 5720125, "releases": { "0.0.2": [ { "comment_text": "", "digests": { "md5": "13473de3cc9fc95f539c09aae04924e9", "sha256": "03f86b44b482fe6b8d517b7631424c72e6c4cc860669ddadef2d4d3217499bc8" }, "downloads": -1, "filename": "mi_ner-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "13473de3cc9fc95f539c09aae04924e9", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 5032, "upload_time": "2019-03-29T15:03:16", "url": "https://files.pythonhosted.org/packages/fb/f6/603c5b5fb827129d809460cb9cc5f8fda868fb9201cceb749314b286a1e1/mi_ner-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "219b0e5aa54ff475325df8bf53406375", "sha256": "2b56c0b28019edc3088eb2aac880e39073b127a074f039a5fb16183ac0054c95" }, "downloads": -1, "filename": "mi-ner-0.0.2.tar.gz", "has_sig": false, "md5_digest": "219b0e5aa54ff475325df8bf53406375", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4875, "upload_time": "2019-03-29T15:03:18", "url": "https://files.pythonhosted.org/packages/04/af/eab026bc32c659354d889d42db834bbd7b04ecf0144eacf28657588ebe7a/mi-ner-0.0.2.tar.gz" } ], "0.1.0": [ { "comment_text": "", "digests": { "md5": "1b73d5556ec54545549da32cfcc38d22", "sha256": "47c49177e5aef0091aa8ce7d6e38983e94c8e19d895079d0a0e0e4dd4aad523b" }, "downloads": -1, "filename": "mi_ner-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "1b73d5556ec54545549da32cfcc38d22", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 5198, "upload_time": "2019-04-04T06:23:52", "url": "https://files.pythonhosted.org/packages/30/18/7565b1617bb0df3228a1d0c6ce948ab54e1566665a77e5ee41f6209e9861/mi_ner-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "9443331047dc7f3b1f9309e99e5b68c6", "sha256": "21e6cb5f5b40fbacb87acc955323671fb4e51ff7aa55820622da40d24a01c0e6" }, "downloads": -1, "filename": "mi-ner-0.1.0.tar.gz", "has_sig": false, "md5_digest": "9443331047dc7f3b1f9309e99e5b68c6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5030, "upload_time": "2019-04-04T06:23:54", "url": "https://files.pythonhosted.org/packages/01/31/7cd9ee35a3d249185a0824ace5523df090840241cf510ffecb3473d0919a/mi-ner-0.1.0.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "52859d1fc3484e32d05bdc2ab4a0fffb", "sha256": "515062cb05ca3ed477219d00ecb5df2504c4a418d35d4fb92ea57a1399273d08" }, "downloads": -1, "filename": "mi_ner-0.2.0-py3-none-any.whl", "has_sig": false, "md5_digest": "52859d1fc3484e32d05bdc2ab4a0fffb", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 5540, "upload_time": "2019-04-10T09:09:06", "url": "https://files.pythonhosted.org/packages/41/4b/d3da15dea0fc020dc8b3f012d426510599d8ab4da752aecfa9ce95d8c014/mi_ner-0.2.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "14682ef087a0951a12db99cb126be516", "sha256": "ae0a530f483af0cb4f61d10311380cc54a31fc19a3e87bd51b75551e4ae28996" }, "downloads": -1, "filename": "mi-ner-0.2.0.tar.gz", "has_sig": false, "md5_digest": "14682ef087a0951a12db99cb126be516", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5346, "upload_time": "2019-04-10T09:09:07", "url": "https://files.pythonhosted.org/packages/7f/73/d6f87e77b8cf8447c55c778b8929b0396c401f4a1415bffdbf87b5384638/mi-ner-0.2.0.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "4032617f100619b6b4b7a6aad6d299f8", "sha256": "005b4559070a5d5ccb2f9e398227125b0a54f1173ad092184d91cf6ecd0154b8" }, "downloads": -1, "filename": "mi_ner-0.2.1-py3-none-any.whl", "has_sig": false, "md5_digest": "4032617f100619b6b4b7a6aad6d299f8", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 5546, "upload_time": "2019-04-20T04:40:55", "url": "https://files.pythonhosted.org/packages/95/b6/0b2a60c02c7f3a92284090c7d4bbcbf9daa4ae003db21b56e943052f724a/mi_ner-0.2.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "2ed84cdf243e693daad92aee47292c9b", "sha256": "163e3c1d7bb05efd2fa19604d9d79b24e4e2ca73f643b9e64db1fa99c019710e" }, "downloads": -1, "filename": "mi-ner-0.2.1.tar.gz", "has_sig": false, "md5_digest": "2ed84cdf243e693daad92aee47292c9b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5349, "upload_time": "2019-04-20T04:40:56", "url": "https://files.pythonhosted.org/packages/02/ab/db9d89bf03f1ba80ab8b486e55fe48bfa4c271e4eb44275ff471b7e191bf/mi-ner-0.2.1.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "d43d330aa81f02c4259badb20cdd7ec4", "sha256": "73db2a8e0cd10e47de2bdd062a37b21fbf61e49dc5a0e959320b071dcf0d2069" }, "downloads": -1, "filename": "mi_ner-0.3.0-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "d43d330aa81f02c4259badb20cdd7ec4", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28116, "upload_time": "2019-08-07T11:43:39", "url": "https://files.pythonhosted.org/packages/d8/c4/e358d10f3b418a784d23201a12821e5dd9472b850cd8625286739d83a5a6/mi_ner-0.3.0-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "289e4a7cce85d0b564d98ed27628670f", "sha256": "445c2f2eaed1710a6bc211ce6eafb4d9100f0b892b9c1cd34c1a062bfc6640f6" }, "downloads": -1, "filename": "mi-ner-0.3.0.tar.gz", "has_sig": false, "md5_digest": "289e4a7cce85d0b564d98ed27628670f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5801, "upload_time": "2019-08-07T11:43:41", "url": "https://files.pythonhosted.org/packages/f4/36/57dae48f4eb0cbd8567eae3634644305b3d3032e7ff8ff0f091d2c437402/mi-ner-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "750b07e5b8596e9200898769b6278d71", "sha256": "9235d4b5d1b38c65ed09f78989f689cf1085032961b59c4cf0755fd2a3c874a5" }, "downloads": -1, "filename": "mi_ner-0.4.0-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "750b07e5b8596e9200898769b6278d71", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28166, "upload_time": "2019-08-20T03:59:26", "url": "https://files.pythonhosted.org/packages/13/50/e765f76e66aba56a17c51570e9c56d20b657938ac62438fc796425e84b6b/mi_ner-0.4.0-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "764d9375ed247c31e4330226990836bc", "sha256": "3ac71a0b4cb69d058776f72a7d86ea8f050b0bb909c94178426192065e41a6fa" }, "downloads": -1, "filename": "mi-ner-0.4.0.tar.gz", "has_sig": false, "md5_digest": "764d9375ed247c31e4330226990836bc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5859, "upload_time": "2019-08-20T03:59:28", "url": "https://files.pythonhosted.org/packages/bb/d9/4a8c61c45e7c37eaee98c0410de89958b2df1449649520000f8d85ffc290/mi-ner-0.4.0.tar.gz" } ], "0.4.1": [ { "comment_text": "", "digests": { "md5": "d8e455b76c7453515115e3203125f6d4", "sha256": "324f5c33e2f623d5cb3a0407541a00486af2f0762699d9284c2fa9e92b47bf3c" }, "downloads": -1, "filename": "mi_ner-0.4.1-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "d8e455b76c7453515115e3203125f6d4", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28227, "upload_time": "2019-08-23T10:33:24", "url": "https://files.pythonhosted.org/packages/89/9d/21b5582f9a606cbc8ffa91197fc4bdf4643cedc411b5f08c0245650a1c02/mi_ner-0.4.1-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "3158f0e6a866c8729788aab82ef701d6", "sha256": "109cbff5842d6182eee397e14396b9f29c7aa91767525ce8971f2872a36d169b" }, "downloads": -1, "filename": "mi-ner-0.4.1.tar.gz", "has_sig": false, "md5_digest": "3158f0e6a866c8729788aab82ef701d6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5919, "upload_time": "2019-08-23T10:33:25", "url": "https://files.pythonhosted.org/packages/b8/42/11933a59e7c96cb4ff86f30d6f4258e000782857fea2959ff523bd80ad25/mi-ner-0.4.1.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "dd5f740126051d48d99217cd2caa38b2", "sha256": "ab5326253bb49a7490cf3acb22a4e3bd13cd9016464a6b3d7161ad30751684fd" }, "downloads": -1, "filename": "mi_ner-0.5.0-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "dd5f740126051d48d99217cd2caa38b2", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28225, "upload_time": "2019-08-23T10:35:36", "url": "https://files.pythonhosted.org/packages/1d/1c/52d492483850f0e208e4c25e6e20cc7cb3e08edeb37d31bd2375a102e7d1/mi_ner-0.5.0-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "4873934eb1de872696a82141d43f17bd", "sha256": "0bf6d22958fdd603a11e3bc64c771cf98a0722428739d49f0e5d114622aa4a3e" }, "downloads": -1, "filename": "mi-ner-0.5.0.tar.gz", "has_sig": false, "md5_digest": "4873934eb1de872696a82141d43f17bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5910, "upload_time": "2019-08-23T10:35:38", "url": "https://files.pythonhosted.org/packages/df/be/60c206aa43fa542a6dc97e3fa7d3ed62ecb654a315ab97295c544929edf9/mi-ner-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "f383f24aa4a746e4b0dd6debf5d246f1", "sha256": "73839b7cf1973bafe95d0239db21d346185a4f6a478b8ff38119c557ea495ace" }, "downloads": -1, "filename": "mi_ner-0.5.1-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "f383f24aa4a746e4b0dd6debf5d246f1", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28223, "upload_time": "2019-08-23T10:54:14", "url": "https://files.pythonhosted.org/packages/66/6a/ec6eeed535c4025f506b08fa713274263e68df319598cb2c797e252fe2a1/mi_ner-0.5.1-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "818f688c785d1c1393105a26c58d66dc", "sha256": "4cc781a44d9c6000ad63d6e02e473bd685e15ba112bd1e0477a2c15769d6b41b" }, "downloads": -1, "filename": "mi-ner-0.5.1.tar.gz", "has_sig": false, "md5_digest": "818f688c785d1c1393105a26c58d66dc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5914, "upload_time": "2019-08-23T10:54:15", "url": "https://files.pythonhosted.org/packages/00/4c/e58a152acba23c9fc46a2c403ed880bfc011d5060de14395612fc0b7f031/mi-ner-0.5.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f383f24aa4a746e4b0dd6debf5d246f1", "sha256": "73839b7cf1973bafe95d0239db21d346185a4f6a478b8ff38119c557ea495ace" }, "downloads": -1, "filename": "mi_ner-0.5.1-cp37-cp37m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "f383f24aa4a746e4b0dd6debf5d246f1", "packagetype": "bdist_wheel", "python_version": "cp37", "requires_python": null, "size": 28223, "upload_time": "2019-08-23T10:54:14", "url": "https://files.pythonhosted.org/packages/66/6a/ec6eeed535c4025f506b08fa713274263e68df319598cb2c797e252fe2a1/mi_ner-0.5.1-cp37-cp37m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "818f688c785d1c1393105a26c58d66dc", "sha256": "4cc781a44d9c6000ad63d6e02e473bd685e15ba112bd1e0477a2c15769d6b41b" }, "downloads": -1, "filename": "mi-ner-0.5.1.tar.gz", "has_sig": false, "md5_digest": "818f688c785d1c1393105a26c58d66dc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5914, "upload_time": "2019-08-23T10:54:15", "url": "https://files.pythonhosted.org/packages/00/4c/e58a152acba23c9fc46a2c403ed880bfc011d5060de14395612fc0b7f031/mi-ner-0.5.1.tar.gz" } ] }