{
    "info": {
        "author": "Hironsan",
        "author_email": "hiroki.nakayama.py@gmail.com",
        "bugtrack_url": null,
        "classifiers": [
            "License :: OSI Approved :: MIT License",
            "Programming Language :: Python",
            "Programming Language :: Python :: 2.6",
            "Programming Language :: Python :: 2.7",
            "Programming Language :: Python :: 3",
            "Programming Language :: Python :: 3.3",
            "Programming Language :: Python :: 3.4",
            "Programming Language :: Python :: 3.5",
            "Programming Language :: Python :: 3.6",
            "Programming Language :: Python :: Implementation :: CPython",
            "Programming Language :: Python :: Implementation :: PyPy"
        ],
        "description": "# seqeval\nseqeval is a Python framework for sequence labeling evaluation.\nseqeval can evaluate the performance of chunking tasks such as named-entity recognition, part-of-speech tagging, semantic role labeling and so on.\n\nThis is well-tested by using the Perl script [conlleval](https://www.clips.uantwerpen.be/conll2002/ner/bin/conlleval.txt),\nwhich can be used for measuring the performance of a system that has processed the CoNLL-2000 shared task data.\n\n## Support features\nseqeval supports following formats:\n* IOB1\n* IOB2\n* IOE1\n* IOE2\n* IOBES\n\nand supports following metrics:\n\n| metrics  | description  |\n|---|---|\n| accuracy_score(y\\_true, y\\_pred)  | Compute the accuracy.  |\n| precision_score(y\\_true, y\\_pred)  | Compute the precision.  |\n| recall_score(y\\_true, y\\_pred)  | Compute the recall.  |\n| f1_score(y\\_true, y\\_pred)  | Compute the F1 score, also known as balanced F-score or F-measure.  |\n| classification_report(y\\_true, y\\_pred, digits=2)  | Build a text report showing the main classification metrics. `digits` is number of digits for formatting output floating point values. Default value is `2`. |\n\n## Usage\nBehold, the power of seqeval:\n\n```python\n>>> from seqeval.metrics import accuracy_score\n>>> from seqeval.metrics import classification_report\n>>> from seqeval.metrics import f1_score\n>>> \n>>> y_true = [['O', 'O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]\n>>> y_pred = [['O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]\n>>>\n>>> f1_score(y_true, y_pred)\n0.50\n>>> accuracy_score(y_true, y_pred)\n0.80\n>>> classification_report(y_true, y_pred)\n             precision    recall  f1-score   support\n\n       MISC       0.00      0.00      0.00         1\n        PER       1.00      1.00      1.00         1\n\n  micro avg       0.50      0.50      0.50         2\n  macro avg       0.50      0.50      0.50         2\n```\n\n### Keras Callback\n\nSeqeval provides a callback for Keras:\n\n```python\nfrom seqeval.callbacks import F1Metrics\n\nid2label = {0: '<PAD>', 1: 'B-LOC', 2: 'I-LOC'}\ncallbacks = [F1Metrics(id2label)]\nmodel.fit(x, y, validation_data=(x_val, y_val), callbacks=callbacks)\n```\n\n## Installation\nTo install seqeval, simply run:\n\n```\n$ pip install seqeval[cpu]\n```\n\nIf you want to install seqeval on GPU environment, please run:\n\n```bash\n$ pip install seqeval[gpu]\n```\n\n## Requirement\n\n* numpy >= 1.14.0\n* tensorflow(optional)",
        "description_content_type": "text/markdown",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/chakki-works/seqeval",
        "keywords": "",
        "license": "MIT",
        "maintainer": "",
        "maintainer_email": "",
        "name": "seqeval",
        "package_url": "https://pypi.org/project/seqeval/",
        "platform": "",
        "project_url": "https://pypi.org/project/seqeval/",
        "project_urls": {
            "Homepage": "https://github.com/chakki-works/seqeval"
        },
        "release_url": "https://pypi.org/project/seqeval/0.0.12/",
        "requires_dist": null,
        "requires_python": "",
        "summary": "Testing framework for sequence labeling",
        "version": "0.0.12"
    },
    "last_serial": 5361036,
    "releases": {
        "0.0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "c7eafa3133f522fa0e3df58d20ae2470",
                    "sha256": "3accd8315f5c90e53a5b4cfe423d77879285333fa690b95bfae07b3f6807f3f7"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.1-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "c7eafa3133f522fa0e3df58d20ae2470",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 5314,
                "upload_time": "2018-02-15T04:55:33",
                "url": "https://files.pythonhosted.org/packages/b5/be/6843b334d323e71e4e6d9285e4d6b19f95288e7c7d31f58f67c108c4403c/seqeval-0.0.1-py3-none-any.whl"
            }
        ],
        "0.0.10": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "8acd08d7c15d67b8e332bcb735263bbf",
                    "sha256": "501a59f21a3deb3cda05f1fee9113dd3532db393fe33c748881d55a608b76390"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.10-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "8acd08d7c15d67b8e332bcb735263bbf",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 7488,
                "upload_time": "2019-04-29T14:42:47",
                "url": "https://files.pythonhosted.org/packages/55/dd/3bf1c646c310daabae47fceb84ea9ab66df7f518a31a89955290d82b8100/seqeval-0.0.10-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "bce3bbd60e931a5cfca04ce702af6b85",
                    "sha256": "69a72e26371fed1ccba8d423537e69f24157d6094eb7376c74c0ebcf8dfdff43"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.10.tar.gz",
                "has_sig": false,
                "md5_digest": "bce3bbd60e931a5cfca04ce702af6b85",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 6384,
                "upload_time": "2019-06-03T05:56:36",
                "url": "https://files.pythonhosted.org/packages/d5/38/1aa0d5e59ff627891759df458b08f3a157c6afd2fe3238057bd365e79c46/seqeval-0.0.10.tar.gz"
            }
        ],
        "0.0.11": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a7a22c24fb018aee94690317591c5d52",
                    "sha256": "11146a39f3e6811dc94da15b611d443a74281688da45b32deea2d84be4c71377"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.11.tar.gz",
                "has_sig": false,
                "md5_digest": "a7a22c24fb018aee94690317591c5d52",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 21129,
                "upload_time": "2019-06-03T10:20:17",
                "url": "https://files.pythonhosted.org/packages/d6/85/dd7bd498196e02fce41b696ceae294204e11586eedf718459c45dbf0e120/seqeval-0.0.11.tar.gz"
            }
        ],
        "0.0.12": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "cd0d718febb87441849b8ee5bcd8b421",
                    "sha256": "9c7764b88b6d1430ab59de63efddf19495fca82159920fd11e362a405f8fc378"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.12.tar.gz",
                "has_sig": false,
                "md5_digest": "cd0d718febb87441849b8ee5bcd8b421",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 21553,
                "upload_time": "2019-06-05T05:21:04",
                "url": "https://files.pythonhosted.org/packages/34/91/068aca8d60ce56dd9ba4506850e876aba5e66a6f2f29aa223224b50df0de/seqeval-0.0.12.tar.gz"
            }
        ],
        "0.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "c8c2017d45fe1c9ca870b8db29f35d15",
                    "sha256": "0ee060ac6f434cd01a85d00d0fab6e5eca98ea59d75c0f8740434ce86b92e727"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.2-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "c8c2017d45fe1c9ca870b8db29f35d15",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 5584,
                "upload_time": "2018-02-15T06:39:44",
                "url": "https://files.pythonhosted.org/packages/ff/d8/c07642cc78c2cf4d313dae024fac521df8fbd62f00ddc69cad5a42c27c33/seqeval-0.0.2-py3-none-any.whl"
            }
        ],
        "0.0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e18b9e7b0d198b158e86fda630196742",
                    "sha256": "6dc7f9ddf5246b909adb0c349575daedbe7828c2bc02df4c81fd4bd80ad8adaa"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.3-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "e18b9e7b0d198b158e86fda630196742",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 5638,
                "upload_time": "2018-02-15T07:44:50",
                "url": "https://files.pythonhosted.org/packages/21/85/fbc6cbbe09b5950531ed1c2543b3528078541625b96a1ffcc8c3239af2af/seqeval-0.0.3-py3-none-any.whl"
            }
        ],
        "0.0.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "acecc4da2cd48e945da647f84c098fbc",
                    "sha256": "4cf6bbd613d7d32c3ad6c50d0659cf29f16e77249c924ead38b1740927138fd2"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.4-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "acecc4da2cd48e945da647f84c098fbc",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 6564,
                "upload_time": "2018-07-24T00:30:58",
                "url": "https://files.pythonhosted.org/packages/4d/4c/b121a6714f2e8cd7418f2558717318721f3c8abff603288c4ecd987fc1bd/seqeval-0.0.4-py3-none-any.whl"
            }
        ],
        "0.0.5": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "02c30bc7e9aee98e6e9eea70c82561fe",
                    "sha256": "788bc2cd5786b13fad2f9334a255a039bef997cc7b53e2f491b697bc32ab9e6b"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.5-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "02c30bc7e9aee98e6e9eea70c82561fe",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 6572,
                "upload_time": "2018-08-07T05:15:40",
                "url": "https://files.pythonhosted.org/packages/dc/b6/6e58b54c0fa343f9c24969cb887f3e76c13d16dded640cc620a914f27dc4/seqeval-0.0.5-py3-none-any.whl"
            }
        ],
        "0.0.6": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "93a4ef471bb3b24202cb8fe373851ddb",
                    "sha256": "007c3a14aa6a5335c1e22daf3e207a4ba24ff238a33c0f83be03ccb5c6d225b4"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.6-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "93a4ef471bb3b24202cb8fe373851ddb",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 5961,
                "upload_time": "2019-03-08T10:36:50",
                "url": "https://files.pythonhosted.org/packages/51/79/d2cd36181d1a8843b312766a94b5c83ce451194b1e4cd99fb5dd50fa6760/seqeval-0.0.6-py3-none-any.whl"
            }
        ],
        "0.0.7": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "06d49deb3de21ca16d4ee8a07fd9ad30",
                    "sha256": "5a8264e6678f74dcead1aeeabeb1c5a9d31b48b8ce43e2408fad090ceadb6244"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.7-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "06d49deb3de21ca16d4ee8a07fd9ad30",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 7339,
                "upload_time": "2019-04-23T14:04:26",
                "url": "https://files.pythonhosted.org/packages/e4/b0/605b34d76782dab9d6e010b396c67b7d583b38e8d53d2edb8b18a2978e65/seqeval-0.0.7-py3-none-any.whl"
            }
        ],
        "0.0.8": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f03b028ab5f92b5f229ce3c6277888d7",
                    "sha256": "78780c7e9337b9531282144800dab1b24b790edd8422bb14fa6f14d4aef04912"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.8-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "f03b028ab5f92b5f229ce3c6277888d7",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 7353,
                "upload_time": "2019-04-23T14:13:33",
                "url": "https://files.pythonhosted.org/packages/94/a0/1fbc1491e77caa6ddb4dea3214db82d174abefa005004fecbb2e9e1b85c1/seqeval-0.0.8-py3-none-any.whl"
            }
        ],
        "0.0.9": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "b6b08138d671cc4c37b03d15f2e13b72",
                    "sha256": "91f4f8c9fa247798ed5a2328d73b668c548541ac34c6021f7be4c567e92a22f3"
                },
                "downloads": -1,
                "filename": "seqeval-0.0.9-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "b6b08138d671cc4c37b03d15f2e13b72",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 8563,
                "upload_time": "2019-04-24T04:13:33",
                "url": "https://files.pythonhosted.org/packages/c2/aa/48adacc396310b081a61c9b5ec2c9fb048c58e128c231fb77cadd8bc5e97/seqeval-0.0.9-py3-none-any.whl"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "cd0d718febb87441849b8ee5bcd8b421",
                "sha256": "9c7764b88b6d1430ab59de63efddf19495fca82159920fd11e362a405f8fc378"
            },
            "downloads": -1,
            "filename": "seqeval-0.0.12.tar.gz",
            "has_sig": false,
            "md5_digest": "cd0d718febb87441849b8ee5bcd8b421",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 21553,
            "upload_time": "2019-06-05T05:21:04",
            "url": "https://files.pythonhosted.org/packages/34/91/068aca8d60ce56dd9ba4506850e876aba5e66a6f2f29aa223224b50df0de/seqeval-0.0.12.tar.gz"
        }
    ]
}