{
"info": {
"author": "Joel Nothman, Ben Hachey, Will Radford",
"author_email": "joel.nothman+neleval@gmail.com",
"bugtrack_url": null,
"classifiers": [
"Intended Audience :: Science/Research",
"License :: OSI Approved :: Apache Software License",
"Programming Language :: Python :: 2.7",
"Programming Language :: Python :: 3",
"Programming Language :: Python :: 3.4",
"Programming Language :: Python :: 3.5",
"Programming Language :: Python :: 3.6",
"Topic :: Scientific/Engineering"
],
"description": "Entity linking evaluation\n=========================\n\nPython command-line evaluation scripts for `TAC `__\nentity linking and related wikification, named entity disambiguation, and\nwithin- and cross-document coreference tasks.\n\n|version| |licence| |py-versions|\n\n|issues| |build| |docs| |coverage|\n\nIt aims for **fast** and **flexible** coreference resolution and\n**sophisticated** named entity recognition evaluation, such as partial scores\nfor partial overlap between gold and system mentions. CEAF, in particular, is\nmuch faster to calculate here than in the `CoNLL-11/12 scorer\n`__. It boasts features\nsuch as configurable metrics; accounting for or ignoring cross-document\ncoreference (see the ``evaluate --by-doc`` flag); plotting to compare\nevaluation by system, measure and corpus subset; and bootstrap-based confidence\ninterval calculation for document-wise evaluation metrics.\n\nRequires that ``python`` (2.7, with Py3k support experimental/partial)\nbe installed on your system with ``numpy`` (and preferably ``scipy`` for\nfast CEAF calculation) and ``joblib``. ``matplotlib`` is required for\nthe ``plot-systems`` command.\n\nSee a list of commands with:\n\n.. code:: bash\n\n ./nel --help\n\nOr install onto your Python path (e.g. with\n``pip install git+https://github.com/wikilinks/neleval``) then\n\n.. code:: bash\n\n python -m neleval --help\n\nTAC-KBP 2014 EDL quickstart\n===========================\n\n.. code:: bash\n\n ./scripts/run_tac14_evaluation.sh \\\n /path/to/gold.xml \\ # TAC14 gold standard queries/mentions\n /path/to/gold.tab \\ # TAC14 gold standard link and nil annotations\n /system/output/directory \\ # directory containing (only) TAC14 system output files\n /script/output/directory \\ # directory to which results are written\n number_of_jobs # number of jobs for parallel mode\n\nEach file in in the system output directory is scored against gold.tab.\n\nSimilar facility is available for TAC-KBP'15 EDL.\n\nMore details\n============\n\nSee `the documentation `__ for more\ndetails.\n\n\n.. |py-versions| image:: https://img.shields.io/pypi/pyversions/neleval.svg\n :alt: Python versions supported\n\n.. |version| image:: https://badge.fury.io/py/neleval.svg\n :alt: Latest version on PyPi\n :target: https://badge.fury.io/py/neleval\n\n.. |build| image:: https://travis-ci.org/wikilinks/neleval.svg?branch=master\n :alt: Travis CI build status\n :scale: 100%\n :target: https://travis-ci.org/wikilinks/neleval\n\n.. |issues| image:: https://img.shields.io/github/issues/wikilinks/neleval.svg\n :alt: Issue tracker\n :target: https://github.com/wikilinks/neleval\n\n.. |coverage| image:: https://coveralls.io/repos/github/wikilinks/neleval/badge.svg\n :alt: Test coverage\n :target: https://coveralls.io/github/wikilinks/neleval\n\n.. |docs| image:: https://readthedocs.org/projects/neleval/badge/?version=latest\n :alt: Documentation Status\n :scale: 100%\n :target: https://neleval.readthedocs.io/en/latest/?badge=latest\n\n.. |licence| image:: https://img.shields.io/badge/Licence-BSD-blue.svg\n :target: https://opensource.org/licenses/BSD-3-Clause\n",
"description_content_type": "",
"docs_url": null,
"download_url": "https://github.com/wikilinks/neleval/tree/v3.1.0",
"downloads": {
"last_day": -1,
"last_month": -1,
"last_week": -1
},
"home_page": "https://github.com/wikilinks/neleval",
"keywords": "clustering",
"license": "Apache 2.0",
"maintainer": "",
"maintainer_email": "",
"name": "neleval",
"package_url": "https://pypi.org/project/neleval/",
"platform": "",
"project_url": "https://pypi.org/project/neleval/",
"project_urls": {
"Download": "https://github.com/wikilinks/neleval/tree/v3.1.0",
"Homepage": "https://github.com/wikilinks/neleval"
},
"release_url": "https://pypi.org/project/neleval/3.1.0/",
"requires_dist": null,
"requires_python": "",
"summary": "Command-line evaluation tools for named entity linking and (cross-document) coreference resolution",
"version": "3.1.0"
},
"last_serial": 3913135,
"releases": {
"3.0.0": [
{
"comment_text": "",
"digests": {
"md5": "1c7a7d60035d8cfca117774ed1b9cf22",
"sha256": "77e4d504c011e5d337b39193488eb5c6ad2fa1dd1e6d17e9d8a7e9f6b61d114a"
},
"downloads": -1,
"filename": "neleval-3.0.0.tar.gz",
"has_sig": false,
"md5_digest": "1c7a7d60035d8cfca117774ed1b9cf22",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 58380,
"upload_time": "2016-04-27T05:15:10",
"url": "https://files.pythonhosted.org/packages/5a/87/cd0f4f4bf0c9b48092b4654e9a1fe794771a33b2782ab212e65e4b228c12/neleval-3.0.0.tar.gz"
}
],
"3.0.1": [
{
"comment_text": "",
"digests": {
"md5": "0dac0d611244d97111507ee0afacda60",
"sha256": "4715705ad9518ec79cb1524523fdaee63c83f11ebf968008d0edd97d26c538de"
},
"downloads": -1,
"filename": "neleval-3.0.1.tar.gz",
"has_sig": false,
"md5_digest": "0dac0d611244d97111507ee0afacda60",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 58596,
"upload_time": "2016-04-27T11:44:01",
"url": "https://files.pythonhosted.org/packages/96/8f/dfd5d438eaae2d583397bf9f5dbadcaf60f8c3703e3a92911c8e7bbecc88/neleval-3.0.1.tar.gz"
}
],
"3.0.2": [
{
"comment_text": "",
"digests": {
"md5": "92d3f88c005fdff749f41e77ab298cbb",
"sha256": "922cf4325c92ad167e4b3a7463a60aa8916c6f3e5f65021d943aab509df7c5c7"
},
"downloads": -1,
"filename": "neleval-3.0.2.tar.gz",
"has_sig": false,
"md5_digest": "92d3f88c005fdff749f41e77ab298cbb",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 58631,
"upload_time": "2016-04-27T11:56:05",
"url": "https://files.pythonhosted.org/packages/4b/f8/97c426cf9e4ac920d29126596066567d8c96921f3eb59d5a4b2aadd42631/neleval-3.0.2.tar.gz"
}
],
"3.0.3": [
{
"comment_text": "",
"digests": {
"md5": "7b3b165e903e52ddc531d189471b4eb1",
"sha256": "7287d963e3aa55e008e4606c470c16f85f0637349708e73a23c795b235caf1d6"
},
"downloads": -1,
"filename": "neleval-3.0.3.tar.gz",
"has_sig": false,
"md5_digest": "7b3b165e903e52ddc531d189471b4eb1",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 58680,
"upload_time": "2016-04-27T11:56:51",
"url": "https://files.pythonhosted.org/packages/44/1e/595bb4834b702f10fa82ecef19d0ef2438501a0f6c7f07aa6f8fff7ef304/neleval-3.0.3.tar.gz"
}
],
"3.1.0": [
{
"comment_text": "",
"digests": {
"md5": "f4700d8a6c31abbabbc29387a4e2bc14",
"sha256": "ae9081af88434694d89fa0313107a0c9318a3c1f492f18f79a9be11f5ba7ac30"
},
"downloads": -1,
"filename": "neleval-3.1.0.tar.gz",
"has_sig": false,
"md5_digest": "f4700d8a6c31abbabbc29387a4e2bc14",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 49529,
"upload_time": "2018-05-30T14:31:46",
"url": "https://files.pythonhosted.org/packages/b7/17/1d4dbed482af78b15bf64ade6f9f96a81189d1bd1eb9c0fbc8128e179eed/neleval-3.1.0.tar.gz"
}
]
},
"urls": [
{
"comment_text": "",
"digests": {
"md5": "f4700d8a6c31abbabbc29387a4e2bc14",
"sha256": "ae9081af88434694d89fa0313107a0c9318a3c1f492f18f79a9be11f5ba7ac30"
},
"downloads": -1,
"filename": "neleval-3.1.0.tar.gz",
"has_sig": false,
"md5_digest": "f4700d8a6c31abbabbc29387a4e2bc14",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 49529,
"upload_time": "2018-05-30T14:31:46",
"url": "https://files.pythonhosted.org/packages/b7/17/1d4dbed482af78b15bf64ade6f9f96a81189d1bd1eb9c0fbc8128e179eed/neleval-3.1.0.tar.gz"
}
]
}