{ "info": { "author": "Ben Lambert", "author_email": "blambert@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "License :: OSI Approved :: Apache Software License", "Programming Language :: Python", "Topic :: Scientific/Engineering :: Artificial Intelligence", "Topic :: Text Processing", "Topic :: Utilities" ], "description": "asr_evaluation\n==============\n[![Build Status](https://travis-ci.org/belambert/asr-evaluation.svg?branch=master)](https://travis-ci.org/belambert/asr-evaluation)\n[![PyPI version](https://badge.fury.io/py/asr_evaluation.svg)](https://badge.fury.io/py/asr_evaluation)\n[![codecov](https://codecov.io/gh/belambert/asr-evaluation/branch/master/graph/badge.svg)](https://codecov.io/gh/belambert/asr-evaluation)\n\nPython module for evaluting ASR hypotheses (i.e. word error rate and word \nrecognition rate).\n\nThis module depends on the [editdistance](https://github.com/belambert/edit-distance)\nproject, for computing edit distances between arbitrary sequences.\n\nThe formatting of the output of this program is very loosely based around the \nsame idea as the align.c program commonly used within the Sphinx ASR community. \nThis may run a bit faster if neither instances nor confusions are printed.\n\nPlease let me know if you have any comments, questions, or problems.\n\nOutput\n------\nThe program outputs three standard measurements:\n - [Word error rate (WER)](https://en.wikipedia.org/wiki/Word_error_rate)\n - Word recognition rate (the number of _matched_ words in the alignment divided by the number of words in the reference).\n - Sentence error rate (SER) (the number of incorrect sentences divided by the total number of sentences).\n\n\nInstalling & uninstalling\n-------------------------\nThe easiest way to install is using pip:\n\n pip install asr-evaluation\n\nAlternatively you can clone this git repo and install using distutils:\n\n git clone git@github.com:belambert/asr-evaluation.git\n cd asr-evaluation\n python setup.py install\n\nTo uninstall with pip:\n\n pip uninstall asr-evaluation\n\n\nCommand line usage\n------------------\nFor command line usage, see:\n```\n wer --help\n```\n\nIt should display something like this:\n\n``` \nusage: wer [-h] [-i | -r] [--head-ids] [-id] [-c] [-p] [-m count] [-a] [-e]\n ref hyp\n\nEvaluate an ASR transcript against a reference transcript.\n\npositional arguments:\n ref Reference transcript filename\n hyp ASR hypothesis filename\n\noptional arguments:\n -h, --help show this help message and exit\n -i, --print-instances\n Print all individual sentences and their errors.\n -r, --print-errors Print all individual sentences that contain errors.\n --head-ids Hypothesis and reference files have ids in the first\n token? (Kaldi format)\n -id, --tail-ids, --has-ids\n Hypothesis and reference files have ids in the last\n token? (Sphinx format)\n -c, --confusions Print tables of which words were confused.\n -p, --print-wer-vs-length\n Print table of average WER grouped by reference\n sentence length.\n -m count, --min-word-count count\n Minimum word count to show a word in confusions.\n -a, --case-insensitive\n Down-case the text before running the evaluation.\n -e, --remove-empty-refs\n Skip over any examples where the reference is empty.\n```\n\nContributing and code of conduct\n--------------------------------\nFor contributions, it's best to Github issues and pull requests. Proper\ntesting and documentation suggested.\n\nCode of conduct is expected to be reasonable, especially as specified by\nthe [Contributor Covenant](http://contributor-covenant.org/version/1/4/)\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "", "keywords": "word,error,rate,asr,speech,recognition", "license": "LICENSE.txt", "maintainer": "", "maintainer_email": "", "name": "asr_evaluation", "package_url": "https://pypi.org/project/asr_evaluation/", "platform": "", "project_url": "https://pypi.org/project/asr_evaluation/", "project_urls": null, "release_url": "https://pypi.org/project/asr_evaluation/2.0.4/", "requires_dist": [ "edit-distance", "termcolor" ], "requires_python": "", "summary": "Evaluating ASR (automatic speech recognition) hypotheses, i.e. computing word error rate.", "version": "2.0.4" }, "last_serial": 4438840, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "46ca50e76efd9c64133f561573c9f198", "sha256": "efdfde627054d865647736c94eea34cbf5240c04f445bff046179888c8945c9f" }, "downloads": -1, "filename": "asr_evaluation-0.1.0.tar.gz", "has_sig": false, "md5_digest": "46ca50e76efd9c64133f561573c9f198", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4468, "upload_time": "2016-07-10T04:02:19", "url": "https://files.pythonhosted.org/packages/fa/ac/bf8d742cf29614056ac9e85a84381647079745eedbeda115a915948860ba/asr_evaluation-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "56307407fcd82ab5c430c7d37b8cee77", "sha256": "c413afbd6d693330deb06c2e89a86dc36d3cdbe49c8cd2481570e2074f78678b" }, "downloads": -1, "filename": "asr_evaluation-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "56307407fcd82ab5c430c7d37b8cee77", "packagetype": "bdist_wheel", "python_version": "3.5", "requires_python": null, "size": 6168, "upload_time": "2016-12-30T20:44:49", "url": "https://files.pythonhosted.org/packages/79/58/d6fa009da5f6cbed5e4a58517775b45e8be94ff20e3595deb5bc0e95936a/asr_evaluation-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "d895c82707999f0b2007ec75abed005b", "sha256": "0d66e5bc57b9a41d0f8b8c1571aa79bed616a149916c4ec38882d07f6e2ba622" }, "downloads": -1, "filename": "asr_evaluation-0.1.1.tar.gz", "has_sig": false, "md5_digest": "d895c82707999f0b2007ec75abed005b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4729, "upload_time": "2016-12-30T20:44:47", "url": "https://files.pythonhosted.org/packages/27/c5/e81093346be30e3e986fd46e8d30bfac7fe26068c10d8a56f10b32619f86/asr_evaluation-0.1.1.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "0802ec5411cc4949597585c720381d34", "sha256": "28c9f94d753eca7a559911c3816c9bf463ebf4109d78de558a46ca7e1baee939" }, "downloads": -1, "filename": "asr_evaluation-0.2.0.tar.gz", "has_sig": false, "md5_digest": "0802ec5411cc4949597585c720381d34", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5153, "upload_time": "2016-12-31T06:38:06", "url": "https://files.pythonhosted.org/packages/ba/33/cf2fb5d786b536852118ee9c05ed36f77cf43253a1a2f0a596e13007bb00/asr_evaluation-0.2.0.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "e41c9471fa27d4d7f0fb0c2255371bb3", "sha256": "d002ccd272eafecb9b19b98362909ee3d235ec679d5c39460145ed064c2c17ab" }, "downloads": -1, "filename": "asr_evaluation-0.2.1.tar.gz", "has_sig": false, "md5_digest": "e41c9471fa27d4d7f0fb0c2255371bb3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5169, "upload_time": "2016-12-31T06:45:09", "url": "https://files.pythonhosted.org/packages/f3/58/806712d8cca701eafd69431560e93c8c1785e6953a61a1f8cd284a24d8c8/asr_evaluation-0.2.1.tar.gz" } ], "0.2.2": [ { "comment_text": "", "digests": { "md5": "0e7b321f81762ab754b89a98fb6a6240", "sha256": "116626210696c765b210a5d26539616b6b72f85e85b93f9c1ce475ab10c55bb1" }, "downloads": -1, "filename": "asr_evaluation-0.2.2.tar.gz", "has_sig": false, "md5_digest": "0e7b321f81762ab754b89a98fb6a6240", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5176, "upload_time": "2016-12-31T06:55:10", "url": "https://files.pythonhosted.org/packages/48/18/0d45733f2d683203c26f9ac6d4678617a85d177ddf9ac11d14d123b030b6/asr_evaluation-0.2.2.tar.gz" } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "2a7b2a6f34ddf1eeec7bebb52760b768", "sha256": "d28f7418ec8510b9db954e8bd5a6a496b94321b0998d025de75e80c3205bbb02" }, "downloads": -1, "filename": "asr_evaluation-0.2.3.tar.gz", "has_sig": false, "md5_digest": "2a7b2a6f34ddf1eeec7bebb52760b768", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5187, "upload_time": "2016-12-31T07:04:43", "url": "https://files.pythonhosted.org/packages/d7/d1/3af3cba3792eed53dcc169bc7299209a28a9330e2cc46feff2e84c38068b/asr_evaluation-0.2.3.tar.gz" } ], "0.2.4": [ { "comment_text": "", "digests": { "md5": "e7c0b4adcd59f7c260fda24914bcf88c", "sha256": "093bddcf10cb6f1b6be5179d2ef48fc58ce1867b6ee76467bf72bc610c0cf0f5" }, "downloads": -1, "filename": "asr_evaluation-0.2.4.tar.gz", "has_sig": false, "md5_digest": "e7c0b4adcd59f7c260fda24914bcf88c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5671, "upload_time": "2017-01-08T22:52:44", "url": "https://files.pythonhosted.org/packages/0a/99/20366e2df1dbd4f889ca6ba848108ddd8d599091c7c0f9badddac60a3433/asr_evaluation-0.2.4.tar.gz" } ], "0.2.5": [ { "comment_text": "", "digests": { "md5": "414a7e6e2ecdcbdd10d9da9c57717cda", "sha256": "3b7f50b54cc7ce692f07f7478bc15cb54adf8ca6c22d6f1161294f2043da2af6" }, "downloads": -1, "filename": "asr_evaluation-0.2.5.tar.gz", "has_sig": false, "md5_digest": "414a7e6e2ecdcbdd10d9da9c57717cda", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5680, "upload_time": "2017-01-26T05:40:32", "url": "https://files.pythonhosted.org/packages/44/50/4e0c0fcac5b988ae1cb0ad5bbef092053782404aa773ea06b3e4390e6d4a/asr_evaluation-0.2.5.tar.gz" } ], "1.0.0": [ { "comment_text": "", "digests": { "md5": "57d37d889457c93a7fc52182fee6de02", "sha256": "2e084e622353128bd48e0662489c9a86db0474513a76e4b0f4ac3e8047ac9845" }, "downloads": -1, "filename": "asr_evaluation-1.0.0.tar.gz", "has_sig": false, "md5_digest": "57d37d889457c93a7fc52182fee6de02", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5762, "upload_time": "2017-01-29T20:15:28", "url": "https://files.pythonhosted.org/packages/62/64/04ec21bab2f586c3490cc4163627f9de947303572e7ea158a15a5c4feab0/asr_evaluation-1.0.0.tar.gz" } ], "1.0.1": [ { "comment_text": "", "digests": { "md5": "1b7e35a924e25589c68fb3a55e0064c8", "sha256": "0d0a2cd26b7fc38bb700f68c7d35c8c8aaaab87bac7a9211d5ff87fd920c75c5" }, "downloads": -1, "filename": "asr_evaluation-1.0.1.tar.gz", "has_sig": false, "md5_digest": "1b7e35a924e25589c68fb3a55e0064c8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5356, "upload_time": "2017-02-21T06:16:36", "url": "https://files.pythonhosted.org/packages/67/75/7aa4a98063b6999f52bc7cd06b064c7bf6d124ee78b4f92f1c5173d747d1/asr_evaluation-1.0.1.tar.gz" } ], "1.1.0": [ { "comment_text": "", "digests": { "md5": "1bfc2d0ffeba2422d1922acb488d79af", "sha256": "30d0d750dec02f070d54eb89d6b35795f47e7e147ef76decc3864551af76f491" }, "downloads": -1, "filename": "asr_evaluation-1.1.0.tar.gz", "has_sig": false, "md5_digest": "1bfc2d0ffeba2422d1922acb488d79af", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5724, "upload_time": "2017-03-04T08:21:44", "url": "https://files.pythonhosted.org/packages/6f/28/9d4cde34b0791178416aeb76dd37feb05d1ad64c7301f53b9b837b233bb8/asr_evaluation-1.1.0.tar.gz" } ], "1.2.0": [ { "comment_text": "", "digests": { "md5": "d872ebc29d123589f1160bf10da6fc5f", "sha256": "f3501929bfee92058b989a515fd1fc5d232da1805499561b17171c24dea277d5" }, "downloads": -1, "filename": "asr_evaluation-1.2.0.tar.gz", "has_sig": false, "md5_digest": "d872ebc29d123589f1160bf10da6fc5f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5914, "upload_time": "2017-04-17T21:20:06", "url": "https://files.pythonhosted.org/packages/4d/41/7c124615dd036fcfb523aaed55870ac721cfda5debdfabafe874c963fe44/asr_evaluation-1.2.0.tar.gz" } ], "1.2.1": [ { "comment_text": "", "digests": { "md5": "50946631ca029bae41510fd8114d8d48", "sha256": "99126b1d4e1b59f0bcc8203383786af1795bd6743a4b0721d3379eebb9e7a604" }, "downloads": -1, "filename": "asr_evaluation-1.2.1.tar.gz", "has_sig": false, "md5_digest": "50946631ca029bae41510fd8114d8d48", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6000, "upload_time": "2017-04-17T22:06:51", "url": "https://files.pythonhosted.org/packages/bf/79/6f5c50623ee5d87307985387f7c1fe2310047393f3a081bfa71e04a63e37/asr_evaluation-1.2.1.tar.gz" } ], "1.2.2": [ { "comment_text": "", "digests": { "md5": "e5c971f4ab37e89efe2ba99d6e30434c", "sha256": "58753ee00a2661ce716533bb7614726e6f65669861cf60bd9a2c81f6579238e6" }, "downloads": -1, "filename": "asr_evaluation-1.2.2.tar.gz", "has_sig": false, "md5_digest": "e5c971f4ab37e89efe2ba99d6e30434c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6900, "upload_time": "2017-04-18T00:20:52", "url": "https://files.pythonhosted.org/packages/10/09/aa23df35ce9b18bf29ba84ea2b950103262eeaecf0177c034120b7aa1929/asr_evaluation-1.2.2.tar.gz" } ], "2.0.0": [ { "comment_text": "", "digests": { "md5": "dbac47f94ff6eb48653e3a949d29110c", "sha256": "b17d3f8a86ad21c0b5433550530e4690b1bf64e889ee193c3fe543a381cac57d" }, "downloads": -1, "filename": "asr_evaluation-2.0.0.tar.gz", "has_sig": false, "md5_digest": "dbac47f94ff6eb48653e3a949d29110c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6046, "upload_time": "2017-04-18T06:09:14", "url": "https://files.pythonhosted.org/packages/36/b5/a0a87b131f885ff49856aea189423c1a970dc6a1eb0e9ee4bfdffdd9e4bb/asr_evaluation-2.0.0.tar.gz" } ], "2.0.1": [ { "comment_text": "", "digests": { "md5": "2a9e06243cf7a307e91a48555eecbebf", "sha256": "1d381e16973bf1b94aac99ca2f266d7ea3924936a5a45b32b8b6333ba8d86bb8" }, "downloads": -1, "filename": "asr_evaluation-2.0.1.tar.gz", "has_sig": false, "md5_digest": "2a9e06243cf7a307e91a48555eecbebf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6146, "upload_time": "2017-07-30T23:36:29", "url": "https://files.pythonhosted.org/packages/88/b6/240c2d3e51da0a132bcdce3b4398a21262ab4eae8afb9255cec98203bf8b/asr_evaluation-2.0.1.tar.gz" } ], "2.0.2": [ { "comment_text": "", "digests": { "md5": "1a273a0ddf5f7e90a56b774b95e504f1", "sha256": "fcda33b00d037c3052dedeeeaeaf69b18e45476100c2c42213aee72179f0bfcf" }, "downloads": -1, "filename": "asr_evaluation-2.0.2.tar.gz", "has_sig": false, "md5_digest": "1a273a0ddf5f7e90a56b774b95e504f1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6149, "upload_time": "2017-10-08T05:57:31", "url": "https://files.pythonhosted.org/packages/c7/ae/179c16420202a6d7d2588d80798256654363222244497bd836511b4781cd/asr_evaluation-2.0.2.tar.gz" } ], "2.0.3": [ { "comment_text": "", "digests": { "md5": "e045b5383d1d7f136eada026d04bfb66", "sha256": "2b7e9fc92c6cb66ca7993878652e14e703ec3b87403f20a8578cd7c466cf6266" }, "downloads": -1, "filename": "asr_evaluation-2.0.3-py3-none-any.whl", "has_sig": false, "md5_digest": "e045b5383d1d7f136eada026d04bfb66", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 7731, "upload_time": "2018-10-22T02:17:16", "url": "https://files.pythonhosted.org/packages/98/1f/b9e906032558f7d42aeab063a718c9dbaa12293f2f5ded301e14579e9603/asr_evaluation-2.0.3-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "ed4245fa9ee5e6c323eb6ec032ad41f6", "sha256": "eaea4068831c819055d92a71608c198fb11c5b2e8260d153706530dbcf93de49" }, "downloads": -1, "filename": "asr_evaluation-2.0.3.tar.gz", "has_sig": false, "md5_digest": "ed4245fa9ee5e6c323eb6ec032ad41f6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7808, "upload_time": "2018-10-22T02:17:17", "url": "https://files.pythonhosted.org/packages/b9/43/8d880a07d9b94203e960a929394870e02f17411dc9178a9879d4ec60092c/asr_evaluation-2.0.3.tar.gz" } ], "2.0.4": [ { "comment_text": "", "digests": { "md5": "e691680412af9877a5a0021662b39ae0", "sha256": "612a07ee81290bef7f910ffc4c70547f9fd071dfa10ec0dd75102b4ad6b2174f" }, "downloads": -1, "filename": "asr_evaluation-2.0.4-py3-none-any.whl", "has_sig": false, "md5_digest": "e691680412af9877a5a0021662b39ae0", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9094, "upload_time": "2018-10-31T23:33:54", "url": "https://files.pythonhosted.org/packages/36/23/3ab0b79dc4cec58412583bb9477ff37b655ec1f50390dc27400db95a7a14/asr_evaluation-2.0.4-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0446376c35347e705fba8592655a43cf", "sha256": "9b7ae0d1a267d25a13acf25e8de13535aedddb292b7aeaa8ed2c22bf51f27aed" }, "downloads": -1, "filename": "asr_evaluation-2.0.4.tar.gz", "has_sig": false, "md5_digest": "0446376c35347e705fba8592655a43cf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8209, "upload_time": "2018-10-31T23:33:56", "url": "https://files.pythonhosted.org/packages/eb/bf/4e8a1e34edc3ace9cc090466963c6baadc734d39cbfb5e84ead1788474b8/asr_evaluation-2.0.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "e691680412af9877a5a0021662b39ae0", "sha256": "612a07ee81290bef7f910ffc4c70547f9fd071dfa10ec0dd75102b4ad6b2174f" }, "downloads": -1, "filename": "asr_evaluation-2.0.4-py3-none-any.whl", "has_sig": false, "md5_digest": "e691680412af9877a5a0021662b39ae0", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9094, "upload_time": "2018-10-31T23:33:54", "url": "https://files.pythonhosted.org/packages/36/23/3ab0b79dc4cec58412583bb9477ff37b655ec1f50390dc27400db95a7a14/asr_evaluation-2.0.4-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0446376c35347e705fba8592655a43cf", "sha256": "9b7ae0d1a267d25a13acf25e8de13535aedddb292b7aeaa8ed2c22bf51f27aed" }, "downloads": -1, "filename": "asr_evaluation-2.0.4.tar.gz", "has_sig": false, "md5_digest": "0446376c35347e705fba8592655a43cf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8209, "upload_time": "2018-10-31T23:33:56", "url": "https://files.pythonhosted.org/packages/eb/bf/4e8a1e34edc3ace9cc090466963c6baadc734d39cbfb5e84ead1788474b8/asr_evaluation-2.0.4.tar.gz" } ] }