{ "info": { "author": "Tianyi Zhang*, Varsha Kishore*, Felix Wu*, Kilian Q. Weinberger, and Yoav Artzi", "author_email": "tzhang@asapp.com", "bugtrack_url": null, "classifiers": [ "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 3", "Topic :: Scientific/Engineering :: Artificial Intelligence" ], "description": "# BERTScore\n[![made-with-python](https://img.shields.io/badge/Made%20with-Python-red.svg)](#python)\n[![arxiv](https://img.shields.io/badge/arXiv-1904.09675-b31b1b.svg)](https://arxiv.org/abs/1904.09675)\n[![PyPI version bert-score](https://badge.fury.io/py/bert-score.svg)](https://pypi.python.org/pypi/bert-score/) [![Downloads](https://pepy.tech/badge/bert-score)](https://pepy.tech/project/bert-score) [![Downloads](https://pepy.tech/badge/bert-score/month)](https://pepy.tech/project/bert-score) [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) \n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black) \n\n\nAutomatic Evaluation Metric described in the paper [BERTScore: Evaluating Text Generation with BERT](https://arxiv.org/abs/1904.09675) (ICLR 2020). We now support about 130 models (see this [spreadsheet](https://docs.google.com/spreadsheets/d/1RKOVpselB98Nnh_EOC4A2BYn8_201tmPODpNWu4w7xI/edit?usp=sharing) for their correlations with human evaluation). Currently, the best model is `microsoft/deberta-xlarge-mnli`, please consider using it instead of the default `roberta-large` in order to have the best correlation with human evaluation.\n\n#### News:\n\n- Updated to version 0.3.11\n - Support 6 DeBERTa v3 models\n - Support 3 ByT5 models\n- Updated to version 0.3.10\n - Support 8 SimCSE models\n - Fix the support of scibert (to be compatible with transformers >= 4.0.0)\n - Add scripts for reproducing some results in our paper (See this [folder](./reproduce))\n - Support fast tokenizers in huggingface transformers with `--use_fast_tokenizer`. Notably, you will get different scores because of the difference in the tokenizer implementations ([#106](https://github.com/Tiiiger/bert_score/issues/106)). \n - Fix non-zero recall problem for empty candidate strings ([#107](https://github.com/Tiiiger/bert_score/issues/107)).\n - Add Turkish BERT Supoort ([#108](https://github.com/Tiiiger/bert_score/issues/108)).\n- Updated to version 0.3.9\n - Support 3 BigBird models\n - Fix bugs for mBART and T5\n - Support 4 mT5 models as requested ([#93](https://github.com/Tiiiger/bert_score/issues/93))\n- Updated to version 0.3.8\n - Support 53 new pretrained models including BART, mBART, BORT, DeBERTa, T5, BERTweet, MPNet, ConvBERT, SqueezeBERT, SpanBERT, PEGASUS, Longformer, LED, Blendbot, etc. Among them, DeBERTa achives higher correlation with human scores than RoBERTa (our default) on WMT16 dataset. The correlations are presented in this [Google sheet](https://docs.google.com/spreadsheets/d/1RKOVpselB98Nnh_EOC4A2BYn8_201tmPODpNWu4w7xI/edit?usp=sharing).\n - Please consider using `--model_type microsoft/deberta-xlarge-mnli` or `--model_type microsoft/deberta-large-mnli` (faster) if you want the scores to correlate better with human scores.\n - Add baseline files for DeBERTa models.\n - Add example code to generate baseline files (please see the [details](get_rescale_baseline)).\n- Updated to version 0.3.7\n - Being compatible with Huggingface's transformers version >=4.0.0. Thanks to public contributers ([#84](https://github.com/Tiiiger/bert_score/pull/84), [#85](https://github.com/Tiiiger/bert_score/issues/85), [#86](https://github.com/Tiiiger/bert_score/pull/86)).\n- See [#22](https://github.com/Tiiiger/bert_score/issues/22) if you want to replicate our experiments on the COCO Captioning dataset.\n\n\n- For people in China, downloading pre-trained weights can be very slow. We provide copies of a few models on Baidu Pan.\n - [roberta-large](https://pan.baidu.com/s/1MTmGHsZ3ubn7Vr_W-wyEdQ) password: dhe5\n - [bert-base-chinese](https://pan.baidu.com/s/1THfiCXjWtdGGsCMskQ5svA) password: jvk7\n - [bert-base-multilingual-cased](https://pan.baidu.com/s/100SBjkLmI7U4pgo_e0q7CQ) password: yx3q\n- [Huggingface's datasets](https://github.com/huggingface/datasets) library includes BERTScore in their metric collection.\n\n
Previous updates

\n\n- Updated to version 0.3.6\n - Support custom baseline files [#74](https://github.com/Tiiiger/bert_score/pull/74)\n - The option `--rescale-with-baseline` is changed to `--rescale_with_baseline` so that it is consistent with other options.\n- Updated to version 0.3.5\n - Being compatible with Huggingface's transformers >=v3.0.0 and minor fixes ([#58](https://github.com/Tiiiger/bert_score/pull/58), [#66](https://github.com/Tiiiger/bert_score/pull/66), [#68](https://github.com/Tiiiger/bert_score/pull/68))\n - Several improvements related to efficency ([#67](https://github.com/Tiiiger/bert_score/pull/67), [#69](https://github.com/Tiiiger/bert_score/pull/69))\n- Updated to version 0.3.4\n - Compatible with transformers v2.11.0 now (#58)\n- Updated to version 0.3.3\n - Fixing the bug with empty strings [issue #47](https://github.com/Tiiiger/bert_score/issues/47).\n - Supporting 6 [ELECTRA](https://github.com/google-research/electra) models and 24 smaller [BERT](https://github.com/google-research/bert) models.\n - A new [Google sheet](https://docs.google.com/spreadsheets/d/1RKOVpselB98Nnh_EOC4A2BYn8_201tmPODpNWu4w7xI/edit?usp=sharing) for keeping the performance (i.e., pearson correlation with human judgment) of different models on WMT16 to-English.\n - Including the script for tuning the best number of layers of an English pre-trained model on WMT16 to-English data (See the [details](tune_layers)).\n- Updated to version 0.3.2\n - **Bug fixed**: fixing the bug in v0.3.1 when having multiple reference sentences.\n - Supporting multiple reference sentences with our command line tool.\n- Updated to version 0.3.1\n - A new `BERTScorer` object that caches the model to avoid re-loading it multiple times. Please see our [jupyter notebook example](./example/Demo.ipynb) for the usage.\n - Supporting multiple reference sentences for each example. The `score` function now can take a list of lists of strings as the references and return the score between the candidate sentence and its closest reference sentence.\n\n

\n\nPlease see [release logs](https://github.com/Tiiiger/bert_score/releases) for older updates.\n\n#### Authors:\n* [Tianyi Zhang](https://scholar.google.com/citations?user=OI0HSa0AAAAJ&hl=en)*\n* [Varsha Kishore](https://scholar.google.com/citations?user=B8UeYcEAAAAJ&authuser=2)*\n* [Felix Wu](https://sites.google.com/view/felixwu/home)*\n* [Kilian Q. Weinberger](http://kilian.cs.cornell.edu/index.html)\n* [Yoav Artzi](https://yoavartzi.com/)\n\n*: Equal Contribution\n\n### Overview\nBERTScore leverages the pre-trained contextual embeddings from BERT and matches\nwords in candidate and reference sentences by cosine similarity.\nIt has been shown to correlate with human judgment on sentence-level and\nsystem-level evaluation.\nMoreover, BERTScore computes precision, recall, and F1 measure, which can be\nuseful for evaluating different language generation tasks.\n\nFor an illustration, BERTScore recall can be computed as\n![](./bert_score.png \"BERTScore\")\n\nIf you find this repo useful, please cite:\n```\n@inproceedings{bert-score,\n title={BERTScore: Evaluating Text Generation with BERT},\n author={Tianyi Zhang* and Varsha Kishore* and Felix Wu* and Kilian Q. Weinberger and Yoav Artzi},\n booktitle={International Conference on Learning Representations},\n year={2020},\n url={https://openreview.net/forum?id=SkeHuCVFDr}\n}\n```\n\n### Installation\n* Python version >= 3.6\n* PyTorch version >= 1.0.0\n\nInstall from pypi with pip by \n\n```sh\npip install bert-score\n```\nInstall latest unstable version from the master branch on Github by:\n```\npip install git+https://github.com/Tiiiger/bert_score\n```\n\nInstall it from the source by:\n```sh\ngit clone https://github.com/Tiiiger/bert_score\ncd bert_score\npip install .\n```\nand you may test your installation by:\n```\npython -m unittest discover\n```\n\n### Usage\n\n\n#### Python Function\n\nOn a high level, we provide a python function `bert_score.score` and a python object `bert_score.BERTScorer`.\nThe function provides all the supported features while the scorer object caches the BERT model to faciliate multiple evaluations.\nCheck our [demo](./example/Demo.ipynb) to see how to use these two interfaces. \nPlease refer to [`bert_score/score.py`](./bert_score/score.py) for implementation details.\n\nRunning BERTScore can be computationally intensive (because it uses BERT :p).\nTherefore, a GPU is usually necessary. If you don't have access to a GPU, you\ncan try our [demo on Google Colab](https://colab.research.google.com/drive/1kpL8Y_AnUUiCxFjhxSrxCsc6-sDMNb_Q)\n\n#### Command Line Interface (CLI)\nWe provide a command line interface (CLI) of BERTScore as well as a python module. \nFor the CLI, you can use it as follows:\n1. To evaluate English text files:\n\nWe provide example inputs under `./example`.\n\n```sh\nbert-score -r example/refs.txt -c example/hyps.txt --lang en\n```\nYou will get the following output at the end:\n\nroberta-large_L17_no-idf_version=0.3.0(hug_trans=2.3.0) P: 0.957378 R: 0.961325 F1: 0.959333\n\nwhere \"roberta-large_L17_no-idf_version=0.3.0(hug_trans=2.3.0)\" is the hash code.\n\nStarting from version 0.3.0, we support rescaling the scores with baseline scores\n\n```sh\nbert-score -r example/refs.txt -c example/hyps.txt --lang en --rescale_with_baseline\n```\nYou will get:\n\nroberta-large_L17_no-idf_version=0.3.0(hug_trans=2.3.0)-rescaled P: 0.747044 R: 0.770484 F1: 0.759045 \n\nThis makes the range of the scores larger and more human-readable. Please see this [post](./journal/rescale_baseline.md) for details.\n\nWhen having multiple reference sentences, please use\n```sh\nbert-score -r example/refs.txt example/refs2.txt -c example/hyps.txt --lang en\n```\nwhere the `-r` argument supports an arbitrary number of reference files. Each reference file should have the same number of lines as your candidate/hypothesis file. The i-th line in each reference file corresponds to the i-th line in the candidate file.\n\n\n2. To evaluate text files in other languages:\n\nWe currently support the 104 languages in multilingual BERT ([full list](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages)).\n\nPlease specify the two-letter abbreviation of the language. For instance, using `--lang zh` for Chinese text. \n\nSee more options by `bert-score -h`.\n\n\n3. To load your own custom model:\nPlease specify the path to the model and the number of layers to use by `--model` and `--num_layers`.\n```sh\nbert-score -r example/refs.txt -c example/hyps.txt --model path_to_my_bert --num_layers 9\n```\n\n\n4. To visualize matching scores:\n```sh\nbert-score-show --lang en -r \"There are two bananas on the table.\" -c \"On the table are two apples.\" -f out.png\n```\nThe figure will be saved to out.png.\n\n\n#### Practical Tips\n\n* Report the hash code (e.g., `roberta-large_L17_no-idf_version=0.3.0(hug_trans=2.3.0)-rescaled`) in your paper so that people know what setting you use. This is inspired by [sacreBLEU](https://github.com/mjpost/sacreBLEU). Changes in huggingface's transformers version may also affect the score (See [issue #46](https://github.com/Tiiiger/bert_score/issues/46)).\n* Unlike BERT, RoBERTa uses GPT2-style tokenizer which creates addition \" \" tokens when there are multiple spaces appearing together. It is recommended to remove addition spaces by `sent = re.sub(r' +', ' ', sent)` or `sent = re.sub(r'\\s+', ' ', sent)`.\n* Using inverse document frequency (idf) on the reference\n sentences to weigh word importance may correlate better with human judgment.\n However, when the set of reference sentences become too small, the idf score \n would become inaccurate/invalid.\n We now make it optional. To use idf,\n please set `--idf` when using the CLI tool or\n `idf=True` when calling `bert_score.score` function.\n* When you are low on GPU memory, consider setting `batch_size` when calling\n `bert_score.score` function.\n* To use a particular model please set `-m MODEL_TYPE` when using the CLI tool\n or `model_type=MODEL_TYPE` when calling `bert_score.score` function. \n* We tune layer to use based on WMT16 metric evaluation dataset. You may use a\n different layer by setting `-l LAYER` or `num_layers=LAYER`. To tune the best layer for your custom model, please follow the instructions in [tune_layers](tune_layers) folder.\n* __Limitation__: Because BERT, RoBERTa, and XLM with learned positional embeddings are pre-trained on sentences with max length 512, BERTScore is undefined between sentences longer than 510 (512 after adding \\[CLS\\] and \\[SEP\\] tokens). The sentences longer than this will be truncated. Please consider using XLNet which can support much longer inputs.\n\n### Default Behavior\n\n#### Default Model\n| Language | Model |\n|:---------:|:--------------------------------:|\n| en | roberta-large |\n| en-sci | allenai/scibert_scivocab_uncased |\n| zh | bert-base-chinese |\n| tr | dbmdz/bert-base-turkish-cased |\n| others | bert-base-multilingual-cased |\n\n#### Default Layers\nPlease see this [Google sheet](https://docs.google.com/spreadsheets/d/1RKOVpselB98Nnh_EOC4A2BYn8_201tmPODpNWu4w7xI/edit?usp=sharing) for the supported models and their performance.\n\n### Acknowledgement\nThis repo wouldn't be possible without the awesome\n[bert](https://github.com/google-research/bert), [fairseq](https://github.com/pytorch/fairseq), and [transformers](https://github.com/huggingface/transformers).\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Tiiiger/bert_score", "keywords": "BERT NLP deep learning google metric", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "bert-score", "package_url": "https://pypi.org/project/bert-score/", "platform": "", "project_url": "https://pypi.org/project/bert-score/", "project_urls": { "Homepage": "https://github.com/Tiiiger/bert_score" }, "release_url": "https://pypi.org/project/bert-score/0.3.11/", "requires_dist": [ "torch (>=1.0.0)", "pandas (>=1.0.1)", "transformers (>=3.0.0numpy)", "requests", "tqdm (>=4.31.1)", "matplotlib", "packaging (>=20.9)" ], "requires_python": ">=3.6", "summary": "PyTorch implementation of BERT score", "version": "0.3.11", "yanked": false, "yanked_reason": null }, "last_serial": 12272283, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "beb7f00f02ca02098929e18791e58daf", "sha256": "d822176308ccf1352f15c3f2e4888b0b17d6784a6267043c369a13f9287d758e" }, "downloads": -1, "filename": "bert_score-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "beb7f00f02ca02098929e18791e58daf", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 7263, "upload_time": "2019-04-23T12:51:26", "upload_time_iso_8601": "2019-04-23T12:51:26.541641Z", "url": "https://files.pythonhosted.org/packages/7c/9d/40c76d648834646c0f7ff111dd41f5b16cc3db270610ed6247f4f21f636f/bert_score-0.1.0-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "10d2ae0b24524047773dc562da5ff879", "sha256": "a8794e7a5750c86d25a07ebc5847d15f8e0a0c4352dff580d7179169194ecec9" }, "downloads": -1, "filename": "bert_score-0.1.0.tar.gz", "has_sig": false, "md5_digest": "10d2ae0b24524047773dc562da5ff879", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5759, "upload_time": "2019-04-23T12:51:28", "upload_time_iso_8601": "2019-04-23T12:51:28.449895Z", "url": "https://files.pythonhosted.org/packages/60/76/6c460b8ef36aebf70ea891672610ab19093400c9729e57222aced7e7a715/bert_score-0.1.0.tar.gz", "yanked": false, "yanked_reason": null } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "e077efb278739754b82a23e92aab20dd", "sha256": "15947a9680d2e3af9e480f7a905d8c0adf2ca0dadef4505fd2b950e7cd9d191e" }, "downloads": -1, "filename": "bert_score-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "e077efb278739754b82a23e92aab20dd", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9411, "upload_time": "2019-04-27T02:50:30", "upload_time_iso_8601": "2019-04-27T02:50:30.874780Z", "url": "https://files.pythonhosted.org/packages/3c/a1/65ab39291884caf5466f443add017c072bf081b548dff073520825fbdc43/bert_score-0.1.1-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "521d962fcd2a09a36f18d8cb2d9d42b9", "sha256": "7ff0a70ac3d43aa94887168079d079d02623f8a5bb157efa50ed7a874de4fdfb" }, "downloads": -1, "filename": "bert_score-0.1.1.tar.gz", "has_sig": false, "md5_digest": "521d962fcd2a09a36f18d8cb2d9d42b9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6918, "upload_time": "2019-04-27T02:50:33", "upload_time_iso_8601": "2019-04-27T02:50:33.064695Z", "url": "https://files.pythonhosted.org/packages/99/73/34b87d5ae5eecaab7269d57e96adad01c4ae1a30acc3a6c26c1f89a1563e/bert_score-0.1.1.tar.gz", "yanked": false, "yanked_reason": null } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "018aa69253f3a79e28d6b28fe1b596b0", "sha256": "0dc5dba7dc34849f91e0a442f8cf0067f891ef46c8c4e8a08c19b7490c177aab" }, "downloads": -1, "filename": "bert_score-0.1.2-py3-none-any.whl", "has_sig": false, "md5_digest": "018aa69253f3a79e28d6b28fe1b596b0", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9441, "upload_time": "2019-04-27T19:05:09", "upload_time_iso_8601": "2019-04-27T19:05:09.946782Z", "url": "https://files.pythonhosted.org/packages/19/d8/a11b9f21be4de8423e9fd3448a490e6b3c8de54afe759c772dad0deded28/bert_score-0.1.2-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "b548221a52d9f6b45faf77ad482b1d54", "sha256": "db27bb570d4adcf336ee88331139052581e2d80edf482b1bb140091cdd5c7056" }, "downloads": -1, "filename": "bert_score-0.1.2.tar.gz", "has_sig": false, "md5_digest": "b548221a52d9f6b45faf77ad482b1d54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6921, "upload_time": "2019-04-27T19:05:12", "upload_time_iso_8601": "2019-04-27T19:05:12.254779Z", "url": "https://files.pythonhosted.org/packages/45/ad/aa216c4e58fc4c6d0d2ae07ae0d11881e9181932532ebff4bbec077d9432/bert_score-0.1.2.tar.gz", "yanked": false, "yanked_reason": null } ], "0.2.0": [], "0.2.1": [], "0.2.2": [ { "comment_text": "", "digests": { "md5": "3baa98d2fc66d0f7e98914672aa70819", "sha256": "36a11d3433999cfebc9fadc94aa43acdf3b69ea553a48f91ef692a185faf319a" }, "downloads": -1, "filename": "bert_score-0.2.2-py3-none-any.whl", "has_sig": false, "md5_digest": "3baa98d2fc66d0f7e98914672aa70819", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 14782, "upload_time": "2019-11-30T01:21:04", "upload_time_iso_8601": "2019-11-30T01:21:04.035943Z", "url": "https://files.pythonhosted.org/packages/47/d5/df44286c8bffc1e38730e889688b03a1a3c2575d673cb7028fd9b185f05b/bert_score-0.2.2-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "1f5179d41a08c750301c89db2a32d341", "sha256": "6591b8403c25cb3c0fc8e646b10f139990cdd0421da402e62b753d60621d094c" }, "downloads": -1, "filename": "bert_score-0.2.2.tar.gz", "has_sig": false, "md5_digest": "1f5179d41a08c750301c89db2a32d341", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 15713, "upload_time": "2019-11-30T01:21:05", "upload_time_iso_8601": "2019-11-30T01:21:05.640147Z", "url": "https://files.pythonhosted.org/packages/76/f1/424ca46eb606d5ff9b0b490ee5d1481f9ae04aac968aef06c12e2da57a08/bert_score-0.2.2.tar.gz", "yanked": false, "yanked_reason": null } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "13cca2860cab352178255aa60c676c5c", "sha256": "ebf9d59408a7465e9ef33f14a9ed180b6b373fbb1c8ad10aeda42e053c3ab927" }, "downloads": -1, "filename": "bert_score-0.2.3-py3-none-any.whl", "has_sig": false, "md5_digest": "13cca2860cab352178255aa60c676c5c", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 15608, "upload_time": "2019-12-22T19:11:54", "upload_time_iso_8601": "2019-12-22T19:11:54.392400Z", "url": "https://files.pythonhosted.org/packages/51/62/0580ae4df9720e3306127880e4d7703ec80e63c454023ddb242f4491dd14/bert_score-0.2.3-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "0c5eae936793ebb7153f403a96eadb3d", "sha256": "833661288243fce8b638654c94c0d9edea2a8f4fd2cdc605c81efe4a99d81bb9" }, "downloads": -1, "filename": "bert_score-0.2.3.tar.gz", "has_sig": false, "md5_digest": "0c5eae936793ebb7153f403a96eadb3d", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 17033, "upload_time": "2019-12-22T19:11:55", "upload_time_iso_8601": "2019-12-22T19:11:55.997263Z", "url": "https://files.pythonhosted.org/packages/bf/d3/f7580cfe74c9123fa46f6fa6b279d6ed5729b7c623774793a90504beb216/bert_score-0.2.3.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "9521cf61d2f1c723b878b99616132843", "sha256": "d4d1aedb84b1c86a6e3c2f4757208b9e4f6bd2318c2589e61efadd7fd74c8572" }, "downloads": -1, "filename": "bert_score-0.3.0-py3-none-any.whl", "has_sig": false, "md5_digest": "9521cf61d2f1c723b878b99616132843", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 48045, "upload_time": "2020-01-14T18:32:25", "upload_time_iso_8601": "2020-01-14T18:32:25.354415Z", "url": "https://files.pythonhosted.org/packages/cd/0f/03a2b49125b420c3d6dea36122844f2308c0efd289bb447b046341439458/bert_score-0.3.0-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "e35f1fd41afc5fde2e21fc54f9686cf1", "sha256": "c4c2a0afb7601013c5700445882952da619404df723efdf64cd568eb649dfdef" }, "downloads": -1, "filename": "bert_score-0.3.0.tar.gz", "has_sig": false, "md5_digest": "e35f1fd41afc5fde2e21fc54f9686cf1", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 37294, "upload_time": "2020-01-14T18:32:27", "upload_time_iso_8601": "2020-01-14T18:32:27.250389Z", "url": "https://files.pythonhosted.org/packages/c4/ba/4031cecbea24ee723cc994ca96e11f3b1b75c406fbc5fd37a48f3d3078b8/bert_score-0.3.0.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "7e1a5e5576bc22e455232e0078333b3b", "sha256": "105bd58789dd58050d9c2a4d635a0a2ae6897e59a3867cc85c442a15f0eeeccb" }, "downloads": -1, "filename": "bert_score-0.3.1-py3-none-any.whl", "has_sig": false, "md5_digest": "7e1a5e5576bc22e455232e0078333b3b", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 51990, "upload_time": "2020-03-05T19:08:06", "upload_time_iso_8601": "2020-03-05T19:08:06.250136Z", "url": "https://files.pythonhosted.org/packages/c8/cd/95f08447e6c773fd2580e7734b00dec0e36319b1147a1aa8028ac78d3eb4/bert_score-0.3.1-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "a90323086a7e66b0d83878ad80d61072", "sha256": "0cd951e6d3ff1c1912707216d576d39d63adb7a0e699fdff07e8870d3f63b659" }, "downloads": -1, "filename": "bert_score-0.3.1.tar.gz", "has_sig": false, "md5_digest": "a90323086a7e66b0d83878ad80d61072", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 39286, "upload_time": "2020-03-05T19:08:07", "upload_time_iso_8601": "2020-03-05T19:08:07.686914Z", "url": "https://files.pythonhosted.org/packages/12/cc/6805830534b72d5776befd46a0fc9a5727a5b17fe9855ad5eada05bb459b/bert_score-0.3.1.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.10": [ { "comment_text": "", "digests": { "md5": "680a50ae893e9c4aa5fc22c01d37d43e", "sha256": "242ac82b1cbc276a69f003649856b0137d949a6bf916c73dbe11f4cf91a8d35c" }, "downloads": -1, "filename": "bert_score-0.3.10-py3-none-any.whl", "has_sig": false, "md5_digest": "680a50ae893e9c4aa5fc22c01d37d43e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 59809, "upload_time": "2021-08-05T04:55:22", "upload_time_iso_8601": "2021-08-05T04:55:22.217270Z", "url": "https://files.pythonhosted.org/packages/09/9e/f944beecfc617a7599fac4710eb1b116ec7f7cbc009e4451aee1fa23c1a4/bert_score-0.3.10-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "197515d76f615b32ab04a109543efd8d", "sha256": "a51631cbc1ed62d5f3e06e28260504a5319e4ed8608e8afa6b7a41352e02fbfe" }, "downloads": -1, "filename": "bert_score-0.3.10.tar.gz", "has_sig": false, "md5_digest": "197515d76f615b32ab04a109543efd8d", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 46841, "upload_time": "2021-08-05T04:55:23", "upload_time_iso_8601": "2021-08-05T04:55:23.913203Z", "url": "https://files.pythonhosted.org/packages/6f/51/eb820cfb959bb4979a40180f54cbba668b683bc7f47837f52dcfcd8ba2b5/bert_score-0.3.10.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.11": [ { "comment_text": "", "digests": { "md5": "8c88145b41ef2528d9e2b12e064aab83", "sha256": "d3e8a440d639327363d61d07417fa74cdab1af1af0defcecc0db7e488f2865bc" }, "downloads": -1, "filename": "bert_score-0.3.11-py3-none-any.whl", "has_sig": false, "md5_digest": "8c88145b41ef2528d9e2b12e064aab83", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 60107, "upload_time": "2021-12-10T22:46:20", "upload_time_iso_8601": "2021-12-10T22:46:20.958650Z", "url": "https://files.pythonhosted.org/packages/0e/f0/834e4b74482ad63e5855c272327b87afe841517be584b63c006484bf9908/bert_score-0.3.11-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "f23171f9746f3dc5e569eec33429e5fd", "sha256": "137a07ba9d4875f61a86ab838a39888f1e1dc7b024b45533da9ece35b0a84f52" }, "downloads": -1, "filename": "bert_score-0.3.11.tar.gz", "has_sig": false, "md5_digest": "f23171f9746f3dc5e569eec33429e5fd", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 47313, "upload_time": "2021-12-10T22:46:22", "upload_time_iso_8601": "2021-12-10T22:46:22.258783Z", "url": "https://files.pythonhosted.org/packages/73/ed/6ef3385d14849c6ffa004da017216b48872286b36f8d54d33662cb332df1/bert_score-0.3.11.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "d5b24857273d9c1b6de62d39b7fa8200", "sha256": "07ddc7a7995188201f107300f877474f88208c82b9bb92172288de621868e7fe" }, "downloads": -1, "filename": "bert_score-0.3.2-py3-none-any.whl", "has_sig": false, "md5_digest": "d5b24857273d9c1b6de62d39b7fa8200", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 52249, "upload_time": "2020-04-18T16:57:24", "upload_time_iso_8601": "2020-04-18T16:57:24.907083Z", "url": "https://files.pythonhosted.org/packages/5b/db/391c067946b946ab6818d49bd38fe5c53c7d7108bea4f0135bde614f41bb/bert_score-0.3.2-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "4910784becf90d1123903e4fa2493c58", "sha256": "0acfc11d93c3514eca8ad95a034293c2ee852aabd704d0babc97f4e6880a5521" }, "downloads": -1, "filename": "bert_score-0.3.2.tar.gz", "has_sig": false, "md5_digest": "4910784becf90d1123903e4fa2493c58", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 39701, "upload_time": "2020-04-18T16:57:26", "upload_time_iso_8601": "2020-04-18T16:57:26.073998Z", "url": "https://files.pythonhosted.org/packages/8a/f2/fe7f8090da39c908082f08f2f65cb5bf0e9d3144d594efbcabd5dbafe421/bert_score-0.3.2.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.3": [ { "comment_text": "", "digests": { "md5": "108bbb6576b3c70fadc92b5488e92ec3", "sha256": "c5426e06da992d742a23f04e5eaa988581b73a03429e75c24aa6bbb1ddf771c9" }, "downloads": -1, "filename": "bert_score-0.3.3-py3-none-any.whl", "has_sig": false, "md5_digest": "108bbb6576b3c70fadc92b5488e92ec3", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 52345, "upload_time": "2020-05-10T22:28:00", "upload_time_iso_8601": "2020-05-10T22:28:00.189655Z", "url": "https://files.pythonhosted.org/packages/95/66/a6210213e3f8e5d52f665d35a435310c11e6d69229b4eb90022e89f3e5d2/bert_score-0.3.3-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "2edd71f8b8c9d8365cf59766884c74c9", "sha256": "f47737dbbdfc97d2c9a941fe620f371a4f71c01370c48c560892828528236adb" }, "downloads": -1, "filename": "bert_score-0.3.3.tar.gz", "has_sig": false, "md5_digest": "2edd71f8b8c9d8365cf59766884c74c9", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 39363, "upload_time": "2020-05-10T22:28:01", "upload_time_iso_8601": "2020-05-10T22:28:01.518404Z", "url": "https://files.pythonhosted.org/packages/1a/5d/d10fd5e3c495cec481ccbe41dc9ea9f7b93f445d48dfaabac6ea55d7297a/bert_score-0.3.3.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.4": [ { "comment_text": "", "digests": { "md5": "a48c4e4c6e4e09e881d4469a74bb1c2c", "sha256": "49d16c6615e1d2f43303fdd9b71d60ff48fcceedb7a1033d8926ede80705a17e" }, "downloads": -1, "filename": "bert_score-0.3.4-py3-none-any.whl", "has_sig": false, "md5_digest": "a48c4e4c6e4e09e881d4469a74bb1c2c", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 52506, "upload_time": "2020-06-10T15:26:37", "upload_time_iso_8601": "2020-06-10T15:26:37.675895Z", "url": "https://files.pythonhosted.org/packages/49/74/410f2cb80ea7cc9f112de55a7cf63f0880d2db963375b73a557d0746b5f1/bert_score-0.3.4-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "a6592c8681427e4fb27cd86837de2196", "sha256": "02114fb1a331131d4f4a70cbbc3022f4b873ef434b18da30cc0d7b7d5822834a" }, "downloads": -1, "filename": "bert_score-0.3.4.tar.gz", "has_sig": false, "md5_digest": "a6592c8681427e4fb27cd86837de2196", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 39704, "upload_time": "2020-06-10T15:26:38", "upload_time_iso_8601": "2020-06-10T15:26:38.774785Z", "url": "https://files.pythonhosted.org/packages/2a/a3/da5e8291a6fb1d5c10777be453b2458892c3ec33d4ac8c8121958ee647dc/bert_score-0.3.4.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.5": [ { "comment_text": "", "digests": { "md5": "33241a36d852a6a9a5807c8f6a4d63de", "sha256": "8699b101667ab464c79d9eec3c156fbbdc144037955fb794e878586f2e3f6a22" }, "downloads": -1, "filename": "bert_score-0.3.5-py3-none-any.whl", "has_sig": false, "md5_digest": "33241a36d852a6a9a5807c8f6a4d63de", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 52654, "upload_time": "2020-07-17T20:26:42", "upload_time_iso_8601": "2020-07-17T20:26:42.614212Z", "url": "https://files.pythonhosted.org/packages/50/8c/70244d0f351176c9984643e2037edc18b9124491b47ad19191039a18d2bd/bert_score-0.3.5-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "ddeb293b0403297c72ae680e7f7dbebc", "sha256": "a91f7b16261b7fd24b267860621393458a48d4f88f45f64ce368592a1bb04af9" }, "downloads": -1, "filename": "bert_score-0.3.5.tar.gz", "has_sig": false, "md5_digest": "ddeb293b0403297c72ae680e7f7dbebc", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 39949, "upload_time": "2020-07-17T20:26:43", "upload_time_iso_8601": "2020-07-17T20:26:43.962047Z", "url": "https://files.pythonhosted.org/packages/85/74/5ee0e3324ee366a37393f5cf9beabb7722331c0d5a7966526ce1e936f6cd/bert_score-0.3.5.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.6": [ { "comment_text": "", "digests": { "md5": "16dd23043ea3b867085d33bf2b9112bc", "sha256": "f66ed5982569dc5a5a472b56bca851067a194d4650303d75e6485cce19960fe5" }, "downloads": -1, "filename": "bert_score-0.3.6-py3-none-any.whl", "has_sig": false, "md5_digest": "16dd23043ea3b867085d33bf2b9112bc", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 53000, "upload_time": "2020-09-03T19:41:14", "upload_time_iso_8601": "2020-09-03T19:41:14.070784Z", "url": "https://files.pythonhosted.org/packages/fa/7e/2e05393a9f89386af6443a9e0323e35f41909e3adf98ba5a1d3fa7f0c2e3/bert_score-0.3.6-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "9be7b333c1851fc867daaf018074f0a1", "sha256": "ffc1927dc7ea1ede0db8c767a2351d70172236f3ad50ed90b22ffb946e5a59e2" }, "downloads": -1, "filename": "bert_score-0.3.6.tar.gz", "has_sig": false, "md5_digest": "9be7b333c1851fc867daaf018074f0a1", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 40430, "upload_time": "2020-09-03T19:41:16", "upload_time_iso_8601": "2020-09-03T19:41:16.342780Z", "url": "https://files.pythonhosted.org/packages/e0/8a/c5f32bda48a02fa154898952a7c931602fd49ba53eef282c7309c2eb9b82/bert_score-0.3.6.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.7": [ { "comment_text": "", "digests": { "md5": "53196c2269dcbfd039d43333a81d6422", "sha256": "7cb962d01280fdcc597d588604df4bd0472cd0d694cfbb48aeae60348f163765" }, "downloads": -1, "filename": "bert_score-0.3.7-py3-none-any.whl", "has_sig": false, "md5_digest": "53196c2269dcbfd039d43333a81d6422", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 53142, "upload_time": "2020-12-06T22:36:17", "upload_time_iso_8601": "2020-12-06T22:36:17.491071Z", "url": "https://files.pythonhosted.org/packages/a1/f9/7bd03a70ccb4e3f6a334f5f5dc8871d76de10144d277d23f730b08cf2aaf/bert_score-0.3.7-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "3ae801eaa521977fb7c2c38bfb440527", "sha256": "6ae0dafb2e2d92dc313f9c6bf6bcd7d4d9af6bf7bc53086e40b9a87f2140cc67" }, "downloads": -1, "filename": "bert_score-0.3.7.tar.gz", "has_sig": false, "md5_digest": "3ae801eaa521977fb7c2c38bfb440527", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 40731, "upload_time": "2020-12-06T22:36:18", "upload_time_iso_8601": "2020-12-06T22:36:18.764836Z", "url": "https://files.pythonhosted.org/packages/68/e9/6eafb4df6318e7c06a0c345b78bb46bd8ea951a24b915dfe81b571656d90/bert_score-0.3.7.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.8": [ { "comment_text": "", "digests": { "md5": "f504e994447c7d65338dcfa220873dbb", "sha256": "3a521bdf923dc32db06196f5e8862304bc191258726d004cf42641e0657c9b66" }, "downloads": -1, "filename": "bert_score-0.3.8-py3-none-any.whl", "has_sig": false, "md5_digest": "f504e994447c7d65338dcfa220873dbb", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 58712, "upload_time": "2021-03-03T18:21:29", "upload_time_iso_8601": "2021-03-03T18:21:29.067366Z", "url": "https://files.pythonhosted.org/packages/14/27/ccf86d5dfc19f89bee4449e96ac6e0f7c312f1614de86609c5f6da5c40af/bert_score-0.3.8-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "5161eb44bc8aa907e28230339ebd3e5b", "sha256": "6da9193dfdf35e47ac731308193bf662645999eb9b6f5f60349369d06071d8e6" }, "downloads": -1, "filename": "bert_score-0.3.8.tar.gz", "has_sig": false, "md5_digest": "5161eb44bc8aa907e28230339ebd3e5b", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 45254, "upload_time": "2021-03-03T18:21:30", "upload_time_iso_8601": "2021-03-03T18:21:30.617737Z", "url": "https://files.pythonhosted.org/packages/81/1b/45b782704e7f1fcb00f7bbc92f98375cdb60cb85b553137a4c0753758719/bert_score-0.3.8.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.9": [ { "comment_text": "", "digests": { "md5": "4198d9821fc3f9c674f4c2b2862f30f5", "sha256": "5990ee4c547940071391afd48a5f520d568a3bab6f9a9a92e96188b3f44d49b6" }, "downloads": -1, "filename": "bert_score-0.3.9-py3-none-any.whl", "has_sig": false, "md5_digest": "4198d9821fc3f9c674f4c2b2862f30f5", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 59047, "upload_time": "2021-04-17T18:46:01", "upload_time_iso_8601": "2021-04-17T18:46:01.737573Z", "url": "https://files.pythonhosted.org/packages/38/fb/e63e7e231a79db0489dbf7e7d0ebfb279ccb3d8216aa0d133572f784f3fa/bert_score-0.3.9-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "46e400e3ce7708e07f7a46b368a61322", "sha256": "43ed028ff38a41ca0ba77fe0b05f796d5d58898a2209abeb0df58687c5f75611" }, "downloads": -1, "filename": "bert_score-0.3.9.tar.gz", "has_sig": false, "md5_digest": "46e400e3ce7708e07f7a46b368a61322", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 45825, "upload_time": "2021-04-17T18:46:03", "upload_time_iso_8601": "2021-04-17T18:46:03.141981Z", "url": "https://files.pythonhosted.org/packages/8c/ae/ef7ef086d6b634067b33f45d083e981d5dd6ccbcc526836d3f652f463771/bert_score-0.3.9.tar.gz", "yanked": false, "yanked_reason": null } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "8c88145b41ef2528d9e2b12e064aab83", "sha256": "d3e8a440d639327363d61d07417fa74cdab1af1af0defcecc0db7e488f2865bc" }, "downloads": -1, "filename": "bert_score-0.3.11-py3-none-any.whl", "has_sig": false, "md5_digest": "8c88145b41ef2528d9e2b12e064aab83", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 60107, "upload_time": "2021-12-10T22:46:20", "upload_time_iso_8601": "2021-12-10T22:46:20.958650Z", "url": "https://files.pythonhosted.org/packages/0e/f0/834e4b74482ad63e5855c272327b87afe841517be584b63c006484bf9908/bert_score-0.3.11-py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "f23171f9746f3dc5e569eec33429e5fd", "sha256": "137a07ba9d4875f61a86ab838a39888f1e1dc7b024b45533da9ece35b0a84f52" }, "downloads": -1, "filename": "bert_score-0.3.11.tar.gz", "has_sig": false, "md5_digest": "f23171f9746f3dc5e569eec33429e5fd", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 47313, "upload_time": "2021-12-10T22:46:22", "upload_time_iso_8601": "2021-12-10T22:46:22.258783Z", "url": "https://files.pythonhosted.org/packages/73/ed/6ef3385d14849c6ffa004da017216b48872286b36f8d54d33662cb332df1/bert_score-0.3.11.tar.gz", "yanked": false, "yanked_reason": null } ], "vulnerabilities": [] }