{ "info": { "author": "Neil G. Marchant", "author_email": "ngmarchant@gmail.com", "bugtrack_url": null, "classifiers": [ "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Programming Language :: Python", "Programming Language :: Python :: 3", "Topic :: Scientific/Engineering", "Topic :: Scientific/Engineering :: Artificial Intelligence", "Topic :: Software Development" ], "description": "=====\nOASIS\n=====\n\n.. image:: https://travis-ci.org/ngmarchant/oasis.svg?branch=master\n :target: https://travis-ci.org/ngmarchant/oasis\n.. image:: https://img.shields.io/badge/License-MIT-yellow.svg\n :target: https://opensource.org/licenses/MIT\n.. image:: https://badge.fury.io/py/oasis.svg\n :target: https://pypi.python.org/pypi/oasis\n\nOASIS is a tool for evaluating binary classifiers when ground truth class\nlabels are not immediately available, but can be obtained at some cost (e.g.\nby asking humans). The tool takes an unlabelled test set as input and\nintelligently selects items to label so as to provide a *precise* estimate of\nthe classifier's performance, whilst *minimising* the amount of labelling\nrequired. The underlying strategy for selecting the items to label is based on\na technique called *adaptive importance sampling*, which is optimised for the\nclassifier performance measure of interest. Currently, OASIS supports\nestimation of the weighted F-measure, which includes the F1-score, precision\nand recall.\n\nImportant links\n===============\nDocumentation: https://ngmarchant.github.io/oasis\n\nSource: https://www.github.com/ngmarchant/oasis\n\nTechnical paper: https://arxiv.org/pdf/1703.00617.pdf\n\nExample\n=======\nSee the Jupyter notebook under ``docs/tutorial/tutorial.ipynb``::\n\n >>> import oasis\n >>> data = oasis.Data()\n >>> data.read_h5('Amazon-GoogleProducts-test.h5')\n >>> def oracle(idx):\n >>> return data.labels[idx]\n >>> smplr = oasis.OASISSampler(alpha, data.preds, data.scores, oracle)\n >>> smplr.sample_distinct(5000) #: query labels for 5000 distinct items\n >>> print(\"Current estimate is {}.\".format(smplr.estimate_[smplr.t_ - 1]))\n\n\nLicense and disclaimer\n======================\nThe code is released under the MIT license. Please see the LICENSE file for\ndetails.\n\n\n", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://ngmarchant.github.io/oasis", "keywords": "F-measure active sampling evaluation classification recall precision", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "oasis", "package_url": "https://pypi.org/project/oasis/", "platform": "", "project_url": "https://pypi.org/project/oasis/", "project_urls": { "Homepage": "http://ngmarchant.github.io/oasis" }, "release_url": "https://pypi.org/project/oasis/0.1.2/", "requires_dist": [ "numpy", "scipy", "sklearn", "tables" ], "requires_python": "", "summary": "Optimal Asymptotic Sequential Importance Sampling", "version": "0.1.2" }, "last_serial": 3049304, "releases": { "0.1.2": [ { "comment_text": "", "digests": { "md5": "2e468773502e69f3355b1de092150272", "sha256": "ea721e29d5459c710a0a536a2484f426d8ac07afaadf1f889c7a433a9eb1585c" }, "downloads": -1, "filename": "oasis-0.1.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2e468773502e69f3355b1de092150272", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 31026, "upload_time": "2017-07-26T06:17:32", "url": "https://files.pythonhosted.org/packages/2d/95/190ede33154be7038de16bb4f3244711ded661074c9ff67de11c85eafbdf/oasis-0.1.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4e737f3b135a740536a7621161940f16", "sha256": "c1171fa0f0e3abce2265cb3ee124d6ea7f14b33d9b4e437fda6a1297919e43d8" }, "downloads": -1, "filename": "oasis-0.1.2.tar.gz", "has_sig": false, "md5_digest": "4e737f3b135a740536a7621161940f16", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16570417, "upload_time": "2017-07-26T06:17:37", "url": "https://files.pythonhosted.org/packages/4a/c8/058ee582a272e5185fb9f18325bc0872224aa1cbf9c38b73907d410619e6/oasis-0.1.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "2e468773502e69f3355b1de092150272", "sha256": "ea721e29d5459c710a0a536a2484f426d8ac07afaadf1f889c7a433a9eb1585c" }, "downloads": -1, "filename": "oasis-0.1.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2e468773502e69f3355b1de092150272", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 31026, "upload_time": "2017-07-26T06:17:32", "url": "https://files.pythonhosted.org/packages/2d/95/190ede33154be7038de16bb4f3244711ded661074c9ff67de11c85eafbdf/oasis-0.1.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4e737f3b135a740536a7621161940f16", "sha256": "c1171fa0f0e3abce2265cb3ee124d6ea7f14b33d9b4e437fda6a1297919e43d8" }, "downloads": -1, "filename": "oasis-0.1.2.tar.gz", "has_sig": false, "md5_digest": "4e737f3b135a740536a7621161940f16", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16570417, "upload_time": "2017-07-26T06:17:37", "url": "https://files.pythonhosted.org/packages/4a/c8/058ee582a272e5185fb9f18325bc0872224aa1cbf9c38b73907d410619e6/oasis-0.1.2.tar.gz" } ] }