{ "info": { "author": "Google LLC", "author_email": "tensorflow-extended-dev@googlegroups.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "Intended Audience :: Education", "Intended Audience :: Science/Research", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3 :: Only", "Programming Language :: Python :: 3.7", "Programming Language :: Python :: 3.8", "Programming Language :: Python :: 3.9", "Topic :: Scientific/Engineering", "Topic :: Scientific/Engineering :: Artificial Intelligence", "Topic :: Scientific/Engineering :: Mathematics", "Topic :: Software Development", "Topic :: Software Development :: Libraries", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "\n\n# TensorFlow Model Analysis\n\n[](https://github.com/tensorflow/model-analysis)\n[](https://badge.fury.io/py/tensorflow-model-analysis)\n[](https://www.tensorflow.org/tfx/model_analysis/api_docs/python/tfma)\n\n*TensorFlow Model Analysis* (TFMA) is a library for evaluating TensorFlow\nmodels. It allows users to evaluate their models on large amounts of data in a\ndistributed manner, using the same metrics defined in their trainer. These\nmetrics can be computed over different slices of data and visualized in Jupyter\nnotebooks.\n\n\n\nCaution: TFMA may introduce backwards incompatible changes before version 1.0.\n\n## Installation\n\nThe recommended way to install TFMA is using the\n[PyPI package](https://pypi.org/project/tensorflow-model-analysis/):\n\n
\npip install tensorflow-model-analysis\n\n\npip install from https://pypi-nightly.tensorflow.org\n\n
\npip install -i https://pypi-nightly.tensorflow.org/simple tensorflow-model-analysis\n\n\npip install from the HEAD of the git:\n\n
\npip install git+https://github.com/tensorflow/model-analysis.git#egg=tensorflow_model_analysis\n\n\npip install from a released version directly from git:\n\n
\npip install git+https://github.com/tensorflow/model-analysis.git@v0.21.3#egg=tensorflow_model_analysis\n\n\nIf you have cloned the repository locally, and want to test your local change,\npip install from a local folder.\n\n
\npip install -e $FOLDER_OF_THE_LOCAL_LOCATION\n\n\nNote that protobuf must be installed correctly for the above option since it is\nbuilding TFMA from source and it requires protoc and all of its includes\nreference-able. Please see [protobuf install instruction](https://github.com/protocolbuffers/protobuf#protocol-compiler-installation)\nfor see the latest install instructions.\n\nCurrently, TFMA requires that TensorFlow is installed but does not have an\nexplicit dependency on the TensorFlow PyPI package. See the\n[TensorFlow install guides](https://www.tensorflow.org/install/) for\ninstructions.\n\n### Build TFMA from source\n\nTo build from source follow the following steps:\n\nInstall the protoc as per the link mentioned:\n[protoc](https://grpc.io/docs/protoc-installation/#install-pre-compiled-binaries-any-os)\n\nCreate a virtual environment by running the commands\n\n```\npython3 -m venv