{ "info": { "author": "Andrey Ignatov", "author_email": "andrey@vision.ee.ethz.ch", "bugtrack_url": null, "classifiers": [ "Intended Audience :: Developers", "Intended Audience :: Education", "Intended Audience :: Information Technology", "Intended Audience :: Science/Research", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Topic :: Scientific/Engineering", "Topic :: Scientific/Engineering :: Artificial Intelligence", "Topic :: Software Development :: Testing", "Topic :: System :: Benchmark" ], "description": "[AI Benchmark Alpha](http://ai-benchmark.com/alpha) is an open source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs. The benchmark is relying on [TensorFlow](https://www.tensorflow.org) machine learning library, and is providing a lightweight and accurate solution for assessing inference and training speed for key Deep Learning models.

\n\nIn total, AI Benchmark consists of 42 tests and 19 sections provided below:
\n\n1. MobileNet-V2  `[classification]`\n2. Inception-V3  `[classification]`\n3. Inception-V4  `[classification]`\n4. Inception-ResNet-V2  `[classification]`\n5. ResNet-V2-50  `[classification]`\n6. ResNet-V2-152  `[classification]`\n7. VGG-16  `[classification]`\n8. SRCNN 9-5-5  `[image-to-image mapping]`\n9. VGG-19  `[image-to-image mapping]`\n10. ResNet-SRGAN  `[image-to-image mapping]`\n11. ResNet-DPED  `[image-to-image mapping]`\n12. U-Net  `[image-to-image mapping]`\n13. Nvidia-SPADE  `[image-to-image mapping]`\n14. ICNet  `[image segmentation]`\n15. PSPNet  `[image segmentation]`\n16. DeepLab  `[image segmentation]`\n17. Pixel-RNN  `[inpainting]`\n18. LSTM  `[sentence sentiment analysis]`\n19. GNMT  `[text translation]`\n\nFor more information and results, please visit the project website: [http://ai-benchmark.com/alpha](http://ai-benchmark.com/alpha)

\n\n#### Installation Instructions
\n\nThe benchmark requires TensorFlow machine learning library to be present in your system.\n\nOn systems that do not have Nvidia GPUs, run the following commands to install AI Benchmark:\n\n```bash\npip install tensorflow\npip install ai-benchmark\n```\n
\n\nIf you want to check the performance of Nvidia graphic cards, run the following commands:\n\n```bash\npip install tensorflow-gpu\npip install ai-benchmark\n```\n\n`Note 1:` If Tensorflow is already installed in your system, you can skip the first command.\n\n`Note 2:` For running the benchmark on Nvidia GPUs, `NVIDIA CUDA` and `cuDNN` libraries should be installed first. Please find detailed instructions [here](https://www.tensorflow.org/install/gpu).

\n\n#### Getting Started
\n\nTo run AI Benchmark, use the following code:\n\n```bash\nfrom ai_benchmark import AIBenchmark\nbenchmark = AIBenchmark()\nresults = benchmark.run()\n```\n\nAlternatively, on Linux systems you can type `ai-benchmark` in the command line to start the tests.\n\nTo run inference or training only, use `benchmark.run_inference()` or `benchmark.run_training()`.

\n\n#### Advanced settings
\n\n```bash\nAIBenchmark(use_CPU=None, verbose_level=1):\n```\n> use_CPU=`{True, False, None}`:   whether to run the tests on CPUs  (if tensorflow-gpu is installed)\n\n> verbose_level=`{0, 1, 2, 3}`:   run tests silently | with short summary | with information about each run | with TF logs\n\n```bash\nbenchmark.run(precision=\"normal\"):\n```\n\n> precision=`{\"normal\", \"high\"}`:   if `high` is selected, the benchmark will execute 10 times more runs for each test.\n\n
\n\n### Additional Notes and Requirements
\n\nGPU with at least 2GB of RAM is required for running inference tests / 4GB of RAM for training tests.\n\nThe benchmark is compatible with both `TensorFlow 1.x` and `2.x` versions.

\n\n### Contacts
\n\nPlease contact `andrey@vision.ee.ethz.ch` for any feedback or information.\n\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://ai-benchmark.com", "keywords": "AI Benchmark Tensorflow Machine Learning Inference Training", "license": "Apache License Version 2.0", "maintainer": "", "maintainer_email": "", "name": "ai-benchmark", "package_url": "https://pypi.org/project/ai-benchmark/", "platform": "", "project_url": "https://pypi.org/project/ai-benchmark/", "project_urls": { "Homepage": "http://ai-benchmark.com" }, "release_url": "https://pypi.org/project/ai-benchmark/0.1.1/", "requires_dist": [ "numpy", "psutil", "py-cpuinfo", "pillow", "setuptools", "requests" ], "requires_python": "", "summary": "AI Benchmark is an open source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs.", "version": "0.1.1" }, "last_serial": 5451735, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "b33f3199a26ab2b3b37811df1ccaa541", "sha256": "07c4af34b259433f3a6e22a970cac854669947525e3a6c18ee3be1333044a018" }, "downloads": -1, "filename": "ai_benchmark-0.1.0-py2-none-any.whl", "has_sig": false, "md5_digest": "b33f3199a26ab2b3b37811df1ccaa541", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 21545965, "upload_time": "2019-06-25T18:38:14", "url": "https://files.pythonhosted.org/packages/24/5a/bf478b0a4385273b9008d1e5367ceeb83187893668b622ba6398fba99309/ai_benchmark-0.1.0-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "a8b0cea1a5326ccfa28f7c7d08280600", "sha256": "f961ed48550a70dcf202b3507af36ef4f408cc7665312cefa9f00dd6eea2c06b" }, "downloads": -1, "filename": "ai_benchmark-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "a8b0cea1a5326ccfa28f7c7d08280600", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 21545964, "upload_time": "2019-06-25T18:38:31", "url": "https://files.pythonhosted.org/packages/49/e8/a70e4a57ee640432990a89f1aaedc562ce4ade2c48c5fc5229048489d877/ai_benchmark-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "adba73fad7389342a93f7df7b1cc8644", "sha256": "9dbf0dae23fd9d68db3c3eaaea42ca0ba12577426b17261bd1890ce466a54fbc" }, "downloads": -1, "filename": "ai-benchmark-0.1.0.tar.gz", "has_sig": false, "md5_digest": "adba73fad7389342a93f7df7b1cc8644", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 21379423, "upload_time": "2019-06-25T18:38:47", "url": "https://files.pythonhosted.org/packages/02/30/03c3a992f41f71560e20d5d1082f6a00ce06e6bd21d02e4d159d3507bca0/ai-benchmark-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "2aef672435653b481b68b21c9da8e894", "sha256": "313f02fc4d94ed3245eab19f59b40615ccaf0c8c547c4ba1a9d0aaf874c2d6fa" }, "downloads": -1, "filename": "ai_benchmark-0.1.1-py2-none-any.whl", "has_sig": false, "md5_digest": "2aef672435653b481b68b21c9da8e894", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 21546386, "upload_time": "2019-06-26T13:35:32", "url": "https://files.pythonhosted.org/packages/92/b7/ada4f327c1f04d128ad938234f13d06786a60926bd7074faaac072ee8e3c/ai_benchmark-0.1.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "59800557269be27327040e4404a2bcff", "sha256": "d96745ee6d8f09069ddc55fe5d9c9a417c3a3e47ce2d22f250278501af59e036" }, "downloads": -1, "filename": "ai_benchmark-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "59800557269be27327040e4404a2bcff", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 21546386, "upload_time": "2019-06-26T13:35:45", "url": "https://files.pythonhosted.org/packages/92/50/bef41c8271f53e048fc59e64b5550bb7b5504363bc9044934759d162b634/ai_benchmark-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "25e93a91f4e2db5a73735e6b2b80d39f", "sha256": "17c8a046d919d471ebcd8ffd7d50b617cbc5dc7f02166aebf696ad5c52a18620" }, "downloads": -1, "filename": "ai-benchmark-0.1.1.tar.gz", "has_sig": false, "md5_digest": "25e93a91f4e2db5a73735e6b2b80d39f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 21379865, "upload_time": "2019-06-26T13:35:58", "url": "https://files.pythonhosted.org/packages/b6/61/948b22c58868d9acc5335a7f137879b45ebcdc4f9cf0018b00187e0b7e8e/ai-benchmark-0.1.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "2aef672435653b481b68b21c9da8e894", "sha256": "313f02fc4d94ed3245eab19f59b40615ccaf0c8c547c4ba1a9d0aaf874c2d6fa" }, "downloads": -1, "filename": "ai_benchmark-0.1.1-py2-none-any.whl", "has_sig": false, "md5_digest": "2aef672435653b481b68b21c9da8e894", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 21546386, "upload_time": "2019-06-26T13:35:32", "url": "https://files.pythonhosted.org/packages/92/b7/ada4f327c1f04d128ad938234f13d06786a60926bd7074faaac072ee8e3c/ai_benchmark-0.1.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "59800557269be27327040e4404a2bcff", "sha256": "d96745ee6d8f09069ddc55fe5d9c9a417c3a3e47ce2d22f250278501af59e036" }, "downloads": -1, "filename": "ai_benchmark-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "59800557269be27327040e4404a2bcff", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 21546386, "upload_time": "2019-06-26T13:35:45", "url": "https://files.pythonhosted.org/packages/92/50/bef41c8271f53e048fc59e64b5550bb7b5504363bc9044934759d162b634/ai_benchmark-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "25e93a91f4e2db5a73735e6b2b80d39f", "sha256": "17c8a046d919d471ebcd8ffd7d50b617cbc5dc7f02166aebf696ad5c52a18620" }, "downloads": -1, "filename": "ai-benchmark-0.1.1.tar.gz", "has_sig": false, "md5_digest": "25e93a91f4e2db5a73735e6b2b80d39f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 21379865, "upload_time": "2019-06-26T13:35:58", "url": "https://files.pythonhosted.org/packages/b6/61/948b22c58868d9acc5335a7f137879b45ebcdc4f9cf0018b00187e0b7e8e/ai-benchmark-0.1.1.tar.gz" } ] }