{ "info": { "author": "Soo Lee", "author_email": "duplexa@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Topic :: Scientific/Engineering :: Bio-Informatics", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "The repo contains a benchmarking script for some of the CWL workflows used by 4DN-DCIC (https://github.com/4dn-dcic/pipelines-cwl), that returns total space, mem and CPUs required per given input size and a recommended AWS EC2 instance type.\n\n[![Build Status](https://travis-ci.org/SooLee/Benchmark.svg?branch=master)](https://travis-ci.org/SooLee/Benchmark)\n\n### Example usage of benchmarking script\n* importing the module\n```python\nfrom Benchmark import run as B\n```\n\n* md5\n```python\napp_name = 'md5'\ninput_json = {'input_size_in_bytes': {'input_file': 20000}}\nB.benchmark(app_name, input_json)\n```\n```\n{'aws': {'recommended_instance_type': 't2.xlarge', 'EBS_optimized': False, 'cost_in_usd': 0.188, 'EBS_optimization_surcharge': None, 'mem_in_gb': 16.0, 'cpu': 4}, 'total_size_in_GB': 14.855186462402344, 'total_mem_in_MB': 13142.84375, 'min_CPU': 4}\n```\n\n* fastqc-0-11-4-1\n```python\napp_name = 'fastqc-0-11-4-1'\ninput_json = {'input_size_in_bytes': {'input_fastq':20000},\n 'parameters': {'threads': 2}}\nB.benchmark(app_name, input_json)\n```\n```\n{'recommended_instance_type': 't2.nano', 'EBS_optimized': False, 'cost_in_usd': 0.006, 'EBS_optimization_surcharge': None, 'mem_in_gb': 0.5, 'cpu': 1}\n```\n\n* bwa-mem\n```python\napp_name = 'bwa-mem'\ninput_json = {'input_size_in_bytes': {'fastq1':93520000,\n 'fastq2':97604000,\n 'bwa_index':3364568000},\n 'parameters': {'nThreads': 4}}\nB.benchmark(app_name, input_json)\n```\n```\n{'aws': {'cost_in_usd': 0.188, 'EBS_optimization_surcharge': None, 'EBS_optimized': False, 'cpu': 4, 'mem_in_gb': 16.0, 'recommended_instance_type': 't2.xlarge'}, 'total_mem_in_MB': 12834.808349609375, 'total_size_in_GB': 15.502477258443832, 'min_CPU': 4}\n```\n\nTo use Benchmark in from other places, install it as below.\n```\npip install Benchmark-4dn\n```\nor\n```\npip install git+git://github.com/SooLee/Benchmark.git\n```\n\n\n---\n\nNote: From `0.5.3` we have a new function that takes in cpu and memory and returns a sorted list of instance dictionaries.\n```\nget_instance_types(cpu=1, mem_in_gb=0.5, instances=instance_list(), top=10, rank='cost_in_usd')\n```\n\nKeys in each instance dictionary:\n```\n'cost_in_usd', 'mem_in_gb', 'cpu', 'instance_type', 'EBS_optimized', 'EBS_optimization_surcharge'\n```\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/SooLee/Benchmark/", "keywords": "benchmark,cwl,common workflow language,docker,tibanna,bioinformatics,4dn", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "Benchmark-4dn", "package_url": "https://pypi.org/project/Benchmark-4dn/", "platform": "", "project_url": "https://pypi.org/project/Benchmark-4dn/", "project_urls": { "Homepage": "https://github.com/SooLee/Benchmark/" }, "release_url": "https://pypi.org/project/Benchmark-4dn/0.5.7/", "requires_dist": null, "requires_python": "", "summary": "Benchmark functions that returns total space, mem, cpu given input size and parameters for the CWL workflows", "version": "0.5.7" }, "last_serial": 5977899, "releases": { "0.5.2": [ { "comment_text": "", "digests": { "md5": "aee0f188ad311ec6e8cd5dd0cbdd26d5", "sha256": "3fcd3f33e81a82f375e7a5572bd8004a24b5ea2aa86f59e0a43d90ec288b130e" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.2-py3-none-any.whl", "has_sig": false, "md5_digest": "aee0f188ad311ec6e8cd5dd0cbdd26d5", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 25188, "upload_time": "2019-05-15T14:10:53", "url": "https://files.pythonhosted.org/packages/42/5a/373cbbe8b260fda39e3d16cbdbda0246aa990019939416edb1414360e1a1/Benchmark_4dn-0.5.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "6c3825cc4f6fba49992531e35dd7f1ef", "sha256": "cf40621a40dd9dd5b0e66f24daec8646a686ed94ddc5d445da3be76fef246e0f" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.2.tar.gz", "has_sig": false, "md5_digest": "6c3825cc4f6fba49992531e35dd7f1ef", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 22453, "upload_time": "2019-05-15T14:10:55", "url": "https://files.pythonhosted.org/packages/2c/9d/03dbe200b18e9c62edbe1e062f09902818c85b2de27ce336a271b769d2df/Benchmark-4dn-0.5.2.tar.gz" } ], "0.5.3": [ { "comment_text": "", "digests": { "md5": "27dba1b4226a8c758c49fcb8eee6bd4f", "sha256": "3650f0b72ba028505a1ba85b4079c02e32ea7b1f3ee799a522261ae87917cbac" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.3-py3-none-any.whl", "has_sig": false, "md5_digest": "27dba1b4226a8c758c49fcb8eee6bd4f", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26144, "upload_time": "2019-06-07T15:12:22", "url": "https://files.pythonhosted.org/packages/45/8c/290a2cb6bc1b9ddac622be57df8c678a6eff58c1eaa634c1315eff25be4e/Benchmark_4dn-0.5.3-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "ebbaeefde921e97bb1d30aeec3fd273d", "sha256": "0f6e085ef2d366ad7159f73b4e722ef19bdb1b0690b3ecc23cbbf7a8e1d96b43" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.3.tar.gz", "has_sig": false, "md5_digest": "ebbaeefde921e97bb1d30aeec3fd273d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23445, "upload_time": "2019-06-07T15:12:24", "url": "https://files.pythonhosted.org/packages/7e/47/3830ddd6793b71c3e429e9068c67f65615528f2214fd27703f874f082352/Benchmark-4dn-0.5.3.tar.gz" } ], "0.5.4": [ { "comment_text": "", "digests": { "md5": "f41514565e9832590efb2952ec424053", "sha256": "6bdb7bb6ce725a18c3adac02269e3b8cb42a143caf9398065e0b1790ae6ee574" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.4-py3-none-any.whl", "has_sig": false, "md5_digest": "f41514565e9832590efb2952ec424053", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26191, "upload_time": "2019-06-25T18:55:38", "url": "https://files.pythonhosted.org/packages/0f/87/ecea11991daa5f0da0bc4a09042f90240ddf27d419ad4267757841324341/Benchmark_4dn-0.5.4-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "dd9c722fe1d5af20be2ec2b8f7ffceae", "sha256": "fb7d3f1bd9fe7178bc1821908834438cc74117539d7a5b96381131b5827369ad" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.4.tar.gz", "has_sig": false, "md5_digest": "dd9c722fe1d5af20be2ec2b8f7ffceae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23492, "upload_time": "2019-06-25T18:55:40", "url": "https://files.pythonhosted.org/packages/c7/66/72174becd0a3cec1712f29c614539e902843b63829ac1e0b58d1c60a1c3c/Benchmark-4dn-0.5.4.tar.gz" } ], "0.5.5": [ { "comment_text": "", "digests": { "md5": "210c18e185607a87b56650966d0f12e3", "sha256": "b37b5eee7816bd39636e60bd333b7dea8fdfef3f8991604faeb32e71eae1a2ee" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.5-py2-none-any.whl", "has_sig": false, "md5_digest": "210c18e185607a87b56650966d0f12e3", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 25444, "upload_time": "2019-08-29T18:44:00", "url": "https://files.pythonhosted.org/packages/9f/02/ab7d23d6aca1e6ac9b7941247171c24d5404b0c0e0d03ec4747eba4d41f1/Benchmark_4dn-0.5.5-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "b9994f1aa455cb1db659c4fc81652422", "sha256": "704defeacb61ed9a4dc63b38f36c58b08a1dd6eae47e08ace631cfecd4925d2b" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.5-py3-none-any.whl", "has_sig": false, "md5_digest": "b9994f1aa455cb1db659c4fc81652422", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26282, "upload_time": "2019-09-26T19:21:54", "url": "https://files.pythonhosted.org/packages/43/76/395e7b6cba7eb24e64beef61a905dce49c4d65eda3f6574a5338479a95ec/Benchmark_4dn-0.5.5-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "fef4fd9fb967acfe433a53464fe0f4d1", "sha256": "c214e066b19661b7158c4abdceb19d0f1d89f271e63c8281313ac7906c840c27" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.5.tar.gz", "has_sig": false, "md5_digest": "fef4fd9fb967acfe433a53464fe0f4d1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23574, "upload_time": "2019-08-29T18:44:02", "url": "https://files.pythonhosted.org/packages/a5/bf/6ec4796a383929965e4a51088b7f3e2cdbec1e15d094803f5a67a1e91f11/Benchmark-4dn-0.5.5.tar.gz" } ], "0.5.6": [ { "comment_text": "", "digests": { "md5": "1e2894c013fbfc215d0444d5f6003393", "sha256": "e2f6565bae4579bd66616fca72597cff4d1bedc1ce42c9a22fa2df5c160d6851" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.6-py3.6.egg", "has_sig": false, "md5_digest": "1e2894c013fbfc215d0444d5f6003393", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 24939, "upload_time": "2019-09-26T19:35:26", "url": "https://files.pythonhosted.org/packages/83/56/052caedf1afbdd2bbd0a45102fa91b174db8bf6afdee7523444c7381aeb8/Benchmark_4dn-0.5.6-py3.6.egg" }, { "comment_text": "", "digests": { "md5": "dd5568fc38e466412dae99d853eb4c77", "sha256": "5bda21d733385281d058c1223c082da3788bb43b1b991ce933247c67bdb93dcb" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.6-py3-none-any.whl", "has_sig": false, "md5_digest": "dd5568fc38e466412dae99d853eb4c77", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26281, "upload_time": "2019-09-26T19:35:23", "url": "https://files.pythonhosted.org/packages/6a/ae/0565533e732dd4e91549cd891b7ee033614700e47d33905683d7e01e07f2/Benchmark_4dn-0.5.6-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1bf3b4bccff8287580fc607e2c0121c6", "sha256": "f44a5d8274710828045955dae92e7ee093174ed88cdc695840f4a250ab9003a3" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.6.tar.gz", "has_sig": false, "md5_digest": "1bf3b4bccff8287580fc607e2c0121c6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23577, "upload_time": "2019-09-26T19:35:25", "url": "https://files.pythonhosted.org/packages/f4/8c/20c852c394b2f6d3a2a0505fb600a1724ca4d7ced00c9edd0fde5a370e0c/Benchmark-4dn-0.5.6.tar.gz" } ], "0.5.6b1": [ { "comment_text": "", "digests": { "md5": "14ec212783637b17e99d5c8241047604", "sha256": "6f253e2e6ffc97082e26531f8aa26fb4875a5f448cd893ce38c195e2f2c85833" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.6b1-py3.6.egg", "has_sig": false, "md5_digest": "14ec212783637b17e99d5c8241047604", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 24947, "upload_time": "2019-09-26T19:22:59", "url": "https://files.pythonhosted.org/packages/3a/a4/1f9fe037ff91a15d73674ee117276326e86aa58f9f0c4fa9a90a3611be3a/Benchmark_4dn-0.5.6b1-py3.6.egg" }, { "comment_text": "", "digests": { "md5": "a31aa52eff9ca082b08c3c2177df5053", "sha256": "8af9c2ebb80f8cf61e2ee6c5849282af3c1e5878538eed3aa1b653d74c627170" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.6b1-py3-none-any.whl", "has_sig": false, "md5_digest": "a31aa52eff9ca082b08c3c2177df5053", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26306, "upload_time": "2019-09-26T19:22:56", "url": "https://files.pythonhosted.org/packages/d7/e0/f07455ee77f6e2d294efdc66d535ca8c862999309004461a733c408527de/Benchmark_4dn-0.5.6b1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "e96f75b29a87237b28898559ba0cc599", "sha256": "b4bb82c37fdad4c55ec0bc780ac8f0ca2d16f1b6e5d03dae2a880259c7916a02" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.6b1.tar.gz", "has_sig": false, "md5_digest": "e96f75b29a87237b28898559ba0cc599", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23590, "upload_time": "2019-09-26T19:22:57", "url": "https://files.pythonhosted.org/packages/19/29/ddd83d22440916c9c6d3b3c0db825c572491301996ea3264a7a0ac35d8a1/Benchmark-4dn-0.5.6b1.tar.gz" } ], "0.5.7": [ { "comment_text": "", "digests": { "md5": "f1e870a40381fadeaa392bedaa293f7f", "sha256": "1ee06fbcada5c984ade9a9ea3e75a54ce4b822921150b4f587e4c573f11437fa" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.7-py3.6.egg", "has_sig": false, "md5_digest": "f1e870a40381fadeaa392bedaa293f7f", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 24940, "upload_time": "2019-10-15T15:03:30", "url": "https://files.pythonhosted.org/packages/1d/99/5490c7680315de6c6ecfa659729c251ab22c8f8c9a9e5ea37a5963320fde/Benchmark_4dn-0.5.7-py3.6.egg" }, { "comment_text": "", "digests": { "md5": "f36d9239c37a7667a060c013ab2804ec", "sha256": "28110e1b5d202582be1e04af32ef6164b6c3424a49a4a32ef06b9cab45f9947e" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.7-py3-none-any.whl", "has_sig": false, "md5_digest": "f36d9239c37a7667a060c013ab2804ec", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26283, "upload_time": "2019-10-15T15:03:27", "url": "https://files.pythonhosted.org/packages/8b/04/3fc7e680a66a577964e2f9fcf08b25704414f03dbdd370d63c8576c0a1bf/Benchmark_4dn-0.5.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "a5c00519a223327c922e7003c96347c6", "sha256": "43014d8a27ba67e0eee20835f326785e166d120ca8280f9626715a86220a97f8" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.7.tar.gz", "has_sig": false, "md5_digest": "a5c00519a223327c922e7003c96347c6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23556, "upload_time": "2019-10-15T15:03:29", "url": "https://files.pythonhosted.org/packages/11/99/147cdf3058a4a08e18295df9dab652ce8fdd0d49fdd77f8abac242e756dc/Benchmark-4dn-0.5.7.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f1e870a40381fadeaa392bedaa293f7f", "sha256": "1ee06fbcada5c984ade9a9ea3e75a54ce4b822921150b4f587e4c573f11437fa" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.7-py3.6.egg", "has_sig": false, "md5_digest": "f1e870a40381fadeaa392bedaa293f7f", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 24940, "upload_time": "2019-10-15T15:03:30", "url": "https://files.pythonhosted.org/packages/1d/99/5490c7680315de6c6ecfa659729c251ab22c8f8c9a9e5ea37a5963320fde/Benchmark_4dn-0.5.7-py3.6.egg" }, { "comment_text": "", "digests": { "md5": "f36d9239c37a7667a060c013ab2804ec", "sha256": "28110e1b5d202582be1e04af32ef6164b6c3424a49a4a32ef06b9cab45f9947e" }, "downloads": -1, "filename": "Benchmark_4dn-0.5.7-py3-none-any.whl", "has_sig": false, "md5_digest": "f36d9239c37a7667a060c013ab2804ec", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26283, "upload_time": "2019-10-15T15:03:27", "url": "https://files.pythonhosted.org/packages/8b/04/3fc7e680a66a577964e2f9fcf08b25704414f03dbdd370d63c8576c0a1bf/Benchmark_4dn-0.5.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "a5c00519a223327c922e7003c96347c6", "sha256": "43014d8a27ba67e0eee20835f326785e166d120ca8280f9626715a86220a97f8" }, "downloads": -1, "filename": "Benchmark-4dn-0.5.7.tar.gz", "has_sig": false, "md5_digest": "a5c00519a223327c922e7003c96347c6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23556, "upload_time": "2019-10-15T15:03:29", "url": "https://files.pythonhosted.org/packages/11/99/147cdf3058a4a08e18295df9dab652ce8fdd0d49fdd77f8abac242e756dc/Benchmark-4dn-0.5.7.tar.gz" } ] }