{ "info": { "author": "Francis Liu", "author_email": "liux2102@umn.edu", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Operating System :: MacOS :: MacOS X", "Operating System :: POSIX", "Operating System :: Unix", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.6", "Programming Language :: Python :: 2.7", "Topic :: Scientific/Engineering", "Topic :: System :: Distributed Computing", "Topic :: Utilities" ], "description": "``Bundle``\n=========\n\n'bundle_manager' is the major module provided by 'bundle'\n\n'bundle' depends on the following third party library to run:\n paramiko (A Python SSHv2 protocal library)\n Pyro4* (Python Remote Objects, needed only when using Bundle as a remote object)\n\nUsage example:\n**************\nBefore using bundle_manager, user needs to create a configuration file.\n src/bundle/example/bundle_credentials.txt is a template configuration file\n\nThere are two ways to use bundle_manager.\nThe first way is to directly import bundle_manager as a library.\n src/bundle/example/bundle_cml.py shows an example of using bundle_manager in\n this way.\nThe second way is to launch bundle_manager as a deamon, register it with Pyro4 \nas a remote object. User program should query Pyro4 with bundle_manager's uri\nto get a reference to the remote object and call thie remote object's functions\n src/bundle/example/bundle_cmlPyro.py shows an example of using bundle_manager\n in this way.\n\nA screen copy of results on india.futuregrid.org (using aboved mentioned first way)\n**************\nfengl@exa (/home/grad03/fengl/DOEProj) % ls bundle_cml.py bundle\nbundle_cml.py*\n\nbundle:\napi/ bundle_credentials.txt db/ impl/ __init__.py __init__.pyc tools/\nfengl@exa (/home/grad03/fengl/DOEProj) % cat bundle/bundle_credentials.txt \n#bundle cluster credential file\n#each line contains credential of a cluster, used for launching a remote connection to the cluster\n#accepted credential fields include: hostname, port, username, password, key_filename\nfinished_job_trace=/home/grad03/fengl/DOEProj/bundle/db\ncluster_type=moab hostname=india.futuregrid.org username=liux2102 key_filename=/home/grad03/fengl/.ssh/id_rsa h_flag=True\n#cluster_type=moab hostname=xray.futuregrid.org username=liux2102 key_filename=/home/grad03/fengl/.ssh/id_rsa\n#cluster_type=moab hostname=hotel.futuregrid.org username=liux2102 key_filename=/home/grad03/fengl/.ssh/id_rsa\n#cluster_type=moab hostname=sierra.futuregrid.org username=liux2102 key_filename=/home/grad03/fengl/.ssh/id_rsa\n#cluster_type=moab hostname=alamo.futuregrid.org username=liux2102 key_filename=/home/grad03/fengl/.ssh/id_rsa\nfengl@exa (/home/grad03/fengl/DOEProj) % ~/virtualenv/bin/python bundle_cml.py\nEnter command: loadc bundle/bundle_credentials.txt\n2013-10-29 17:11:39,251 india.futuregrid.org india.futuregrid.org INFO __init__:112 Connected to india.futuregrid.org\nEnter command: list\n['india.futuregrid.org']\nEnter command: showc india.futuregrid.org\n{'state': 'Up', 'num_procs': 248, 'pool': {'compute': {'np': 8, 'num_procs': 168, 'num_nodes': 21}, 'b534': {'np': 8, 'num_procs': 8, 'num_nodes': 1}, 'delta': {'np': 12, 'num_procs': 72, 'num_nodes': 6}}, 'queue_info': {'bravo': {'started': 'True', 'queue_name': 'bravo', 'enabled': 'True', 'pool': 'bravo', 'max_walltime': 86400}, 'batch': {'started': 'True', 'queue_name': 'batch', 'enabled': 'True', 'pool': 'compute', 'max_walltime': 86400}, 'long': {'started': 'True', 'queue_name': 'long', 'enabled': 'True', 'pool': 'compute', 'max_walltime': 604800}, 'delta-long': {'started': 'True', 'queue_name': 'delta-long', 'enabled': 'True', 'pool': 'delta', 'max_walltime': 604800}, 'delta': {'started': 'True', 'queue_name': 'delta', 'enabled': 'True', 'pool': 'delta', 'max_walltime': 86400}, 'b534': {'started': 'True', 'queue_name': 'b534', 'enabled': 'True', 'pool': 'b534', 'max_walltime': 604800}, 'ib': {'started': 'True', 'queue_name': 'ib', 'enabled': 'True', 'pool': 'compute', 'max_walltime': 86400}, 'interactive': {'started': 'True', 'queue_name': 'interactive', 'enabled': 'True', 'pool': 'compute', 'max_walltime': 86400}}, 'num_nodes': 28}\nEnter command: showw india.futuregrid.org\n{'free_procs': 208, 'per_pool_workload': {'compute': {'free_procs': 128, 'free_nodes': 16, 'alive_nodes': 21, 'busy_nodes': 5, 'np': 8, 'busy_procs': 40, 'alive_procs': 168}, 'b534': {'free_procs': 8, 'free_nodes': 1, 'alive_nodes': 1, 'busy_nodes': 0, 'np': 8, 'busy_procs': 0, 'alive_procs': 8}, 'delta': {'free_procs': 72, 'free_nodes': 6, 'alive_nodes': 6, 'busy_nodes': 0, 'np': 12, 'busy_procs': 0, 'alive_procs': 72}}, 'free_nodes': 23, 'alive_nodes': 28, 'busy_nodes': 5, 'busy_procs': 40, 'alive_procs': 248}\nEnter command: quit\n2013-10-29 17:12:17,222 india.futuregrid.org india.futuregrid.org DEBUG close:1003 close\n2013-10-29 17:12:17,222 india.futuregrid.org india.futuregrid.org DEBUG run:607 received \"close\" command\ncmd_line_loop finish\n\nA screen copy of results on india.futuregrid.org (using aboved mentioned second way)\n**************\nfengl@exa (/home/grad03/fengl) % ~/virtualenv/bin/python -m Pyro4.naming\n/home/grad03/fengl/virtualenv/local/lib/python2.7/site-packages/Pyro4/core.py:167: UserWarning: HMAC_KEY not set, protocol data may not be secure\n warnings.warn(\"HMAC_KEY not set, protocol data may not be secure\")\nNot starting broadcast server for localhost.\nNS running on localhost:9090 (127.0.0.1)\nURI = PYRO:Pyro.NameServer@localhost:9090\n\n\n\n#Open another terminal\nfengl@exa (/home/grad03/fengl/DOEProj) % ~/virtualenv/bin/python bundle/impl/bundle_manager.py -D -c bundle/bundle_credentials.txt \ndaemon mode\n2013-10-29 16:05:12,393 india.futuregrid.org india.futuregrid.org INFO __init__:112 Connected to india.futuregrid.org\n2013-10-29 16:05:12,393 INFO:india.futuregrid.org:bundle_agent.py:112:Connected to india.futuregrid.org\n/home/grad03/fengl/virtualenv/local/lib/python2.7/site-packages/Pyro4/core.py:167: UserWarning: HMAC_KEY not set, protocol data may not be secure\n warnings.warn(\"HMAC_KEY not set, protocol data may not be secure\")\nObject <__main__.BundleManager object at 0x1c59f90>:\n uri = PYRO:obj_9262a45a566a46f39c4fad5288fbf9ae@localhost:41540\n name = BundleManager\nPyro daemon running.\n\n\n\n#Check bundle_manager has successfully registered itself as a remote object to Pyro4\nfengl@exa (/home/grad03/fengl) % ~/virtualenv/bin/python -m Pyro4.nsc list\n/home/grad03/fengl/virtualenv/local/lib/python2.7/site-packages/Pyro4/core.py:167: UserWarning: HMAC_KEY not set, protocol data may not be secure\n warnings.warn(\"HMAC_KEY not set, protocol data may not be secure\")\n--------START LIST \nBundleManager --> PYRO:obj_9262a45a566a46f39c4fad5288fbf9ae@localhost:41540\nPyro.NameServer --> PYRO:Pyro.NameServer@localhost:9090\n--------END LIST\n\n\n``AIMES``\n=========\n\nAIMES is a DOE ASCR funded collaborative project between the RADICAL\ngroup at Rutgers, University of Minnesota, and the Computation Institute\nat the University of Chicago, that will explore the role of abstractions\nand integrated middleware to support science at extreme scales. AIMES\nwill co-design middleware from an application and infrastructure\nperspective. AIMES will provide abstractions for compute, data and\nnetwork, integrated across multiple levels to provide an interoperable,\nextensible and scalable middleware stack to support extreme-scale\nscience.\n\nAIMES is funded by DOE ASCR under grant numbers: DE-FG02-12ER26115,\nDE-SC0008617, and DE-SC0008651\n\n\nChangelog for ``aimes``\n================================\n\n0.1.0 (2013-06-12)\n------------------\n\n- Created the python module for the bundle project.", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Francis-Liu/aimes.bundle", "keywords": "aimes bundle", "license": "MIT", "maintainer": null, "maintainer_email": null, "name": "aimes.bundle", "package_url": "https://pypi.org/project/aimes.bundle/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/aimes.bundle/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/Francis-Liu/aimes.bundle" }, "release_url": "https://pypi.org/project/aimes.bundle/0.1.1/", "requires_dist": null, "requires_python": null, "summary": "Bundle based Information System for AIMES", "version": "0.1.1" }, "last_serial": 1764888, "releases": { "0.0.2": [ { "comment_text": "", "digests": { "md5": "83d1d620cac01c009abff93766eb62c8", "sha256": "34a62ef58c95876f0c11ebd7ad8dfe0cf90cc8d5809c94769128b9cba7accb7b" }, "downloads": -1, "filename": "aimes.bundle-0.0.2.tar.gz", "has_sig": false, "md5_digest": "83d1d620cac01c009abff93766eb62c8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 454824, "upload_time": "2015-09-03T02:25:42", "url": "https://files.pythonhosted.org/packages/01/38/e985f21f557575130d132c444ca0cddfb49e255321b7983ee35619e24c83/aimes.bundle-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "df4b10aa98e2c6e834aa85380921b5d4", "sha256": "086a34938c8a6be4258368b05df0f18ee4144b79d1aa98a2bbf6b3bdafe552dc" }, "downloads": -1, "filename": "aimes.bundle-0.0.3.tar.gz", "has_sig": false, "md5_digest": "df4b10aa98e2c6e834aa85380921b5d4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 456527, "upload_time": "2015-09-04T15:11:40", "url": "https://files.pythonhosted.org/packages/2d/ed/8debe5a28e101f0b4b5bbf0ed9f26e39ce9d55918acef83c9c892bb06153/aimes.bundle-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "e8865a3ecfd4f5a8a2ec6a0816ae29c9", "sha256": "f16328d8929c2337a16441b6a0ff9925957d9587339637f609c980c075180067" }, "downloads": -1, "filename": "aimes.bundle-0.0.4.tar.gz", "has_sig": false, "md5_digest": "e8865a3ecfd4f5a8a2ec6a0816ae29c9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 458970, "upload_time": "2015-09-04T15:16:40", "url": "https://files.pythonhosted.org/packages/bf/2c/4d7e317ca0dc0516d7008116e5f58ddbcb4aae166ed8e399e5a5ef15cf35/aimes.bundle-0.0.4.tar.gz" } ], "0.1.0": [ { "comment_text": "", "digests": { "md5": "5a59a098c8d0c983477e914d77ba7e73", "sha256": "89d75dbd2e6cb34586964b522a98df28bcb8abad47889b133c743c41493c7cfb" }, "downloads": -1, "filename": "aimes.bundle-0.1.0.tar.gz", "has_sig": false, "md5_digest": "5a59a098c8d0c983477e914d77ba7e73", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 478367, "upload_time": "2015-09-28T18:47:10", "url": "https://files.pythonhosted.org/packages/89/cf/3a3d22282785c7082b3bb29063126c8e2017b90fcb962defb5237a40ffda/aimes.bundle-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "ad04fa65537cdba818642c0acbd9fed3", "sha256": "d3fecbea05eaa6c308bb8a4828fa75852eaf1e8a54c2aeb44b9329e5efecef48" }, "downloads": -1, "filename": "aimes.bundle-0.1.1.tar.gz", "has_sig": false, "md5_digest": "ad04fa65537cdba818642c0acbd9fed3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 499777, "upload_time": "2015-10-12T20:01:08", "url": "https://files.pythonhosted.org/packages/68/0e/5c14fffd3bf1432fc9e1d450a8df6c2ba941abfc0bd7eef28a310dfec1e2/aimes.bundle-0.1.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ad04fa65537cdba818642c0acbd9fed3", "sha256": "d3fecbea05eaa6c308bb8a4828fa75852eaf1e8a54c2aeb44b9329e5efecef48" }, "downloads": -1, "filename": "aimes.bundle-0.1.1.tar.gz", "has_sig": false, "md5_digest": "ad04fa65537cdba818642c0acbd9fed3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 499777, "upload_time": "2015-10-12T20:01:08", "url": "https://files.pythonhosted.org/packages/68/0e/5c14fffd3bf1432fc9e1d450a8df6c2ba941abfc0bd7eef28a310dfec1e2/aimes.bundle-0.1.1.tar.gz" } ] }