{
    "info": {
        "author": "['stijn.deweirdt@ugent.be', 'jens.timmerman@ugent.be', 'ewan.higgs@ugent.be']",
        "author_email": "",
        "bugtrack_url": null,
        "classifiers": [
            "Programming Language :: Python :: 2"
        ],
        "description": "hanythingondemand (HOD for short)\n=================================\n\nDocumentation is available at `Read the\nDocs <http://hod.readthedocs.org>`__\n\n|Build Status|\n\nGoal\n----\n\nHOD is a set of scripts to start services, for example a Hadoop cluster,\nfrom within another resource management system (i.e. Torque/PBS). As\nsuch, it allows traditional users of HPC systems to experiment with\nHadoop or use it as a production setup if there is no dedicated setup\navailable.\n\nHadoop is not the only software supported. HOD can also create HBase\ndatabases, IPython notebooks, and set up a Spark environment.\n\nBenefits\n--------\n\nThere are two main benefits:\n\n1. Users can run jobs on a traditional batch cluster. This is good for\n   small to medium Hadoop jobs where the framework is used but having a\n   'big data' cluster isn't required. At this point the performance\n   benefits of a parallel file system outweigh the 'share nothing'\n   architecture of a HDFS style file system.\n\n2. Users from different groups can run whichever version of Hadoop they\n   like. This removes the need for painful upgrades to running Yarn\n   clusters and hoping all users' jobs are backwards compatible.\n\nHistory\n-------\n\nHadoop used to ship it's own HOD (Hadoop On Demand) but it was not\nmaintained and only supported Hadoop without tuning. The HOD code that\nwas shipped with Hadoop 1.0.0 release was buggy to say the least. An\nattempt was made to make it work on the UGent HPC infrastructure, and\nalthough a working Hadoop cluster was realised, it was a nightmare to\nextend it's functionality. At that point (April 2012), hanythingondemand\nwas started to be better maintainable and support more tuning and\nfunctionality out of the box. For example, HBase was a minimum\nrequirement. Hence, why Hadoop on Demand became 'Hanything'. Apart from\nthe acronym 'HOD' nothing of Hadoop On Demand was reused.\n\nMore on the history of Hadoop On Demand can be found in section 2 of\n`this paper on Yarn\n(PDF) <http://www.cs.cmu.edu/~garth/15719/papers/yarn.pdf>`__\n\nHow does it work?\n-----------------\n\nhanythingondemand works by launching an MPI job which uses the reserved\nnodes as a cluster-in-a-cluster. These nodes then have the various\nHadoop services started on them. Users can launch a job at startup\n(batch mode) or login to worker nodes (using the ``hod connect``\ncommand) where they can interact with their services.\n\nPrerequisites\n-------------\n\n-  A cluster using\n   `Torque <http://www.adaptivecomputing.com/products/open-source/torque/>`__.\n-  `environment-modules <http://modules.sourceforge.net/>`__ to manage\n   the environment\n\nThe rest of the requirements can be installed using\n`EasyBuild <https://github.com/hpcugent/easybuild>`__:\n\n-  Python and various libraries.\n-  `mpi4py <http://mpi4py.scipy.org/>`__\n-  eg. on fedora ``yum install -y mpi4py-mpich2``\n-  If you build this yourself, you will probably need to set the $MPICC\n   environment variable.\n-  `vsc-base <https://github.com/hpcugent/vsc-base>`__ - Used for\n   command line parsing.\n-  `vsc-mympirun <https://github.com/hpcugent/vsc-mympirun>`__ -\n   Used for setting up the MPI job.\n-  `pbs_python <https://oss.trac.surfsara.nl/pbs_python>`__ - Used\n   for interacting with the PBS (aka Torque) server.\n-  `netifaces <https://pypi.python.org/pypi/netifaces>`__\n-  `netaddr <https://pypi.python.org/pypi/netaddr/>`__\n-  Java\n-  Oracle JDK or OpenJDK - both installable with Easybuild\n-  Hadoop binaries\n-  eg. the `Cloudera distribution\n   versions <http://archive.cloudera.com/cdh4/cdh/4/>`__ (used to test\n   HOD)\n\nExample use cases:\n------------------\n\nCreating an HOD cluster:\n~~~~~~~~~~~~~~~~~~~~~~~~\n\n.. code:: shell\n\n    # submits a job to start a Hadoop cluster on 16 nodes\n    $ hod create --dist Hadoop-2.3.0-cdh5.0 -n16 --label my-cluster\n\n    ### Connect to your new cluster.\n    $ hod connect my-cluster\n\n    ### Then, in your session, you can run your hadoop jobs:\n    $ hadoop jar somejob.jar SomeClass arg1 arg2\n\n\u2018Set it and forget it\u2019 batch jobs:\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\n.. code:: shell\n\n    # Run a batch job on 1 node:\n    $ hod batch --dist Hadoop-2.3.0-cdh5.0 --label my-cluster --script=my-script.sh\n\n.. |Build Status| image:: https://travis-ci.org/hpcugent/hanythingondemand.svg?branch=master\n   :target: https://travis-ci.org/hpcugent/hanythingondemand\n",
        "description_content_type": "",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "",
        "keywords": "",
        "license": "GPL v2",
        "maintainer": "",
        "maintainer_email": "",
        "name": "hanythingondemand",
        "package_url": "https://pypi.org/project/hanythingondemand/",
        "platform": "",
        "project_url": "https://pypi.org/project/hanythingondemand/",
        "project_urls": null,
        "release_url": "https://pypi.org/project/hanythingondemand/3.2.3/",
        "requires_dist": null,
        "requires_python": "",
        "summary": "",
        "version": "3.2.3"
    },
    "last_serial": 4735689,
    "releases": {
        "3.0.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "450e45826097cce2b704efb97860d264",
                    "sha256": "a803f37ea3cc390b217cb05f0c9484b38f38369e3eb521f43f87df04f762157e"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.0.0.tar.gz",
                "has_sig": false,
                "md5_digest": "450e45826097cce2b704efb97860d264",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 48628,
                "upload_time": "2015-10-22T13:44:25",
                "url": "https://files.pythonhosted.org/packages/a0/3e/d362def8fd7da5d7bef87c3a49cf3db98e4f2e2365048fe25966e682092e/hanythingondemand-3.0.0.tar.gz"
            }
        ],
        "3.0.0dev": [],
        "3.0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "4e2cc2e635bd08d75a3e1fd28c2b096c",
                    "sha256": "83dbb3566a8692892e0063f522cadaf5540d9cc3ae04b0e6d9e101eb3095a495"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "4e2cc2e635bd08d75a3e1fd28c2b096c",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 48786,
                "upload_time": "2015-11-01T22:02:49",
                "url": "https://files.pythonhosted.org/packages/06/38/412365d9bf28b89c73c7d8eecdcea601ede01f58a75346a4fce47f1fd745/hanythingondemand-3.0.1.tar.gz"
            }
        ],
        "3.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "026eed03ab123b717c9ef2823ec1af41",
                    "sha256": "39f90ed46d7d15a491ee1d2c64f6876260488cecca9a685a423c1ca70596df3e"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "026eed03ab123b717c9ef2823ec1af41",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 60531,
                "upload_time": "2015-11-19T20:42:11",
                "url": "https://files.pythonhosted.org/packages/1a/b1/20c303da33245332a13b9497029bd04b5ce875f21b7e03db0fb286652c2c/hanythingondemand-3.0.2.tar.gz"
            }
        ],
        "3.0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a106b4780cee0d5f7fef4922faa33456",
                    "sha256": "706eb836c43e425f34610b51081482c6fbc07fbffbb2261e4642c877d4af37fd"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "a106b4780cee0d5f7fef4922faa33456",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 49629,
                "upload_time": "2015-12-09T08:58:40",
                "url": "https://files.pythonhosted.org/packages/a3/79/75256c457bb922769dff8bc1c75d0c4f2b53fa319655f26f3253ca671cde/hanythingondemand-3.0.3.tar.gz"
            }
        ],
        "3.0.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "3f449c13033cf56bec58bd0573419704",
                    "sha256": "279339d07c4f61df092de2eef448980ebce5b0d4dadd4641f9cd10218aba55e5"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.0.4.tar.gz",
                "has_sig": false,
                "md5_digest": "3f449c13033cf56bec58bd0573419704",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 49897,
                "upload_time": "2016-01-20T21:09:31",
                "url": "https://files.pythonhosted.org/packages/41/a5/71da604f8dc82d1705a20e29a85fbe9c0acefd36ecb6de5bde76e1d10ab9/hanythingondemand-3.0.4.tar.gz"
            }
        ],
        "3.1.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "eff80198337e58fe0e93d2cefc2fc6a8",
                    "sha256": "4eff1be0bcec4050dbac5a841fc79f0b01abeb93b62390116028ce4aa9f07fc9"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.1.0.tar.gz",
                "has_sig": false,
                "md5_digest": "eff80198337e58fe0e93d2cefc2fc6a8",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 49869,
                "upload_time": "2016-05-26T13:09:00",
                "url": "https://files.pythonhosted.org/packages/1f/99/8c2d7dc62344fadf2809fd58ff4c1671a34a3484bfacc8208a0860132478/hanythingondemand-3.1.0.tar.gz"
            }
        ],
        "3.1.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "ebf2fdbc4f3c6911374d7d26ba58d4cb",
                    "sha256": "67189c8f8b940388135d45ee56caed675ad7138dcf103082499b7595e9e42be3"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.1.1.tar.gz",
                "has_sig": false,
                "md5_digest": "ebf2fdbc4f3c6911374d7d26ba58d4cb",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 49897,
                "upload_time": "2016-08-11T16:29:24",
                "url": "https://files.pythonhosted.org/packages/b8/9b/6f8417600221561877a6889b81127084429661d06bb867015689ac385da3/hanythingondemand-3.1.1.tar.gz"
            }
        ],
        "3.1.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "4580da9ffba191cfd0ceca352ef59e35",
                    "sha256": "70d87375bf3dd41a4ec47793fa6c02f84cf7863acc90896747da0255f1a85d4e"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.1.2.tar.gz",
                "has_sig": false,
                "md5_digest": "4580da9ffba191cfd0ceca352ef59e35",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 50090,
                "upload_time": "2016-08-16T07:33:11",
                "url": "https://files.pythonhosted.org/packages/ae/fc/06a601ee57e425c0cb1444e03d24739e11d6fba4b503f541bc7b0bfd40ee/hanythingondemand-3.1.2.tar.gz"
            }
        ],
        "3.1.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e4832344f6efca93bcc8ec13a885dd7f",
                    "sha256": "a0b9ac4fff8de85c4b38bc49bdec3f6217ad19253a5a7f06f4e9f6f281e56ee3"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.1.3.tar.gz",
                "has_sig": false,
                "md5_digest": "e4832344f6efca93bcc8ec13a885dd7f",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 50373,
                "upload_time": "2016-08-18T09:35:55",
                "url": "https://files.pythonhosted.org/packages/36/89/ebfebe59c0f01662a938fe151b3ac7fbb8b938bfdb4431601a4cd6a21cb7/hanythingondemand-3.1.3.tar.gz"
            }
        ],
        "3.1.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "538cc85086744e6b0b5350efc51ec8e2",
                    "sha256": "2b7f5ccc6b37226adbd328901988ccd26624e25011b67e4a5dd8ed478be574cc"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.1.4.tar.gz",
                "has_sig": false,
                "md5_digest": "538cc85086744e6b0b5350efc51ec8e2",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 50416,
                "upload_time": "2016-09-09T19:59:34",
                "url": "https://files.pythonhosted.org/packages/19/5b/042f9db9332d1f75ce7b27e08200ee821703b0c1bc951bc49b8f1c566917/hanythingondemand-3.1.4.tar.gz"
            }
        ],
        "3.2.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "cbdf8428bdef0557b0262503e5a87fd5",
                    "sha256": "f99f7f1ed3aa9876e75c0c656721475fc6b5d88231c2d557fb44dd2c1546143a"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.2.0.tar.gz",
                "has_sig": false,
                "md5_digest": "cbdf8428bdef0557b0262503e5a87fd5",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 51460,
                "upload_time": "2016-10-21T08:38:55",
                "url": "https://files.pythonhosted.org/packages/51/09/ec48151ad6adb77d6f6a14b87faff261582f43bb65102f3b6f84c051143f/hanythingondemand-3.2.0.tar.gz"
            }
        ],
        "3.2.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "76c13b92e6a71c83835dd338d0854d2a",
                    "sha256": "6589d2606c3c8375a530f0d19af50e0e7a6bb09a0414a5a8a6aec9ae4d9c5ae3"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.2.2.tar.gz",
                "has_sig": false,
                "md5_digest": "76c13b92e6a71c83835dd338d0854d2a",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 51716,
                "upload_time": "2017-05-08T07:31:53",
                "url": "https://files.pythonhosted.org/packages/85/c0/b4224b1c35fb0a33e63b8e86ac52584bdda6d8cc284ddd52b4203bf3a83e/hanythingondemand-3.2.2.tar.gz"
            }
        ],
        "3.2.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "95fde884e1e0acd95961d01bd4e0327b",
                    "sha256": "e8bb176df45546e47e6abdfcb9cfd16f73369362368286cfe69d270710323c58"
                },
                "downloads": -1,
                "filename": "hanythingondemand-3.2.3.tar.gz",
                "has_sig": false,
                "md5_digest": "95fde884e1e0acd95961d01bd4e0327b",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 50535,
                "upload_time": "2019-01-24T13:19:39",
                "url": "https://files.pythonhosted.org/packages/d1/55/a23e364457529eb09e27f1761123b8ec7fa4bfe1a21ae7f35ba607db26fc/hanythingondemand-3.2.3.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "95fde884e1e0acd95961d01bd4e0327b",
                "sha256": "e8bb176df45546e47e6abdfcb9cfd16f73369362368286cfe69d270710323c58"
            },
            "downloads": -1,
            "filename": "hanythingondemand-3.2.3.tar.gz",
            "has_sig": false,
            "md5_digest": "95fde884e1e0acd95961d01bd4e0327b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 50535,
            "upload_time": "2019-01-24T13:19:39",
            "url": "https://files.pythonhosted.org/packages/d1/55/a23e364457529eb09e27f1761123b8ec7fa4bfe1a21ae7f35ba607db26fc/hanythingondemand-3.2.3.tar.gz"
        }
    ]
}