{ "info": { "author": "Heiko Burau", "author_email": "h.burau@hzdr.de", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Environment :: Web Environment", "Intended Audience :: Science/Research", "License :: OSI Approved :: GNU Affero General Public License v3", "Natural Language :: English", "Operating System :: OS Independent", "Programming Language :: Python", "Topic :: Scientific/Engineering :: Information Analysis" ], "description": "pyDive\n======\n\nDistributed Interactive Visualization and Exploration of large datasets.\n\n## What is pyDive?\n\nUse pyDive to work with homogeneous, n-dimensional arrays that are too big to fit into your local machine's memory.\npyDive provides containers whose elements are distributed across a cluster or stored in\na large hdf5/adios-file if the cluster is still too small. All computation and data-access is then done in parallel by the cluster nodes in the background. \nIf you feel like working with [numpy](http://www.numpy.org) arrays pyDive has reached the goal!\n\npyDive is developed and maintained by the **[Junior Group Computational Radiation Physics](http://www.hzdr.de/db/Cms?pNid=132&pOid=30354)**\nat the [Institute for Radiation Physics](http://www.hzdr.de/db/Cms?pNid=132)\nat [HZDR](http://www.hzdr.de/).\n\n**Features:**\n - Since all cluster management is given to [IPython.parallel](http://ipython.org/ipython-doc/dev/parallel/) you can take your\n existing profiles for pyDive. No further cluster configuration needed.\n - Save bandwidth by slicing an array in parallel on disk first before loading it into main memory!\n - GPU-cluster array available thanks to [pycuda](http://mathema.tician.de/software/pycuda/) with additional support for non-contiguous memory.\n - As all of pyDive's distributed array types are auto-generated from local arrays like numpy, hdf5, pycuda, etc... \n you can easily make your own local array classes distributed too.\n\n## Dive in!\n\n```python\nimport pyDive\npyDive.init(profile='mpi')\n\nh5field = pyDive.h5.open(\"myData.h5\", \"myDataset\", distaxes=(0,1))\nones = pyDive.ones_like(h5field)\n\n# Distribute file i/o and computation across the cluster\nh5field[::10,:] = h5field[::10,:].load() + 5.0 * ones[::10,:]\n```\n\n## Documentation\n\nIn our [Online Documentation](http://ComputationalRadiationPhysics.github.io/pyDive/), [pdf](http://ComputationalRadiationPhysics.github.io/pyDive/pyDive.pdf) you can find \ndetailed information on all interfaces as well as some [Tutorials](http://computationalradiationphysics.github.io/pyDive/tutorial.html)\nand a [Quickstart](http://computationalradiationphysics.github.io/pyDive/start.html).\n\n## Software License\n\npyDive is licensed under the **GPLv3+ and LGPLv3+** (it is *dual licensed*).\nLicences can be found in [GPL](COPYING) or [LGPL](COPYING.LESSER), respectively.", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://github.com/ComputationalRadiationPhysics/pyDive", "keywords": null, "license": "GNU Affero General Public License v3", "maintainer": null, "maintainer_email": null, "name": "pyDive", "package_url": "https://pypi.org/project/pyDive/", "platform": "any", "project_url": "https://pypi.org/project/pyDive/", "project_urls": { "Download": "UNKNOWN", "Homepage": "http://github.com/ComputationalRadiationPhysics/pyDive" }, "release_url": "https://pypi.org/project/pyDive/1.2.2/", "requires_dist": null, "requires_python": null, "summary": "Distributed Interactive Visualization and Exploration of large datasets", "version": "1.2.2" }, "last_serial": 1627931, "releases": { "1.0": [ { "comment_text": "", "digests": { "md5": "46f681497213918e97776b2f18ab7ebc", "sha256": "d8bc67c8d6e06b5a5b7d065b6d9ed37409bcbcb8e1cf168d66132df601c4b7d5" }, "downloads": -1, "filename": "pyDive-1.0.tar.gz", "has_sig": false, "md5_digest": "46f681497213918e97776b2f18ab7ebc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11138, "upload_time": "2014-11-05T14:16:56", "url": "https://files.pythonhosted.org/packages/f8/ad/e589b614a5d6787a3afca02d3852a62194cbfeb13629fa5758b255137868/pyDive-1.0.tar.gz" } ], "1.0.1": [ { "comment_text": "", "digests": { "md5": "0a0a87bcc934184021c310db2d575163", "sha256": "232db0584b8e2b6d8516d9d1701d9658f658540a60de27b1b15a71b2f1051359" }, "downloads": -1, "filename": "pyDive-1.0.1.tar.gz", "has_sig": false, "md5_digest": "0a0a87bcc934184021c310db2d575163", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 23978, "upload_time": "2014-11-05T23:49:09", "url": "https://files.pythonhosted.org/packages/b9/08/28c6cf65602d0cb5da5872b0609475f1c66576d58af1fe1dd442ce9f89b7/pyDive-1.0.1.tar.gz" } ], "1.0.2": [ { "comment_text": "", "digests": { "md5": "a233f2dcbf17b794776ae0c5b1958fcc", "sha256": "d6a2d56efd6cc71be31956f779a0d2dfc25670f74f3ec269c819b4f8a00a984d" }, "downloads": -1, "filename": "pyDive-1.0.2.tar.gz", "has_sig": false, "md5_digest": "a233f2dcbf17b794776ae0c5b1958fcc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2950249, "upload_time": "2014-11-06T00:16:50", "url": "https://files.pythonhosted.org/packages/55/d7/a7975357ca7e4b7a6c0e7bf9f13a8ea4cd422083b7002130207c9d2d4b23/pyDive-1.0.2.tar.gz" } ], "1.1": [ { "comment_text": "", "digests": { "md5": "099d91b4033a60c27d70a2a111ebd0c0", "sha256": "be76c9b37c346471f53773e914fb10921a184e8d2f200378d11873a94cc63274" }, "downloads": -1, "filename": "pyDive-1.1.tar.gz", "has_sig": false, "md5_digest": "099d91b4033a60c27d70a2a111ebd0c0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2953382, "upload_time": "2015-03-29T18:59:52", "url": "https://files.pythonhosted.org/packages/35/70/2925b06ab0b29b1a274d0171d7fc3fe2ed51ef8145f7e5a0115ccd91267f/pyDive-1.1.tar.gz" } ], "1.2": [ { "comment_text": "", "digests": { "md5": "82857a877730683014f16424aed398c9", "sha256": "0057b54fc8a7e6e00a1848ffb01ccf97ffc3fc6ce8f58b2098f4cc9c757b9d27" }, "downloads": -1, "filename": "pyDive-1.2.tar.gz", "has_sig": false, "md5_digest": "82857a877730683014f16424aed398c9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3012423, "upload_time": "2015-06-22T16:08:46", "url": "https://files.pythonhosted.org/packages/82/d9/c2d68fff93a1233186cf9a59cb165da2bf6943652a9f76d12f789a9a983e/pyDive-1.2.tar.gz" } ], "1.2.1": [ { "comment_text": "", "digests": { "md5": "5cd0bcc3067a214db32427155d7f2a3f", "sha256": "a6a8f6bf128fabf117d3c32a4c078cb5469076a236a632908268e4f2d41b9c44" }, "downloads": -1, "filename": "pyDive-1.2.1.tar.gz", "has_sig": false, "md5_digest": "5cd0bcc3067a214db32427155d7f2a3f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3016759, "upload_time": "2015-07-10T15:56:14", "url": "https://files.pythonhosted.org/packages/95/0c/b8a86f1ef06fbd45c2ded76234b69032eb5cbdd98d6512555b3f7ac5f179/pyDive-1.2.1.tar.gz" } ], "1.2.2": [ { "comment_text": "", "digests": { "md5": "a5b6ad88e0ef60707655467a16542d3c", "sha256": "7a30afe2e86e2ffa3e147a86ec251256920c11ba98ba14b167f3811536ec588b" }, "downloads": -1, "filename": "pyDive-1.2.2.tar.gz", "has_sig": false, "md5_digest": "a5b6ad88e0ef60707655467a16542d3c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3016802, "upload_time": "2015-07-10T16:16:29", "url": "https://files.pythonhosted.org/packages/56/70/4706cf1e019118cae3c5a544ea88fc4cdba855de538f01feda878325c860/pyDive-1.2.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "a5b6ad88e0ef60707655467a16542d3c", "sha256": "7a30afe2e86e2ffa3e147a86ec251256920c11ba98ba14b167f3811536ec588b" }, "downloads": -1, "filename": "pyDive-1.2.2.tar.gz", "has_sig": false, "md5_digest": "a5b6ad88e0ef60707655467a16542d3c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3016802, "upload_time": "2015-07-10T16:16:29", "url": "https://files.pythonhosted.org/packages/56/70/4706cf1e019118cae3c5a544ea88fc4cdba855de538f01feda878325c860/pyDive-1.2.2.tar.gz" } ] }