{ "info": { "author": "", "author_email": "", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Science/Research", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Topic :: Scientific/Engineering" ], "description": ".. image:: https://img.shields.io/circleci/project/github/NCAR/intake-esm/master.svg?style=for-the-badge&logo=circleci\n :target: https://circleci.com/gh/NCAR/intake-esm/tree/master\n\n.. image:: https://img.shields.io/codecov/c/github/NCAR/intake-esm.svg?style=for-the-badge\n :target: https://codecov.io/gh/NCAR/intake-esm\n\n\n.. image:: https://img.shields.io/readthedocs/intake-esm/latest.svg?style=for-the-badge\n :target: https://intake-esm.readthedocs.io/en/latest/?badge=latest\n :alt: Documentation Status\n\n.. image:: https://img.shields.io/pypi/v/intake-esm.svg?style=for-the-badge\n :target: https://pypi.org/project/intake-esm\n :alt: Python Package Index\n\n.. image:: https://img.shields.io/conda/vn/conda-forge/intake-esm.svg?style=for-the-badge\n :target: https://anaconda.org/conda-forge/intake-esm\n :alt: Conda Version\n\n\n===========\nIntake-esm\n===========\n\nMotivation\n----------\n\nProject efforts such as the `Coupled Model Intercomparison Project (CMIP)`_\nand the `Community Earth System Model (CESM) Large Ensemble Project`_\nproduce a huge of amount climate data persisted on tape, disk storage, object storage\ncomponents across multiple (in the order of ~ 300,000) data assets.\nThese data assets are stored in netCDF and more recently `Zarr`_ formats.\nFinding, investigating, loading these assets into data array containers\nsuch as xarray can be a daunting task due to the large number of files\na user may be interested in. Intake-esm aims to address these issues by\nproviding necessary functionality for searching, discovering, data access/loading.\n\n\nOverview\n--------\n\n`intake-esm` is a data cataloging utility built on top of `intake`_, `pandas`_, and\n`xarray`_, and it's pretty awesome!\n\n- Opening an ESM collection definition file: An ESM (Earth System Model) collection file is a JSON file that conforms\n to the `ESM Collection Specification`_. When provided a link/path to an esm collection file, ``intake-esm`` establishes\n a link to a database (CSV file) that contains data assets locations and associated metadata\n (i.e., which experiement, model, the come from). The collection JSON file can be stored on a local filesystem\n or can be hosted on a remote server.\n\n .. code-block:: python\n\n >>> import intake\n >>> col_url = \"https://raw.githubusercontent.com/NCAR/intake-esm-datastore/master/catalogs/pangeo-cmip6.json\"\n >>> col = intake.open_esm_datastore(col_url)\n\n- Search and Discovery: ``intake-esm`` provides functionality to execute queries against the database:\n\n .. code-block:: python\n\n >>> cat = col.search(experiment_id=['historical', 'ssp585'], table_id='Oyr',\n ... variable_id='o2', grid_label='gn')\n\n- Access: when the user is satisfied with the results of their query, they can ask ``intake-esm``\n to load data assets (netCDF/HDF files and/or Zarr stores) into xarray datasets:\n\n .. code-block:: python\n\n >>> dset_dict = cat.to_dataset_dict(zarr_kwargs={'consolidated': True, 'decode_times': False},\n ... cdf_kwargs={'chunks': {}, 'decode_times': False})\n\n\n.. _CMIP: https://www.wcrp-climate.org/wgcm-cmip\n.. _CESM: http://www.cesm.ucar.edu/projects/community-projects/LENS/\n.. _ERA5: https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era5\n.. _GMET: https://ncar.github.io/hydrology/models/GMET\n.. _MPI-GE: https://www.mpimet.mpg.de/en/grand-ensemble/\n.. _NA-CORDEX: https://na-cordex.org/\n.. _CESM-LENS-AWS: http://ncar-aws-www.s3-website-us-west-2.amazonaws.com/\n.. _intake: https://github.com/intake/intake\n.. _Datasets Collection Curation: https://github.com/NCAR/intake-esm-datastore\n.. _Coupled Model Intercomparison Project (CMIP): https://www.wcrp-climate.org/wgcm-cmip\n.. _Community Earth System Model (CESM) Large Ensemble Project: http://www.cesm.ucar.edu/projects/community-projects/LENS/\n.. _Zarr: https://zarr.readthedocs.io/en/stable/\n.. _pandas: https://pandas.pydata.org/\n.. _xarray: https://xarray.pydata.org/en/stable/\n.. _ESM Collection Specification: https://github.com/NCAR/esm-collection-spec\n\n\nSee documentation_ for more information.\n\n.. _documentation: https://intake-esm.readthedocs.io/en/latest/\n\n\nInstallation\n------------\n\nIntake-esm can be installed from PyPI with pip:\n\n.. code-block:: bash\n\n pip install intake-esm\n\n\nIt is also available from `conda-forge` for conda installations:\n\n.. code-block:: bash\n\n conda install -c conda-forge intake-esm\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/NCAR/intake-esm", "keywords": "intake-esm", "license": "Apache 2.0", "maintainer": "Anderson Banihirwe", "maintainer_email": "abanihi@ucar.edu", "name": "intake-esm", "package_url": "https://pypi.org/project/intake-esm/", "platform": "", "project_url": "https://pypi.org/project/intake-esm/", "project_urls": { "Homepage": "https://github.com/NCAR/intake-esm" }, "release_url": "https://pypi.org/project/intake-esm/2019.10.15/", "requires_dist": [ "intake-xarray (>=0.3.1)", "xarray (>=0.13.0)", "pyyaml", "tqdm", "fsspec", "s3fs", "gcsfs" ], "requires_python": ">=3.6", "summary": "An intake plugin for building and loading earth system data sets such as CMIP, CESM Large Ensemble", "version": "2019.10.15" }, "last_serial": 5979311, "releases": { "2019.10.15": [ { "comment_text": "", "digests": { "md5": "82a16251bd94959909eae69e266fc264", "sha256": "4393c373ee157fb7a67697457c4a1a93065bf784f1fa0ebe04662b7ce5013030" }, "downloads": -1, "filename": "intake_esm-2019.10.15-py3-none-any.whl", "has_sig": false, "md5_digest": "82a16251bd94959909eae69e266fc264", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 14832, "upload_time": "2019-10-15T20:38:04", "url": "https://files.pythonhosted.org/packages/60/0a/77eeb1323b466af18f66e1630185611fa283e1a7cedea5a4b3bcfe4ffd39/intake_esm-2019.10.15-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "38d5f344888145cdc8163303d2e1d279", "sha256": "959625b6e20f3153a800a541bb4341ef11db6ca2c761e9e8f22b641349dd8c74" }, "downloads": -1, "filename": "intake-esm-2019.10.15.tar.gz", "has_sig": false, "md5_digest": "38d5f344888145cdc8163303d2e1d279", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 102208, "upload_time": "2019-10-15T20:38:06", "url": "https://files.pythonhosted.org/packages/52/64/9978a10f84095730230f8aa32780826b73722b2f3f97fe27cbb3bb5ad263/intake-esm-2019.10.15.tar.gz" } ], "2019.2.28": [ { "comment_text": "", "digests": { "md5": "6e7ee5f4806c519cb445978936eafd3a", "sha256": "14385a9c7ea46d55ccc2e739a8653f7040931ecfb1e2fd60b3a168da06fba7b4" }, "downloads": -1, "filename": "intake_esm-2019.2.28-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "6e7ee5f4806c519cb445978936eafd3a", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": ">3.5", "size": 14053, "upload_time": "2019-02-27T17:37:22", "url": "https://files.pythonhosted.org/packages/2c/bb/4963bafa68ee081942ab729d4396a78e2febc8e9dcd743b9e95c8b9c7d23/intake_esm-2019.2.28-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "f10c207dc7db221326f426461e50449d", "sha256": "215369603e6264b2624aef81459896be0b0f2340c47aff10efa4c0397561a078" }, "downloads": -1, "filename": "intake-esm-2019.2.28.tar.gz", "has_sig": false, "md5_digest": "f10c207dc7db221326f426461e50449d", "packagetype": "sdist", "python_version": "source", "requires_python": ">3.5", "size": 29412, "upload_time": "2019-02-27T17:37:24", "url": "https://files.pythonhosted.org/packages/61/f2/b4b19f3413096111cfa7d8df2d7a917bcd999736d4f9e65909a85869ed6e/intake-esm-2019.2.28.tar.gz" } ], "2019.4.26": [ { "comment_text": "", "digests": { "md5": "0c8e6f26611b8a3e333524730586dad1", "sha256": "abfebd0e004f076fa6647997e06920510e1827b70b659147482c930dcb2b9fde" }, "downloads": -1, "filename": "intake_esm-2019.4.26-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "0c8e6f26611b8a3e333524730586dad1", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": ">3.5", "size": 12592618, "upload_time": "2019-04-26T00:22:50", "url": "https://files.pythonhosted.org/packages/00/b4/57128fdfec27be7cfeb7e62c1c741e9c031593b4570d32f88360a04d2ba8/intake_esm-2019.4.26-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "f4ae99d64741e341763e4f7e876064d5", "sha256": "ced11b72ece08e3f1d219f6cc1bc15a6c4e1fb6157897387c6ed8ff9fd44d923" }, "downloads": -1, "filename": "intake-esm-2019.4.26.tar.gz", "has_sig": false, "md5_digest": "f4ae99d64741e341763e4f7e876064d5", "packagetype": "sdist", "python_version": "source", "requires_python": ">3.5", "size": 12277754, "upload_time": "2019-04-26T00:23:11", "url": "https://files.pythonhosted.org/packages/68/2e/03cbf37c12486c80f151a42955526c613eef603b0f4646ed47fe712e201d/intake-esm-2019.4.26.tar.gz" } ], "2019.4.26.1": [ { "comment_text": "", "digests": { "md5": "ffbe4f75c755caca67099d405b18bb74", "sha256": "36dc9f22a3c50a17318e10708983442607e8c874182fa909c35ac5aa43fe3985" }, "downloads": -1, "filename": "intake_esm-2019.4.26.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "ffbe4f75c755caca67099d405b18bb74", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": ">3.5", "size": 27530, "upload_time": "2019-04-26T03:03:52", "url": "https://files.pythonhosted.org/packages/d6/1b/06725b431966611bbf0e8f469a8ff8252f743ddc40d0f4fd516b0000ec13/intake_esm-2019.4.26.1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "55fb4fc53c6fe6d4466c1ed3524e4947", "sha256": "1975f7ab4a565076267d77056ad7af9b39bf6f27a0993d1ed084fed2e52f76c3" }, "downloads": -1, "filename": "intake-esm-2019.4.26.1.tar.gz", "has_sig": false, "md5_digest": "55fb4fc53c6fe6d4466c1ed3524e4947", "packagetype": "sdist", "python_version": "source", "requires_python": ">3.5", "size": 69718, "upload_time": "2019-04-26T03:03:54", "url": "https://files.pythonhosted.org/packages/f3/ad/79e393953468d3766da7d61c9e2a5cad81c315284066643cdf497e641a74/intake-esm-2019.4.26.1.tar.gz" } ], "2019.5.11": [ { "comment_text": "", "digests": { "md5": "7e7e35ec59330b6cb4a517ca3b9d43b7", "sha256": "e7a92eaf724ffdb8ba102495750a98130f19878cddae3f5f5c1aa58f1f071535" }, "downloads": -1, "filename": "intake_esm-2019.5.11-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "7e7e35ec59330b6cb4a517ca3b9d43b7", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": ">3.5", "size": 33013, "upload_time": "2019-05-12T05:14:09", "url": "https://files.pythonhosted.org/packages/63/4d/0d37236e44c8504368f21252fd05c4ab7f63161ada89861271723857b5c6/intake_esm-2019.5.11-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "57e078bbb54d9f8d44c40e37be930ab6", "sha256": "e307adf982f1729b09e24f828142a52398ba201f67b6bc636f1bb2bbe18c5fdb" }, "downloads": -1, "filename": "intake-esm-2019.5.11.tar.gz", "has_sig": false, "md5_digest": "57e078bbb54d9f8d44c40e37be930ab6", "packagetype": "sdist", "python_version": "source", "requires_python": ">3.5", "size": 3182436, "upload_time": "2019-05-12T05:14:20", "url": "https://files.pythonhosted.org/packages/7a/ba/f5e4cdaa0b1ea3c6877a0e2792dbf39319ca2461f7e184ea7d23c367b15e/intake-esm-2019.5.11.tar.gz" } ], "2019.8.23": [ { "comment_text": "", "digests": { "md5": "97ddb7560eb064b5583f367920e6c9ba", "sha256": "2faa4baa1288d07ec4e105538133c3b5dc5204e943e8327ca46e25b8d7829d80" }, "downloads": -1, "filename": "intake_esm-2019.8.23-py3-none-any.whl", "has_sig": false, "md5_digest": "97ddb7560eb064b5583f367920e6c9ba", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 48797, "upload_time": "2019-08-23T19:39:23", "url": "https://files.pythonhosted.org/packages/08/26/4b96b951d9e5122cafef031b16498e8e5cb31989eaf32963770dcb3dd375/intake_esm-2019.8.23-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "de26aff504a65a251728578e2788e1e3", "sha256": "0c3866accec23b11a8ae94b8b6b09d66f0cdd151818950e6b49e6aabc39418b9" }, "downloads": -1, "filename": "intake-esm-2019.8.23.tar.gz", "has_sig": false, "md5_digest": "de26aff504a65a251728578e2788e1e3", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 280041, "upload_time": "2019-08-23T19:39:25", "url": "https://files.pythonhosted.org/packages/d4/d4/f89c97b1e4b58fe65807a909cf97c0e3c115ec738c58eb42649f1240b247/intake-esm-2019.8.23.tar.gz" } ], "2019.8.5": [ { "comment_text": "", "digests": { "md5": "4221bf01973b70223fe3d44a10154aba", "sha256": "843c6f15dba601d5a444047586a308ba293ee13aa1f76dd31fa5fe07d04bddef" }, "downloads": -1, "filename": "intake_esm-2019.8.5-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "4221bf01973b70223fe3d44a10154aba", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": ">3.5", "size": 40416, "upload_time": "2019-08-05T21:31:25", "url": "https://files.pythonhosted.org/packages/4d/d0/e3f8bd6799f533e719c5a74b395e1132f363e4e4ea3a6ca7709576f3d84a/intake_esm-2019.8.5-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "002ee25c5aba9f48f3b6a7e200b03e39", "sha256": "2a7ca5b981959c26ef73de9092fc54bf01bae58020b9298d24df4c0e2850da26" }, "downloads": -1, "filename": "intake-esm-2019.8.5.tar.gz", "has_sig": false, "md5_digest": "002ee25c5aba9f48f3b6a7e200b03e39", "packagetype": "sdist", "python_version": "source", "requires_python": ">3.5", "size": 3189198, "upload_time": "2019-08-05T21:31:27", "url": "https://files.pythonhosted.org/packages/4d/1b/a9332a970c564d1575b1d05c03d25fd46dfab2315ea1506215f576b0cf66/intake-esm-2019.8.5.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "82a16251bd94959909eae69e266fc264", "sha256": "4393c373ee157fb7a67697457c4a1a93065bf784f1fa0ebe04662b7ce5013030" }, "downloads": -1, "filename": "intake_esm-2019.10.15-py3-none-any.whl", "has_sig": false, "md5_digest": "82a16251bd94959909eae69e266fc264", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 14832, "upload_time": "2019-10-15T20:38:04", "url": "https://files.pythonhosted.org/packages/60/0a/77eeb1323b466af18f66e1630185611fa283e1a7cedea5a4b3bcfe4ffd39/intake_esm-2019.10.15-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "38d5f344888145cdc8163303d2e1d279", "sha256": "959625b6e20f3153a800a541bb4341ef11db6ca2c761e9e8f22b641349dd8c74" }, "downloads": -1, "filename": "intake-esm-2019.10.15.tar.gz", "has_sig": false, "md5_digest": "38d5f344888145cdc8163303d2e1d279", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 102208, "upload_time": "2019-10-15T20:38:06", "url": "https://files.pythonhosted.org/packages/52/64/9978a10f84095730230f8aa32780826b73722b2f3f97fe27cbb3bb5ad263/intake-esm-2019.10.15.tar.gz" } ] }