{
    "info": {
        "author": "Carmelo Sammarco",
        "author_email": "sammarcocarmelo@gmail.com",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 3 - Alpha",
            "Intended Audience :: Science/Research",
            "Programming Language :: Python :: 3.6",
            "Topic :: Scientific/Engineering"
        ],
        "description": "# MerOC    \n \n[![Build Status](https://travis-ci.com/carmelosammarco/MerOC.png)](https://travis-ci.com/carmelosammarco/MerOC) [![Build status](https://ci.appveyor.com/api/projects/status/qqy9y9iu1a473qk4?svg=true)](https://ci.appveyor.com/project/carmelosammarco/meroc) [![PyPi](https://img.shields.io/badge/PyPi-Project-yellow.svg)](https://pypi.org/project/MerOC/) [![Gitter](https://badges.gitter.im/MerOC/community.svg)](https://gitter.im/MerOC/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)\n\nI developed this software while working as [AKKA](https://www.akka-technologies.com) consultant engeneer for the [CMEMS's Service Desk (Copernicus Marine Environment Monitoring Service)](http://marine.copernicus.eu). I was and I am inspired by the Mercator-Ocean's community (users, co-workers, web-forum discussions and many more) which gave me ideas and the motivational power to build this tool. It is the first python application of its kind created inside the CMEMS environment and I hope that with time it will became an ufficial CMEMS tool. The main goals that I wanted to adress were solving the most common user problems as the data-download requests and the netCDF file manipulations.\n\n**This project gave me also ideas to develop other tools** as [tool4NC](https://github.com/carmelosammarco/tool4NC), [MerocENV](https://github.com/carmelosammarco/MerocENV) and [ads4MO](https://github.com/carmelosammarco/ads4MO). To know more about them just visit the projects web pages which are hyperlinked above.\n\nI created also a **chat-community** powered by \"Gitter\" where is possible have an exchange of ideas,functionalities,bugs and many more. Just click ![Gitter](https://badges.gitter.im/MerOC/community.svg) to acces the chat room.\n\nMany thanks to visit this page and try this software.\n\n**Carmelo Sammarco**\n\n## Introduction:\n\nPython software containing functions for simplifying the netCDF files download and manipulations. The registration to the [CMEMS web portal](http://marine.copernicus.eu) (by Copernicus) is required to be able to use the download services (TAB1:netCDF-Download). The other tools (TAB2:netCDF-Manipulations) can be used without any registration.\n\n![Imgur](https://i.imgur.com/ub2FHrm.jpg?1)\n\n\n## Be aware that:\n\nBecause of the early project development stage, it is possible find bugs, errors and imprecisions. Please to report them if you can.\n  \n\n## Dependencies:\n\nThe dependencies  are listed below:\n\n- [x]  netCDF4>=1.4.2\n- [x]  ftputil>=3.4\n- [x]  motuclient>=1.8.1\n- [x]  pandas>=0.23.4\n- [x]  xarray>=0.11.0 \n- [x]  csv342>=1.0.0\n- [x]  Shapely>=1.6.4.post1\n- [x]  Fiona>=1.8.4\n- [x]  cdo>=1.4.0\n\n\n## Installation for Unix users (Linux distros and Mac-OSX systems):\n\nIf interested to have a fully use of the \"TAB2:netCDF-Manipulations\" please install the [cdo - climate data operator](https://code.mpimet.mpg.de/projects/cdo). In fact it is required to run few functions in the above mentioned tab. To do that you can use the following command:\n\n```\nsudo apt-get install cdo\n```\n\nAlso please consider to install [Anaconda](https://www.anaconda.com) 3.* version (Be aware that to use this software is suggested python ~=3.6). Once the bash file (.sh) is downloaded, you can execute it in the terminal using the following command:\n\n```\nbash file_installation_Anaconda_downloaded.sh\n```\n\nFurthermore, an update of pip, setuptools and wheels is suggested. You can do it executing the following command:\n\n```\npython -m pip install --upgrade pip setuptools wheel\n```\n\nAfter that run the software installation with:\n\n```\npip install MerOC\n```\n\nWhen the installation is concluded, just type in the terminal \"MerOC\",press the enter key and the application will pop up.\n\n\n## Installation for Windows users:\n\nAs first things please install [cdo - climate data operator](https://code.mpimet.mpg.de/projects/cdo). It is required to run few functions inside the \"TAB2:netCDF-Manipulations\". From the product web page you can download the version which satisfy your system characteristics. Once de-compressed the folder downloaded just run the .exe file to install cdo in your Windows OS system.\n\nAlso please consider to install [Anaconda](https://www.anaconda.com) 3.* version (Be aware that to use this software is suggested python ~=3.6). The file from you downloaded will be a stardard executable (.exe). Before run the installation please be sure to tick the option for add in the Windows PATH environment variable the path of the anaconda package. \n\nFurthermore, an update of pip, setuptools and wheels is suggested. You can do it executing the following command:\n\n```\npython -m pip install --upgrade pip setuptools wheel\n```\n\nBefore start with the software installation it is mandatory to manually configure and install few python dependencies that are not correctly managed by the stardard 'pip' Windows command installation. The dependencies that I am speaking of are \u201cshapely\u201d and \u201cfiona\u201d. They are essential Python modules for geospatial operations which are contained in this python software (exporting a netCDF variable as shapefile just to cite an example). In this particular scenario, and especially in a Windows OS, be able to install the required modules using the Python wheels can be very handy. In fact they are already pre-compiled and then easily digested from the Windows OS. Christoph Gohlke, at the Laboratory for Fluorescence Dynamics at UC Irvine, maintains a large [Python wheels library](https://www.lfd.uci.edu/~gohlke/pythonlibs/). Be aware that for each module you need to choose the one maching your Python version and the pc processor characteristics (32 or 64-bit). If we consider as example \"Shapely-1.6.4.post1-cp37-cp37m-win32.whl\" the \"cp37\" indicate the python version which is 3.7.* while \"win32\" the processor type which is 32-bit. The python version can be indicated also as \"py3\" or \"py2\" or \"py2.py3\". the latter when both the 2.* and 3.* python version can be used. To install a wheel file you just need to run \"pip install [wheel_file]\"  in the same location where the wheel is located. To succeed within the installation of \"shapely\" and \"fiona\" you must execute the following steps, in the same order as they are listed below:\n\n1. Install [Visual studio C++](https://www.microsoft.com/en-us/download/details.aspx?id=48145).\n \n2. Download [gdal](https://www.lfd.uci.edu/~gohlke/pythonlibs/#gdal), [click](https://www.lfd.uci.edu/~gohlke/pythonlibs/#click), [cligj](https://www.lfd.uci.edu/~gohlke/pythonlibs/#cligj), [click_plugin](https://www.lfd.uci.edu/~gohlke/pythonlibs/#click), [attrs](https://www.lfd.uci.edu/~gohlke/pythonlibs/#attrs), [munch](https://www.lfd.uci.edu/~gohlke/pythonlibs/#munch), [fiona](https://www.lfd.uci.edu/~gohlke/pythonlibs/#fiona), [pyproj](https://www.lfd.uci.edu/~gohlke/pythonlibs/#pyproj), [rtree](https://www.lfd.uci.edu/~gohlke/pythonlibs/#rtree) and [shapely](https://www.lfd.uci.edu/~gohlke/pythonlibs/#shapely) from the [Python wheels library](https://www.lfd.uci.edu/~gohlke/pythonlibs/). Now you have what you need for the following steps.\n\n3. Install the gdal wheel. I suggest you to don't use gdal module alongside OSGeo4W or other similar distributions because they could go in conflict and then generate errors and malfuctions. Also add the gdal library path to the Windows PATH environment variable (which will be something like \"C:\\pyhon_version\\Lib\\site-packages\\osgeo\").To know in which way add the gdal path variable  you can check [here](https://www.howtogeek.com/118594/how-to-edit-your-system-path-for-easy-command-line-access/). Finally we can now test the gdal module. Before do that please to close and then re-open the command prompt and from whatever path location execute this command:\n\n```\ngdalinfo --help-general\n```\n \nIf gdal is correctly configured it will display its usage instructions.\n \n4. Install the others Python wheels modules, previously downloaded (gdal excluded), and following the list order (from the top to the bottom):\n\n- click\n- cligj\n- click_plugin\n- attrs\n- munch\n- fiona\n- pyproj\n- rtree\n- shapely\n\nNow that the all the most nasty dependencies are installed (at least for Windows OS), you can execute:\n\n```\npip install MerOC\n```\n\nWhen the installation is concluded, just type in the terminal \"MerOC\",press the enter key and the application will pop up.\n\n## Functionalities:\n\nThe program is divided into two tabs. The first tab is exslusively used by the download mechanisms while the second tab contains tools for the manipulation of netCDF files (See figure above). More details following below:\n\n### TAB 1: netCDF-Download\n\nThis Tab allows to subset the CMEMS products by bounding box, variables, depths and time coverage and then download by days, months,depths or just as a single file the data requested. The way to download is strictly related to the data time coverage. In fact for a very large time window (ex. years or anyway for more than 2 months of data) it is wiser use the \u201cDownload-monthly\u201d method (which generates one file for month) while for few days the simple \u201cDownload\u201d and \u201cDownload daily\u201d method can be used (the former generates just one output file while the latter a file for each day).\n\nBelow I am going to display a more detailed image of the \"TAB 1: netCDF-Download\". With different coulours are highlighted  the different \"TAB\" sections.\n\n![Imgur](https://i.imgur.com/mNzMCS0.png?1)\n\n![Imgur](https://i.imgur.com/v3wHiIK.png)\n\nI can summarise the workflow of the \"TAB 1: netCDF-Download\" as the following:\n\n**1) Filling the form with all the parameters required**\n- **CMEMS Usename**\n- **CMEMS Password**\n- **Product :** name of the product \n- **Dataset :** name of the dataset \n- **Long min/max :** Longitude min and max\n- **Lat  min/max :** Latidude min and max\n- **Depth min/max :** Depth min and max (if it is avaiable)\n- **Date start/end :** Defined by dates and time  (**From** [date_start] at [hh:mm:ss] **To** [date end] **at** [hh:mm:ss])\n- **Variable-1,2,3 :** Max three variables are allowed. If you want use less just leave the cell empty.\n- **File name :** It needs to be typed also if just used by the single file download method)\n- **Out-Dir :** output directory where we want to save the data\n\n**2) Generation of the motuclient script**\n\n**3) Download the data**\n  \nTo do that just a click to the more appropriate methods (based on your needs) is required. As i said previously the download mechanisms will allow you to download data by depths, days, months, Months&Depths, Yearly (very usefull when requested just a grid point) or just as single file. All the download mechanisms are highlighted in yellow in the figure above. \n\n### TAB 2: netCDF-Manipulation \n\nThis tab is able to convert the netCDF files in different formats (CSV, GRID and shape files), concatenate segments of data coming from the same dataset but at different time steps and split the data in function of the time. It is possible split the data by day(DD), months(YYYYMM) and years(YYYY) with the additional option of addiing a suffix to the data generated. More details about the functions included in  this tab are displayed in a separate published python module named [tool4NC](https://github.com/carmelosammarco/tool4NC) which bring in a easy coding form all the manipulation functionalities.\n\n## Stand-alone window application:\n\n-------\n\n**The App For Windows OS can be downloaded from [HERE](https://www.dropbox.com/s/rjds1xvag67ygkc/MerOC-win.exe?dl=0).**\n\nThis APP is still a prototype and then in development. I just decided to give you a preview. Just for your information and technical reason many fuctionalities are not working at the moment especially in the \"TAB2:netCDF-Manipulations\" where the only active fuction is the conversion to csv.",
        "description_content_type": "text/markdown",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/carmelosammarco/MerOC",
        "keywords": "",
        "license": "gpl-3.0",
        "maintainer": "",
        "maintainer_email": "",
        "name": "MerOC",
        "package_url": "https://pypi.org/project/MerOC/",
        "platform": "OS Independent",
        "project_url": "https://pypi.org/project/MerOC/",
        "project_urls": {
            "Homepage": "https://github.com/carmelosammarco/MerOC"
        },
        "release_url": "https://pypi.org/project/MerOC/1.1.2/",
        "requires_dist": null,
        "requires_python": "~=3.6",
        "summary": "Software to download/manipulate netCDF files",
        "version": "1.1.2"
    },
    "last_serial": 5782383,
    "releases": {
        "1.1.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "cf33c8346eb8650b4627f4c043c07662",
                    "sha256": "020935f124fe53cbc26e8fcb146d8d9d64729c8b6434e4a751f6926f170a1b31"
                },
                "downloads": -1,
                "filename": "MerOC-1.1.2.tar.gz",
                "has_sig": false,
                "md5_digest": "cf33c8346eb8650b4627f4c043c07662",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": "~=3.6",
                "size": 27260,
                "upload_time": "2019-09-04T16:43:44",
                "url": "https://files.pythonhosted.org/packages/d5/d3/ca67e99b5aa6947959853148ed091a5de404208c0527301c19f333bb0082/MerOC-1.1.2.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "cf33c8346eb8650b4627f4c043c07662",
                "sha256": "020935f124fe53cbc26e8fcb146d8d9d64729c8b6434e4a751f6926f170a1b31"
            },
            "downloads": -1,
            "filename": "MerOC-1.1.2.tar.gz",
            "has_sig": false,
            "md5_digest": "cf33c8346eb8650b4627f4c043c07662",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "~=3.6",
            "size": 27260,
            "upload_time": "2019-09-04T16:43:44",
            "url": "https://files.pythonhosted.org/packages/d5/d3/ca67e99b5aa6947959853148ed091a5de404208c0527301c19f333bb0082/MerOC-1.1.2.tar.gz"
        }
    ]
}