{ "info": { "author": "SLAC National Accelerator Laboratory - Bennet Meyers", "author_email": "bennetm@stanford.edu", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Intended Audience :: Science/Research", "License :: OSI Approved :: BSD License", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Topic :: Scientific/Engineering" ], "description": "# solar-data-tools\n\n[![PyPI release](https://img.shields.io/pypi/v/solar-data-tools.svg)](https://pypi.org/project/solar-data-tools/)\n[![Anaconda Cloud release](https://anaconda.org/slacgismo/solar-data-tools/badges/version.svg)](https://anaconda.org/slacgismo/solar-data-tools)\n\nTools for performing common tasks on solar PV data signals. These tasks include finding clear days in\na data set, common data transforms, and fixing time stamp issues. These tools are designed to be\nautomatic and require little if any input from the user. Libraries are included to help with data IO\nand plotting as well. \n\nSee notebooks folder for examples.\n\n## Setup\n\n### Installing this project as PIP package\n\n```sh\n$ pip install solar-data-tools\n```\n\nAs of March 6, 2019, it fails because scs package installed as a dependency of cxvpy expects numpy to be already installed.\n[scs issue 85](https://github.com/cvxgrp/scs/issues/85) says, it is fixed.\nHowever, it doesn't seem to be reflected in its pip package.\nAlso, cvxpy doesn't work with numpy version less than 1.16.\nAs a work around, install numpy separatly first and then install this package.\ni.e.\n```sh\n$ pip install 'numpy>=1.16'\n$ pip install statistical-clear-sky\n```\n\n#### Solvers\n\nBy default, ECOS solver is used, which is supported by cvxpy because it is Open Source.\n\nHowever, it is found that Mosek solver is more stable. Thus, we encourage you to install it separately as below and obtain the license on your own.\n\n* [mosek](https://www.mosek.com/resources/getting-started/) - For using MOSEK solver.\n\n ```sh\n $ pip install -f https://download.mosek.com/stable/wheel/index.html Mosek\n ```\n\n### Installing this project as Anaconda package\n\n```sh\n$ conda install -c slacgismo solar-data-tools\n```\n\nIf you are using Anaconda, the problem described in the section for PIP package above doesn't occur since numpy is already installed. And during solar-data-tools installation, numpy is upgraded above 1.16.\n\n#### Solvers\n\nBy default, ECOS solver is used, which is supported by cvxpy because it is Open Source.\n\nHowever, it is found that Mosek solver is more stable. Thus, we encourage you to install it separately as below and obtain the license on your own.\n\n* [mosek](https://www.mosek.com/resources/getting-started/) - For using MOSEK solver.\n\n ```sh\n $ conda install -c mosek mosek\n ```\n\n### Using this project by cloning this GIT repository\n\nFrom a fresh `python` environment, run the following from the base project folder:\n\n```bash\n$ pip install -r requirements.txt\n```\n\nAs of March 6, 2019, it fails because scs package installed as a dependency of cxvpy expects numpy to be already installed.\n[scs issue 85](https://github.com/cvxgrp/scs/issues/85) says, it is fixed.\nHowever, it doesn't seem to be reflected in its pip package.\nAlso, cvxpy doesn't work with numpy version less than 1.16.\nAs a work around, install numpy separatly first and then install this package.\ni.e.\n```bash\n$ pip install 'numpy>=1.16'\n$ pip install -r requirements.txt\n```\n\nTo test that everything is working correctly, launch\n\n```bash\n$ jupyter notebook\n```\n\nand run the two notebooks in the `notebooks/` folder.\n\n## Usage\n\n#### Clear Day Detection\n\nThis algorithm estimates the clear days in a data set two ways and then combines the estimates for the final estimations. The first estimate is based on the \"smoothness\" of each daily power signal. The second estimate is based on the seasonally adjusted daily energy output of the system.\n\n```python\nimport numpy as np\nfrom solardatatools.clear_day_detection import find_clear_days\nfrom solardatatools.data_transforms import make_2d\nfrom solardatatools.dataio import get_pvdaq_data\n\npv_system_data = get_pvdaq_data(sysid=35, api_key='DEMO_KEY', year=[2011, 2012, 2013])\n\npower_signals_d = make_2d(pv_system_data, key='dc_power')\n\nclear_days = find_clear_days(power_signals_d)\n```\n\n#### Time Shift Detection and Fixing\n\nThis algorithm determines if the time stamps provided with the data have \"shifted\" at any point and then corrects the shift if found. These shifts can often be caused by incorrect handling of daylight savings time, but can come from other sources as well.\n\n```python\nfrom solardatatools.data_transforms import fix_time_shifts, make_2d\nfrom solardatatools.dataio import get_pvdaq_data\nfrom solardatatools.plotting import plot_2d\n\npv_system_data = get_pvdaq_data(sysid=1199, year=[2015, 2016, 2017], api_key='DEMO_KEY')\n\npower_signals_d = make_2d(pv_system_data, key='dc_power')\n\nfixed_power_signals_d, time_shift_days_indices_ixs = fix_time_shifts(\n power_signals_d, return_ixs=True)\n```\n\n## Versioning\n\nWe use [Semantic Versioning](http://semver.org/) for versioning. For the versions available, see the [tags on this repository](https://github.com/bmeyers/solar-data-tools/tags).\n\n## Authors\n\n* **Bennet Meyers** - *Initial work and Main research work* - [Bennet Meyers GitHub](https://github.com/bmeyers)\n\nSee also the list of [contributors](https://github.com/bmeyers/solar-data-tools/contributors) who participated in this project.\n\n## License\n\nThis project is licensed under the BSD 2-Clause License - see the [LICENSE](LICENSE) file for details\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/bmeyers/solar-data-tools", "keywords": "solar pv photovoltaic", "license": "", "maintainer": "", "maintainer_email": "", "name": "solar-data-tools", "package_url": "https://pypi.org/project/solar-data-tools/", "platform": "", "project_url": "https://pypi.org/project/solar-data-tools/", "project_urls": { "Bug Reports": "https://github.com/bmeyers/solar-data-tools/issues", "Homepage": "https://github.com/bmeyers/solar-data-tools" }, "release_url": "https://pypi.org/project/solar-data-tools/0.1.3/", "requires_dist": [ "scipy", "numpy (>=1.16)", "pandas", "sklearn", "seaborn", "requests", "cvxpy (>=1.0)", "check-manifest ; extra == 'dev'", "coverage ; extra == 'test'" ], "requires_python": ">=3.6, <4", "summary": "Tools for performing common tasks on solar PV data signals", "version": "0.1.3" }, "last_serial": 5711741, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "1191a4ddcccdba7b29fb50c3903d2ad0", "sha256": "e9e827e718b8991d94ee11e5522428a2cc215c3fae45e47d5f7fb6a0505ccecd" }, "downloads": -1, "filename": "solar_data_tools-0.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "1191a4ddcccdba7b29fb50c3903d2ad0", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6, <4", "size": 11271, "upload_time": "2019-03-06T23:26:27", "url": "https://files.pythonhosted.org/packages/8a/f0/b8365259b64121f7745ceae09b612fc435a021366187dbb95606f21a3f2a/solar_data_tools-0.1.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "b4a46f003d174ac2fadc1e44aeef36cd", "sha256": "857b0680552ddf70474d4ee61084dfe017f4c7127d2c28182f780086c5a17e73" }, "downloads": -1, "filename": "solar-data-tools-0.1.0.tar.gz", "has_sig": false, "md5_digest": "b4a46f003d174ac2fadc1e44aeef36cd", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6, <4", "size": 10945, "upload_time": "2019-03-06T23:26:29", "url": "https://files.pythonhosted.org/packages/d2/16/7f20b8f5391231b5ac8a7d9aaa8b6c42a5b32d5135553dbcf4af0105c67b/solar-data-tools-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "f01e5a2749ff6113768ec7e72e75ed97", "sha256": "b0462ecc26efa0c1c8209dbe703ca1015baab588b30e7831c85dc16f99e901cd" }, "downloads": -1, "filename": "solar_data_tools-0.1.1-py3-none-any.whl", "has_sig": false, "md5_digest": "f01e5a2749ff6113768ec7e72e75ed97", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6, <4", "size": 13234, "upload_time": "2019-03-06T23:48:06", "url": "https://files.pythonhosted.org/packages/97/47/dd26d2458b17df26cf52c01839c1b833cdf9bc876c5532a756ac3b23b6c4/solar_data_tools-0.1.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "14a3501fee4b60e683f400925e75c837", "sha256": "d860db8535eb1e5aac91d42534c4255a597edc8346297695517c364d01be251e" }, "downloads": -1, "filename": "solar-data-tools-0.1.1.tar.gz", "has_sig": false, "md5_digest": "14a3501fee4b60e683f400925e75c837", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6, <4", "size": 12532, "upload_time": "2019-03-06T23:48:07", "url": "https://files.pythonhosted.org/packages/b7/9c/24202ae742f17760bc1e48b232d7d67a59899217f944cbb4f216e54e48ff/solar-data-tools-0.1.1.tar.gz" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "f06bbc7d5fe90e2670ecc114f0a6da06", "sha256": "48e0aae294e1565d4c8cc2518d5bd6c73f9963c9a51aa57b55c576d6c1d00e95" }, "downloads": -1, "filename": "solar_data_tools-0.1.2-py3-none-any.whl", "has_sig": false, "md5_digest": "f06bbc7d5fe90e2670ecc114f0a6da06", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6, <4", "size": 17133, "upload_time": "2019-05-14T23:35:09", "url": "https://files.pythonhosted.org/packages/9f/75/c3bd14708359a6556b7094b01be5215f96ce44fe702b0cc6fad5d62812d2/solar_data_tools-0.1.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1395febc97d658e8d9e3deddf7eaa3f3", "sha256": "2992bf86342ade9a82c730efdf28e94aca7163239d9d561d31318cdcb1844001" }, "downloads": -1, "filename": "solar-data-tools-0.1.2.tar.gz", "has_sig": false, "md5_digest": "1395febc97d658e8d9e3deddf7eaa3f3", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6, <4", "size": 14271, "upload_time": "2019-05-14T23:35:11", "url": "https://files.pythonhosted.org/packages/b5/94/6fc0a0f289ca09c9028326aa0b844e1bacb706287cdba392c719b2e051c0/solar-data-tools-0.1.2.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "f1ea7b18d59d2d86343093caf1410e54", "sha256": "b586948b09a19f3345e59c1e3a3bed459327a08229dfdd2189d36af16ea2d069" }, "downloads": -1, "filename": "solar_data_tools-0.1.3-py3-none-any.whl", "has_sig": false, "md5_digest": "f1ea7b18d59d2d86343093caf1410e54", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6, <4", "size": 21695, "upload_time": "2019-08-21T21:01:39", "url": "https://files.pythonhosted.org/packages/e6/1c/d2f94b88330a10938e70f308a5a5afb3df26e5e3fe6441d155112d5fde18/solar_data_tools-0.1.3-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "bc22d5c9f5cc187e5380ebd2c9230048", "sha256": "e37fae99a1fa10b750e68c468eb7f70eec60432311e6680a57d7297fa2dbea4d" }, "downloads": -1, "filename": "solar-data-tools-0.1.3.tar.gz", "has_sig": false, "md5_digest": "bc22d5c9f5cc187e5380ebd2c9230048", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6, <4", "size": 20289, "upload_time": "2019-08-21T21:01:41", "url": "https://files.pythonhosted.org/packages/80/0b/90d5b120eef5130d0b7aef84b11014254b484862205f727cb98d69093920/solar-data-tools-0.1.3.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f1ea7b18d59d2d86343093caf1410e54", "sha256": "b586948b09a19f3345e59c1e3a3bed459327a08229dfdd2189d36af16ea2d069" }, "downloads": -1, "filename": "solar_data_tools-0.1.3-py3-none-any.whl", "has_sig": false, "md5_digest": "f1ea7b18d59d2d86343093caf1410e54", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6, <4", "size": 21695, "upload_time": "2019-08-21T21:01:39", "url": "https://files.pythonhosted.org/packages/e6/1c/d2f94b88330a10938e70f308a5a5afb3df26e5e3fe6441d155112d5fde18/solar_data_tools-0.1.3-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "bc22d5c9f5cc187e5380ebd2c9230048", "sha256": "e37fae99a1fa10b750e68c468eb7f70eec60432311e6680a57d7297fa2dbea4d" }, "downloads": -1, "filename": "solar-data-tools-0.1.3.tar.gz", "has_sig": false, "md5_digest": "bc22d5c9f5cc187e5380ebd2c9230048", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6, <4", "size": 20289, "upload_time": "2019-08-21T21:01:41", "url": "https://files.pythonhosted.org/packages/80/0b/90d5b120eef5130d0b7aef84b11014254b484862205f727cb98d69093920/solar-data-tools-0.1.3.tar.gz" } ] }