{ "info": { "author": "Christoph Paulik", "author_email": "christoph.paulik@geo.tuwien.ac.at", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Programming Language :: Python" ], "description": "========\ndatedown\n========\n\n.. image:: https://travis-ci.org/cpaulik/datedown.svg?branch=master\n :target: https://travis-ci.org/cpaulik/datedown\n\n.. image:: https://coveralls.io/repos/github/cpaulik/datedown/badge.svg?branch=master\n :target: https://coveralls.io/github/cpaulik/datedown?branch=master\n\n.. image:: https://badge.fury.io/py/datedown.svg\n :target: http://badge.fury.io/py/datedown\n\nSmall library to download files with date and time based filenames or folder\nstructures. In parallel using wget.\n\nRecursive wget can be slow and result in cumbersome local folder structures.\nThis library downloads exact filenames based on exact dates or a range of dates.\nRemote and local filenames and paths are built using the `Python strftime and\nstrptime format specification\n`_\n\nThe library uses the Python multiprocessing module to start multiple wget\ninstances for possibly faster downloading. At the end of the download process it\nverfies that all the files were downloaded. No support for checksums at the\nmoment.\n\nInstallation\n============\n\n* Install `wget `_ if it is not already on\n your system.\n* ``pip install datedown``\n\nUsage\n=====\n\nThe program can be used either as a library to be called from other Python\nprograms or as a stand alone command line program.\n\nUse as a command line program\n-----------------------------\n\nAfter installation the ``datedown`` program should be available in your shell.\nTo get detailed instructions on how to use it run ``datedown -h``.\n\nIf it is impossible to know the exact filename on the server then also a\nrecursive version of the script is available under the name ``datedown_rec``.\n\nExample\n~~~~~~~\n\n.. code::\n\n datedown 2000-01-01 2000-01-02 http://localhost:8888 file_%Y_%m_%d.txt /home/cpa/ --urlsubdirs test_data year_month_subfolders %Y %m\n\nThis would download the files\n\n* http://localhost:8888/test_data/year_month_subfolders/2000/01/file_2000_01_01.txt\n* http://localhost:8888/test_data/year_month_subfolders/2000/01/file_2000_01_02.txt\n\nto\n\n* /home/cpa/test_data/year_month_subfolders/2000/01/file_2000_01_01.txt\n* /home/cpa/test_data/year_month_subfolders/2000/01/file_2000_01_02.txt\n\n\nUse as a library\n----------------\n\nFor use as a library the most important function is\n:py:func:`datedown.interface.download_by_dt` or :py:func:`datedown.down.download`. The\nfirst function takes functions that produce urls from Python datetime objects\nwhereas the second takes lists of urls and local filenames. Please see the\nAPI Documentation for more details about these functions.\n\n|Documentation Status|\n\n.. |Documentation Status| image:: https://readthedocs.org/projects/datedown/badge/?version=latest\n :target: http://datedown.readthedocs.org/\n\nNote\n====\n\nThis project has been set up using PyScaffold 2.5.6. For details and usage\ninformation on PyScaffold see http://pyscaffold.readthedocs.org/.", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/cpaulik/datedown", "keywords": "", "license": "mit", "maintainer": "", "maintainer_email": "", "name": "datedown", "package_url": "https://pypi.org/project/datedown/", "platform": "", "project_url": "https://pypi.org/project/datedown/", "project_urls": { "Homepage": "https://github.com/cpaulik/datedown" }, "release_url": "https://pypi.org/project/datedown/0.3/", "requires_dist": null, "requires_python": "", "summary": "Small library to download files with date and time based filenames or folder structures. In parallel using wget.", "version": "0.3" }, "last_serial": 2660432, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "b166ffc25bee4c14976d7dfdb03fc54c", "sha256": "986890243256009cc12a61ee8ed58a4e9ab3b933d380d413db746211b2180f60" }, "downloads": -1, "filename": "datedown-0.1.tar.gz", "has_sig": false, "md5_digest": "b166ffc25bee4c14976d7dfdb03fc54c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16050, "upload_time": "2016-07-25T14:48:53", "url": "https://files.pythonhosted.org/packages/80/83/b086836943fc58c49eb7a86d0a7056c0a3c8f6dbd38ed0aaa1355cd8ba16/datedown-0.1.tar.gz" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "c6879585847e8d94ef8dcfe586855182", "sha256": "d24d0f9d97b78146587111b9aaf10d84dfd06fb404411787655723edae5cdac6" }, "downloads": -1, "filename": "datedown-0.2.tar.gz", "has_sig": false, "md5_digest": "c6879585847e8d94ef8dcfe586855182", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16499, "upload_time": "2016-07-26T09:53:37", "url": "https://files.pythonhosted.org/packages/13/be/5c29b258899adbb62007ef9dff7d96239b6ab874c2e46fceb26163661c0b/datedown-0.2.tar.gz" } ], "0.3": [ { "comment_text": "", "digests": { "md5": "d8823fa83fd36fbf7f056a3b14ac5349", "sha256": "aeea31a977671fd62435d1fba6882de4b07ba732b345be3219e5fc6970bfe3a2" }, "downloads": -1, "filename": "datedown-0.3.tar.gz", "has_sig": false, "md5_digest": "d8823fa83fd36fbf7f056a3b14ac5349", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16639, "upload_time": "2017-02-22T12:59:17", "url": "https://files.pythonhosted.org/packages/69/be/18ac91cb514d86d908ac646c9a1bfb962e139894647faf87aee967c432df/datedown-0.3.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "d8823fa83fd36fbf7f056a3b14ac5349", "sha256": "aeea31a977671fd62435d1fba6882de4b07ba732b345be3219e5fc6970bfe3a2" }, "downloads": -1, "filename": "datedown-0.3.tar.gz", "has_sig": false, "md5_digest": "d8823fa83fd36fbf7f056a3b14ac5349", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16639, "upload_time": "2017-02-22T12:59:17", "url": "https://files.pythonhosted.org/packages/69/be/18ac91cb514d86d908ac646c9a1bfb962e139894647faf87aee967c432df/datedown-0.3.tar.gz" } ] }