{ "info": { "author": "Kevin Wurster", "author_email": "kevin@skytruth.org", "bugtrack_url": null, "classifiers": [], "description": "=====\nDewey\n=====\n\n\n.. image:: https://codeship.com/projects/234cd8a0-0199-0133-5687-5ab5ab3bbe8f/status?branch=master\n :target: https://codeship.com/projects/88690\n\n\nFigure out which files to touch when working with spatiotemporal data.\n\n\nOverview\n========\n\nWe have a lot of data that needs to be chunked by primary key, datetime, and\nspace but we don't want to sort through all of it whenever we just want to\nlook at a small piece. The solution is a sidecar metadata file and a file\nstructure organized as a spatial quadtree that is interacted with via a simple\nand lightweight NoSQL engine that is aware of these components.\n\nData is grouped in directories matching quadtree nodes in files that are grouped\ntime and primary key. Managing the actual files is up to the user. This library\nonly knows how to interact with the sidecar files.\n\nWe want to have both an API:\n\n.. code-block:: python\n\n import melvil\n import datetime\n\n # The base directory, match expression, etc. are all defined in a configfile\n\n # Only process data from the past 30 days that appears in the lower left\n # quadrant of the world, as specified by WGS84\n max_ts = datetime.datetime.now()q\n min_ts = max_ts - datetime.timedelta(days=30)\n bbox = (-180, -90 0, 0)\n\n for fp in melvil.search(min_ts=min_ts, max_ts=max_ts, bbox=bbox):\n with open(fp) as f:\n # Do something\n\nAnd a CLI:\n\n.. code-block:: console\n\n $ melvil search --min-ts 2014-01-01 --max-ts 2015-01-01 --bbox -180 -90 0 0\n /path/to/output/file/1\n /path/to/output/file/2\n /path/to/output/file/3\n ...\n\nUnder the hood ``melvil`` is looking for\n\n\nDeveloping\n==========\n\n.. code-block:: console\n\n $ git clone https://github.com/SkyTruth/Dewey\n $ cd Dewey\n $ virtualenv venv\n $ pip install -e .[test]\n $ py.test tests --cov melvil --term-missing melvil\n\n\nLicense\n=======\n\nSee ``LICENSE.txt``.", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/SkyTruth/Dewey", "keywords": "NoSQL spatial temporal spatiotemporal", "license": "Apache 2.0", "maintainer": null, "maintainer_email": null, "name": "Melvil", "package_url": "https://pypi.org/project/Melvil/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/Melvil/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/SkyTruth/Dewey" }, "release_url": "https://pypi.org/project/Melvil/0.1/", "requires_dist": null, "requires_python": null, "summary": "A general purpose AIS I/O library using the GPSd AIVDM schema.", "version": "0.1" }, "last_serial": 1613987, "releases": { "0.1": [] }, "urls": [] }