{ "info": { "author": "Andy Fiedler", "author_email": "andy@andyfiedler.com", "bugtrack_url": null, "classifiers": [], "description": "TsTables\n========\n\nTsTables is a Python package to store time series data in HDF5 files\nusing PyTables. It stores time series data into daily partitions and\nprovides functions to query for subsets of data across partitions.\n\nIts goals are to support a workflow where tons (gigabytes) of time\nseries data are appended periodically to a HDF5 file, and need to be\nread many times (quickly) for analytical models and research.\n\nExample\n-------\n\nThis example reads in minutely bitcoin price data and then fetches a\nrange of data. For the full example here, and other examples, see\n`EXAMPLES.md `__.\n\n.. code:: python\n\n # Class to use as the table description\n class BpiValues(tables.IsDescription):\n timestamp = tables.Int64Col(pos=0)\n bpi = tables.Float64Col(pos=1)\n\n # Use pandas to read in the CSV data\n bpi = pandas.read_csv('bpi_2014_01.csv',index_col=0,names=['date','bpi'],parse_dates=True)\n\n f = tables.open_file('bpi.h5','a')\n\n # Create a new time series\n ts = f.create_ts('/','BPI',BpiValues)\n\n # Append the BPI data\n ts.append(bpi)\n\n # Read in some data\n read_start_dt = datetime(2014,1,4,12,00)\n read_end_dt = datetime(2014,1,4,14,30)\n\n rows = ts.read_range(read_start_dt,read_end_dt)\n\n # `rows` will be a pandas DataFrame with a DatetimeIndex.\n\nHere is how to open a pre-existing ``bpi.h5`` HDF5 file and get that\ntimeseries from it.\n\n.. code:: python\n\n f = tables.open_file('bpi.h5','r')\n ts = f.root.BPI._f_get_timeseries()\n\n # Read in some data\n read_start_dt = datetime(2014,1,4,12,00)\n read_end_dt = datetime(2014,1,4,14,30)\n\n rows = ts.read_range(read_start_dt,read_end_dt)\n\nRunning unit tests\n------------------\n\nYou can run the unit test suite from the command line at the root of the\nrepository:\n\n``python setup.py test``\n\nPreliminary benchmarks\n----------------------\n\nThe main goal of TsTables is to make it very fast to read subsets of\ndata, given a date range. TsTables currently includes a simple benchmark\nto track progress towards that goal. To run it, after installing the\npackage, you can run ``tstables_benchmark`` from the command line or you\ncan import the package in a Python console and run it directly.\n\n.. code:: python\n\n import tstables\n tstables.Benchmark.main()\n\nRunning the benchmark both prints results out to the screen and saves\nthem in ``benchmark.txt``.\n\nThe benchmark loads one year of random secondly data (just the timestamp\ncolumn and a 32-bit integer \"price\" column) into a file, and then it\nreads random one hour chunks of data.\n\nCurrently, here's some benchmarks of TsTables (from a MacBook Pro with a\nSSD):\n\n+---------------------------------------------------------------+-----------------+\n| Metric | Results |\n+===============================================================+=================+\n| Append one month of data (2.67 million rows) | 0.711 seconds |\n+---------------------------------------------------------------+-----------------+\n| Fetch one hour of data into memory | 0.305 seconds |\n+---------------------------------------------------------------+-----------------+\n| File size (one year of data, 32 million rows, uncompressed) | 391.6 MB |\n+---------------------------------------------------------------+-----------------+\n\nHDF5 supports zlib and other compression algorithms, which can be\nenabled through PyTables to reduce the file size. Without compression,\nthe HDF5 file size is approximately 1.8% larger than the raw data in\nbinary form, a drastically lower overhead than CSV files.\n\nContributing\n------------\n\nIf you are interested in the project (to contribute or to hear about\nupdates), email Andy Fiedler at andy@andyfiedler.com or submit a pull\nrequest.", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://github.com/afiedler/tstables", "keywords": "time series high frequency HDF5", "license": "MIT", "maintainer": null, "maintainer_email": null, "name": "tstables", "package_url": "https://pypi.org/project/tstables/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/tstables/", "project_urls": { "Download": "UNKNOWN", "Homepage": "http://github.com/afiedler/tstables" }, "release_url": "https://pypi.org/project/tstables/0.0.15/", "requires_dist": null, "requires_python": null, "summary": "Handles large time series using PyTables and Pandas", "version": "0.0.15" }, "last_serial": 1761469, "releases": { "0.0.10": [ { "comment_text": "", "digests": { "md5": "50e1e9655b72c115443de6311cc5e6c6", "sha256": "cb561c898725eedc6cadfe0bf85060841f7cb71a5392304008f16dc13c6d05f7" }, "downloads": -1, "filename": "tstables-0.0.10.tar.gz", "has_sig": false, "md5_digest": "50e1e9655b72c115443de6311cc5e6c6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11792, "upload_time": "2014-05-27T13:25:26", "url": "https://files.pythonhosted.org/packages/93/d1/0985622413ae1a3965944d2287fd6c0134ca214b3d135bf9b062b6b8c7c2/tstables-0.0.10.tar.gz" } ], "0.0.11": [ { "comment_text": "", "digests": { "md5": "42bcf5f307e3d409f8128548896ef2f5", "sha256": "0afda4730553956ad2d9b55e6233f3051e39ebf72f54d2109123f132613f3bf4" }, "downloads": -1, "filename": "tstables-0.0.11.tar.gz", "has_sig": false, "md5_digest": "42bcf5f307e3d409f8128548896ef2f5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11727, "upload_time": "2014-05-28T13:19:10", "url": "https://files.pythonhosted.org/packages/a6/59/2195ca7fa7819d7d7c7d7547f16b02b73b2601cd34d42610b6163829dd8f/tstables-0.0.11.tar.gz" } ], "0.0.12": [ { "comment_text": "", "digests": { "md5": "d2cefdeef3448a12467cf688eb560651", "sha256": "9681879c98084439dcf32bd19ca12035d3178feffbdfae749fd2076e4b6fe93c" }, "downloads": -1, "filename": "tstables-0.0.12.tar.gz", "has_sig": false, "md5_digest": "d2cefdeef3448a12467cf688eb560651", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11397, "upload_time": "2014-06-30T13:58:07", "url": "https://files.pythonhosted.org/packages/2b/42/0d6c4739a9f7f31481792db9792249f97f015b5e3830276a5b5816debb3b/tstables-0.0.12.tar.gz" } ], "0.0.13": [ { "comment_text": "", "digests": { "md5": "903ff2700be7d5d0660684424c4713dd", "sha256": "5d4bd61492dfc71797ce27c51cd182ebbbc3604755568dd838f1ed831945942e" }, "downloads": -1, "filename": "tstables-0.0.13.tar.gz", "has_sig": false, "md5_digest": "903ff2700be7d5d0660684424c4713dd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11391, "upload_time": "2014-07-31T20:14:09", "url": "https://files.pythonhosted.org/packages/e5/bc/3f968852321f8a8e65fd83343647f303fb0f09ba177b8e6042bf9055f6aa/tstables-0.0.13.tar.gz" } ], "0.0.14": [ { "comment_text": "", "digests": { "md5": "a9eba5a6573a699ce50a8b8b9326ca8e", "sha256": "85781718b7cc99f71564cb3261455ce878e1e8ea2495c264795984caaa0f9eb5" }, "downloads": -1, "filename": "tstables-0.0.14.tar.gz", "has_sig": false, "md5_digest": "a9eba5a6573a699ce50a8b8b9326ca8e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11663, "upload_time": "2014-10-30T20:13:06", "url": "https://files.pythonhosted.org/packages/fb/8e/8e0e99fc5683bcd583b2251fbbb9124f736a274dd60713a4845ded9cb02f/tstables-0.0.14.tar.gz" } ], "0.0.15": [ { "comment_text": "", "digests": { "md5": "b7695a15ee954881943a1d9987e1f121", "sha256": "3ebd49f53cfaf0c415593067ef1f75f8e3b46bad9404885a5f4fbc58abd41b9b" }, "downloads": -1, "filename": "tstables-0.0.15.tar.gz", "has_sig": false, "md5_digest": "b7695a15ee954881943a1d9987e1f121", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11840, "upload_time": "2015-10-10T17:19:44", "url": "https://files.pythonhosted.org/packages/ed/b8/94920edeb0bcdc7cffc80f9219fe22af96f21953d615bab27487d8bc949d/tstables-0.0.15.tar.gz" } ], "0.0.1dev": [ { "comment_text": "", "digests": { "md5": "c20253d90eaa7b77da33410f602fbf6f", "sha256": "13c73c7b9da667693967526b1969212623d78d1c59f875113b9fbc944eed54ce" }, "downloads": -1, "filename": "tstables-0.0.1dev.tar.gz", "has_sig": false, "md5_digest": "c20253d90eaa7b77da33410f602fbf6f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7032, "upload_time": "2014-05-14T12:54:07", "url": "https://files.pythonhosted.org/packages/4e/39/3ff00471a3bf3f7864455741f5298fd44d46bbb49a73380ded604c3d5de3/tstables-0.0.1dev.tar.gz" } ], "0.0.2dev": [ { "comment_text": "", "digests": { "md5": "b489df0824777b0f372d49b0daab8976", "sha256": "4eafbcf670da0fffb5a26eca9fd6bab9d5724fcd9d689df8527b65b4a89d31f6" }, "downloads": -1, "filename": "tstables-0.0.2dev.tar.gz", "has_sig": false, "md5_digest": "b489df0824777b0f372d49b0daab8976", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7060, "upload_time": "2014-05-14T13:22:13", "url": "https://files.pythonhosted.org/packages/e7/d3/d4ab921657e4e2794a6991201c3ee4479a266a4b5e77b6a995e6a8fc800e/tstables-0.0.2dev.tar.gz" } ], "0.0.3dev": [ { "comment_text": "", "digests": { "md5": "672ee1a1509640474e7884cfa9ad79c7", "sha256": "ce6e2aa76243a7f815bb8c19b50568ce463817ae2b44fdabf4bf4d811241e24e" }, "downloads": -1, "filename": "tstables-0.0.3dev.tar.gz", "has_sig": false, "md5_digest": "672ee1a1509640474e7884cfa9ad79c7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6976, "upload_time": "2014-05-17T00:50:36", "url": "https://files.pythonhosted.org/packages/05/70/f704505d5d5d4f22d630bb48132b126a701c38caf611bc2103b8ef551524/tstables-0.0.3dev.tar.gz" } ], "0.0.4dev": [ { "comment_text": "", "digests": { "md5": "2b50efc8c361637e177287ba6e38478f", "sha256": "533f0080031cb60237fd9cf49390481c026b10d2c4bddc706c818fb950b51a41" }, "downloads": -1, "filename": "tstables-0.0.4dev.tar.gz", "has_sig": false, "md5_digest": "2b50efc8c361637e177287ba6e38478f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7393, "upload_time": "2014-05-18T21:24:05", "url": "https://files.pythonhosted.org/packages/26/81/15921c167fc88fb0259d3e82497c037baa68104687d68c4421f53b46869d/tstables-0.0.4dev.tar.gz" } ], "0.0.5dev": [ { "comment_text": "", "digests": { "md5": "053c81b4c53fc520f1ef6d882d444114", "sha256": "d32da2df7719a6c7b25cbb44a378fd4863d5122f1e221f763d3fd97ba6d28a76" }, "downloads": -1, "filename": "tstables-0.0.5dev.tar.gz", "has_sig": false, "md5_digest": "053c81b4c53fc520f1ef6d882d444114", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7597, "upload_time": "2014-05-19T15:12:26", "url": "https://files.pythonhosted.org/packages/90/23/a2a514c65baf5be3beb7f814f23868f6195404f829898d94e13c4ea062c7/tstables-0.0.5dev.tar.gz" } ], "0.0.6dev": [ { "comment_text": "", "digests": { "md5": "e6700d9e9ca556b296ec0f38c7550b5c", "sha256": "3426ddeaed2ec3e50407b1d37ee59263c98584afde9b9b08ee10ba35a621f2b7" }, "downloads": -1, "filename": "tstables-0.0.6dev.tar.gz", "has_sig": false, "md5_digest": "e6700d9e9ca556b296ec0f38c7550b5c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8411, "upload_time": "2014-05-20T14:17:53", "url": "https://files.pythonhosted.org/packages/5d/22/f53bac01d284814990b7d5f32b9b68a28321566b419216238361f264685c/tstables-0.0.6dev.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "e87c183d9460f5037cc5debd1798fa2f", "sha256": "4caaaedcec740bafef51c0fb875ed279465ce0c15ec190892a54dda25d4eea06" }, "downloads": -1, "filename": "tstables-0.0.7.tar.gz", "has_sig": false, "md5_digest": "e87c183d9460f5037cc5debd1798fa2f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9274, "upload_time": "2014-05-20T14:29:01", "url": "https://files.pythonhosted.org/packages/b3/06/0eb5dc58123c24d20a5afd0450d1243995cc6d08c79e4c3422e0e5f34965/tstables-0.0.7.tar.gz" } ], "0.0.9": [ { "comment_text": "", "digests": { "md5": "5bc397b762df5d9f72b12479b7371855", "sha256": "4de0441852091aae8cb5979d284e4afce93411fe72543c3c08b419310abfea00" }, "downloads": -1, "filename": "tstables-0.0.9.tar.gz", "has_sig": false, "md5_digest": "5bc397b762df5d9f72b12479b7371855", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12030, "upload_time": "2014-05-23T14:19:10", "url": "https://files.pythonhosted.org/packages/90/5f/7bc40279efae4e41c1b8c6626570c02b9f0eca47d0c51c38e68749adea43/tstables-0.0.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "b7695a15ee954881943a1d9987e1f121", "sha256": "3ebd49f53cfaf0c415593067ef1f75f8e3b46bad9404885a5f4fbc58abd41b9b" }, "downloads": -1, "filename": "tstables-0.0.15.tar.gz", "has_sig": false, "md5_digest": "b7695a15ee954881943a1d9987e1f121", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11840, "upload_time": "2015-10-10T17:19:44", "url": "https://files.pythonhosted.org/packages/ed/b8/94920edeb0bcdc7cffc80f9219fe22af96f21953d615bab27487d8bc949d/tstables-0.0.15.tar.gz" } ] }