{ "info": { "author": "Charles Irick", "author_email": "cirick@gmail.com", "bugtrack_url": null, "classifiers": [], "description": "# Batching\n\nBatching is a set of tools to format data for training sequence models.\n\n[![Build Status](https://travis-ci.org/cirick/batching.svg?branch=master)](https://travis-ci.org/cirick/batching)\n[![Coverage Status](https://coveralls.io/repos/github/cirick/batching/badge.svg?branch=master)](https://coveralls.io/github/cirick/batching?branch=master)\n\n## Installation\n```shell\n$ pip install batching\n```\n\n## Example usage\nExample script exists in sample.py\n```python\n# Metadata for batch info - including batch IDs and mappings to storage resouces like filenames\nstorage_meta = StorageMeta(validation_split=0.2)\n\n# Storage for batch data - Memory, Files, S3\nstorage = BatchStorageMemory(storage_meta)\n\n# Create batches - configuration contains feature names, windowing config, timeseries spacing\nbatch_generator = Builder(storage, \n feature_set, \n look_back, \n look_forward, \n batch_seconds, \n batch_size=128)\nbatch_generator.generate_and_save_batches(list_of_dataframes)\n\n# Generator for feeding batches to training - tf.keras.model.fit_generator\ntrain_generator = BatchGenerator(storage)\nvalidation_generator = BatchGenerator(storage, is_validation=True)\n\nmodel = tf.keras.Sequential()\nmodel.add(tf.keras.layers.Dense(1, activation='sigmoid')\nmodel.compile(loss=tf.keras.losses.binary_crossentropy, \n optimizer=tf.keras.optimizers.Adam(), \n metrics=['accuracy'])\nmodel.fit_generator(train_generator,\n validation_data=validation_generator,\n epochs=epochs)\n```\n\n## License\n\n[![License](http://img.shields.io/:license-mit-blue.svg?style=flat-square)](http://badges.mit-license.org)\n\n- **[MIT license](http://opensource.org/licenses/mit-license.php)**\n- Copyright 2015 \u00a9 FVCproductions.", "description_content_type": "text/markdown", "docs_url": null, "download_url": "https://github.com/cirick/batching/archive/v1.0.4.tar.gz", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/cirick/batching", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "batching", "package_url": "https://pypi.org/project/batching/", "platform": "", "project_url": "https://pypi.org/project/batching/", "project_urls": { "Download": "https://github.com/cirick/batching/archive/v1.0.4.tar.gz", "Homepage": "https://github.com/cirick/batching" }, "release_url": "https://pypi.org/project/batching/1.0.4/", "requires_dist": null, "requires_python": "", "summary": "Batching is a set of tools to format data for training sequence models", "version": "1.0.4" }, "last_serial": 5929637, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "2bb86bb3d37046176f4d86a172a2bda3", "sha256": "1b4563947c1a30265ced79c25952bdbb6d7b33e30fdaf38e20c69de6423d288b" }, "downloads": -1, "filename": "batching-0.0.1.tar.gz", "has_sig": false, "md5_digest": "2bb86bb3d37046176f4d86a172a2bda3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4680, "upload_time": "2019-05-25T03:16:35", "url": "https://files.pythonhosted.org/packages/66/77/08a6144808a813a1c1cbf94b7f7ef2f0d045784fc0ff5176a9888f9947a3/batching-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "21c233b09865d356bbc675059f98ebfd", "sha256": "4e06c6583a3373fd3a233d1dcdeb996935a168adcb225a19f15c6552951c17f9" }, "downloads": -1, "filename": "batching-0.0.2.tar.gz", "has_sig": false, "md5_digest": "21c233b09865d356bbc675059f98ebfd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5172, "upload_time": "2019-05-28T15:54:28", "url": "https://files.pythonhosted.org/packages/14/f9/e0089fa743f00fdd9485bce6229d1a2d5232b9923f257581677c1117ea5c/batching-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "70a81a3256ad49872249a532e4b88afe", "sha256": "40542b1bd89bc89165508df2a57e1c48e3474fedb2cde6dccaee030c4c27aee6" }, "downloads": -1, "filename": "batching-0.0.3.tar.gz", "has_sig": false, "md5_digest": "70a81a3256ad49872249a532e4b88afe", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6263, "upload_time": "2019-05-28T21:05:08", "url": "https://files.pythonhosted.org/packages/80/40/655e620c416eb40df0639d1e3be7a6a7fcfd673ddcd6e73a9f3231337322/batching-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "6dcfd7071b888f94cc35469b5886fb18", "sha256": "232d2385676a663af7572473aafcfb1e93485070eec36adb1da690fa6b224c32" }, "downloads": -1, "filename": "batching-0.0.4.tar.gz", "has_sig": false, "md5_digest": "6dcfd7071b888f94cc35469b5886fb18", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6351, "upload_time": "2019-05-29T15:54:18", "url": "https://files.pythonhosted.org/packages/8c/c5/5e9394791a9a6ba95af5ce7cd96f56f14ab83606ff4a08c95c9f9dffc3c9/batching-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "6ca107d969add28b1f0d57930d0bdeb7", "sha256": "3c9322dde41d766fd52d19291a7adc974e0d1ef6849ef356effa01ae9a7a8722" }, "downloads": -1, "filename": "batching-0.0.5.tar.gz", "has_sig": false, "md5_digest": "6ca107d969add28b1f0d57930d0bdeb7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6446, "upload_time": "2019-05-29T17:57:14", "url": "https://files.pythonhosted.org/packages/cb/32/92be74692ec6ef221a8eba32bdefb53e2c8d12dc555e8e6e8d603c4d3e88/batching-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "040802ec4c9e1aa684030e7a74e1a00f", "sha256": "00dbedf9f1296c956eae651b351feba9f271310a07a3a7658e54b6f3cc27b742" }, "downloads": -1, "filename": "batching-0.0.6.tar.gz", "has_sig": false, "md5_digest": "040802ec4c9e1aa684030e7a74e1a00f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6542, "upload_time": "2019-05-30T21:17:49", "url": "https://files.pythonhosted.org/packages/f8/7a/7a066d2b4708e1b9e550ed04f8992f16eb4125920bfbecff1f239f0c9d99/batching-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "b176d17298b90935eda3f6416309e1a4", "sha256": "5d6ee516addc90c4ff07cf743d151bbbe7f5be76b24afb5eebb8c51583f40e23" }, "downloads": -1, "filename": "batching-0.0.7.tar.gz", "has_sig": false, "md5_digest": "b176d17298b90935eda3f6416309e1a4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6639, "upload_time": "2019-05-31T02:55:01", "url": "https://files.pythonhosted.org/packages/10/03/35c50eca516f712a4a7b5fdc31a41c33db8fe0d9b150c22defce647d942e/batching-0.0.7.tar.gz" } ], "0.0.8": [ { "comment_text": "", "digests": { "md5": "e9f1eb60fb660350db898b016ccb09bd", "sha256": "6d8634c23f96ea0804ad4b820afc8a6699c04c15fca4bfe407a2f6e8b2d9f208" }, "downloads": -1, "filename": "batching-0.0.8.tar.gz", "has_sig": false, "md5_digest": "e9f1eb60fb660350db898b016ccb09bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6653, "upload_time": "2019-06-01T03:12:09", "url": "https://files.pythonhosted.org/packages/b7/48/8255f569e0ee26d1652af50cf961ff009fa97e8a63c8e30ff774959b9fa9/batching-0.0.8.tar.gz" } ], "1.0.0": [ { "comment_text": "", "digests": { "md5": "bf51667779c9885286a689cf6b86dc27", "sha256": "a1790030de888e1fb2893304f37509946464044150e37b2c8255029e6aa1b195" }, "downloads": -1, "filename": "batching-1.0.0.tar.gz", "has_sig": false, "md5_digest": "bf51667779c9885286a689cf6b86dc27", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7355, "upload_time": "2019-07-03T16:10:56", "url": "https://files.pythonhosted.org/packages/5b/e9/46677ab157d017643a54daf594e4197f0e2d90d9ca4444a31bd5efdd5cc9/batching-1.0.0.tar.gz" } ], "1.0.1": [ { "comment_text": "", "digests": { "md5": "79447ea4bf70250fd8f9a205d8be604d", "sha256": "a66f7de784c9efbf0bbb858b3760a219f82705075d1cebe3d44863844c54cc1a" }, "downloads": -1, "filename": "batching-1.0.1.tar.gz", "has_sig": false, "md5_digest": "79447ea4bf70250fd8f9a205d8be604d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7360, "upload_time": "2019-07-10T17:11:13", "url": "https://files.pythonhosted.org/packages/b7/47/723b54ced5d619419b8ee1a1195eec16955d38e3cc872b4614b61cee4ed1/batching-1.0.1.tar.gz" } ], "1.0.2": [ { "comment_text": "", "digests": { "md5": "16415a6effc89161b03d31a0de4da3ce", "sha256": "0ae4e8d4bc444d94772062ab71f476486f489e59573b9acfb822cf63fb1e3c9b" }, "downloads": -1, "filename": "batching-1.0.2.tar.gz", "has_sig": false, "md5_digest": "16415a6effc89161b03d31a0de4da3ce", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7430, "upload_time": "2019-07-11T14:42:36", "url": "https://files.pythonhosted.org/packages/ca/5a/134a95543c7cc0ad7cdc64b5c234754be095f7024101db4e3927d5dd2759/batching-1.0.2.tar.gz" } ], "1.0.3": [ { "comment_text": "", "digests": { "md5": "9975bfa951a2b59fd218b7c1a7f39dc7", "sha256": "2787dda0ceb891bbf9e2f73017d1474b748fefd74c8d5aa563758b24b97a17b0" }, "downloads": -1, "filename": "batching-1.0.3.tar.gz", "has_sig": false, "md5_digest": "9975bfa951a2b59fd218b7c1a7f39dc7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8045, "upload_time": "2019-08-08T19:54:56", "url": "https://files.pythonhosted.org/packages/12/6f/29f6052fc64c309b90d65f2631f4952506740d6c295c16dfc71a26515604/batching-1.0.3.tar.gz" } ], "1.0.4": [ { "comment_text": "", "digests": { "md5": "8059d13c6803d11addfb939b549a5cae", "sha256": "8d03231874114bf8b4949e2c17d85a813f9257b67bf94ca1204b612fd28d2996" }, "downloads": -1, "filename": "batching-1.0.4.tar.gz", "has_sig": false, "md5_digest": "8059d13c6803d11addfb939b549a5cae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8051, "upload_time": "2019-10-04T18:23:53", "url": "https://files.pythonhosted.org/packages/68/83/86b19b9f2deb780b0d915e86161d61195a7aa7c3b0c8155aa74ebfaa784e/batching-1.0.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "8059d13c6803d11addfb939b549a5cae", "sha256": "8d03231874114bf8b4949e2c17d85a813f9257b67bf94ca1204b612fd28d2996" }, "downloads": -1, "filename": "batching-1.0.4.tar.gz", "has_sig": false, "md5_digest": "8059d13c6803d11addfb939b549a5cae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8051, "upload_time": "2019-10-04T18:23:53", "url": "https://files.pythonhosted.org/packages/68/83/86b19b9f2deb780b0d915e86161d61195a7aa7c3b0c8155aa74ebfaa784e/batching-1.0.4.tar.gz" } ] }