{ "info": { "author": "Ilja Heitlager", "author_email": "iheitlager@schubergphilis.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.6", "Topic :: Database", "Topic :: Software Development :: Build Tools", "Topic :: Utilities" ], "description": "Data-migrator (version 0.6.2) is a simple data-migration package for python lovers.\n\n.. image:: https://img.shields.io/pypi/pyversions/data-migrator.svg\n :target: https://pypi.python.org/pypi/data-migrator\n\n.. image:: https://circleci.com/gh/schubergphilis/data-migrator.svg?style=svg\n :target: https://circleci.com/gh/schubergphilis/data-migrator\n\n----\n\n.. image:: https://pyup.io/repos/github/schubergphilis/data-migrator/shield.svg\n :target: https://pyup.io/repos/github/schubergphilis/data-migrator/\n :alt: Updates\n\n.. image:: https://readthedocs.org/projects/data-migrator/badge/?version=latest\n :target: http://data-migrator.readthedocs.io/en/latest/?badge=latest\n :alt: Documentation Status\n\n.. image:: https://api.codacy.com/project/badge/Grade/bf6030e9e7e248979607802880336611\n :target: https://www.codacy.com/app/schubergphilis/data-migrator?utm_source=github.com&utm_medium=referral&utm_content=schubergphilis/data-migrator&utm_campaign=Badge_Grade\n\n.. image:: https://api.codacy.com/project/badge/Coverage/bf6030e9e7e248979607802880336611\n :target: https://www.codacy.com/app/schubergphilis/data-migrator?utm_source=github.com&utm_medium=referral&utm_content=schubergphilis/data-migrator&utm_campaign=Badge_Coverage\n\n.. image:: https://badge.fury.io/py/data-migrator.svg\n :target: https://badge.fury.io/py/data-migrator\n\n\nData-migrator is a declarative DSL for table driven data transformations, set up as\nan open and extensive system. Use this to create data transformations for\nchanging databases as a result of changing code, initial loads to datalakes\n(it contains a Kinesis provider)and more.\n\nExample\n-------\n\nData-migrator assumes data is extracted and loaded with client access.\n\n.. code-block:: bash\n\n\t$ mysql source_db -E 'select id,a,b from table' -B | python my_filter.py | mysql target_db\n\nIt than offers a wide range of primitives with default settings to build complex transformations\nfast, readable and extendable\n\n.. code-block:: python\n\n from data_migrator import models, transform\n\n class Result(models.Model):\n id = models.IntField(pos=0) # keep id\n uuid = models.UUIDField() # generate new uuid4 field\n a = models.StringField(pos=1, default='NO_NULL', max_length=5, nullable='NULL', replacement=lambda x:x.upper())\n b = models.StringField(pos=2, name='my_b')\n\n if __name__ == \"__main__\":\n transform.Transformer(models=[Result]).process()\n\nInstallation\n------------\n\nExecute the following command to install *data-migrator* with ``pip``::\n\n pip install data-migrator\n\nSee the `Installation Instructions\n`_ in Documentation for\nmore instructions on installing, upgrading, and uninstalling *data-migrator*.\n\nThe project is `maintained at GitHub `_.\n\nSupport and contribute\n----------------------\nQuestions, comments, bug reports and especially tested patches may be\nsubmitted directly to the `issue tracker\n`_.\n\nEveryone interacting with this codebase, issue trackers,\nchat rooms, and mailing lists is expected to follow the\n`Code of Conduct `_.\n\n\n", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/schubergphilis/data-migrator", "keywords": "datamigration,development-tools", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "data-migrator", "package_url": "https://pypi.org/project/data-migrator/", "platform": "any", "project_url": "https://pypi.org/project/data-migrator/", "project_urls": { "Homepage": "https://github.com/schubergphilis/data-migrator" }, "release_url": "https://pypi.org/project/data-migrator/0.6.2/", "requires_dist": [ "boto3", "python-dateutil", "six" ], "requires_python": "", "summary": "declarative data migration and transformation package", "version": "0.6.2" }, "last_serial": 3570623, "releases": { "0.4.5": [ { "comment_text": "", "digests": { "md5": "d21175b19e53f1b3b913b9fa679905fe", "sha256": "181b1281e70f2e6b0ddfd7ca1cb5d281d6e34194903d096711a06ad41ad26907" }, "downloads": -1, "filename": "data_migrator-0.4.5-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "d21175b19e53f1b3b913b9fa679905fe", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 22774, "upload_time": "2017-04-14T09:47:02", "url": "https://files.pythonhosted.org/packages/6f/cb/e9b3830800e83e137ff435fd49ad6a5dfb500e34835e5d6d64791fdfbe23/data_migrator-0.4.5-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "956b419ea597499fbbacd2e87f9a8e39", "sha256": "12a6f4b820e08ee4f0b70353b3b63a613a26909f081006244daca59a246362ff" }, "downloads": -1, "filename": "data-migrator-0.4.5.tar.gz", "has_sig": false, "md5_digest": "956b419ea597499fbbacd2e87f9a8e39", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 26783, "upload_time": "2017-04-14T09:47:04", "url": "https://files.pythonhosted.org/packages/33/d0/d4431132932eebdeb83ae6ffb5a4243273a2ec878d917691bed51331ef63/data-migrator-0.4.5.tar.gz" } ], "0.4.6": [ { "comment_text": "", "digests": { "md5": "9effe9652f9664727ad323062f1325d9", "sha256": "af5a3ce0550235023a537090caab07e544dfd78d9ab13f030b4df2524fe7a388" }, "downloads": -1, "filename": "data_migrator-0.4.6-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "9effe9652f9664727ad323062f1325d9", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 27410, "upload_time": "2017-04-17T21:45:43", "url": "https://files.pythonhosted.org/packages/c8/fd/77f40cf263855b0198292496b8a891535f6f0befa0892aa8fb76a306fcc4/data_migrator-0.4.6-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "e656c60f1a3d1832e7e640a5b079deb8", "sha256": "714375fd4529d22d72b2026f93765a41afcf2dfa3fa8606ff35b52a41c4f75fd" }, "downloads": -1, "filename": "data-migrator-0.4.6.tar.gz", "has_sig": false, "md5_digest": "e656c60f1a3d1832e7e640a5b079deb8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 33471, "upload_time": "2017-04-17T21:45:44", "url": "https://files.pythonhosted.org/packages/be/e1/b7642ff7565fca8486340ea0ffa599e1f206fceac9adcf419b0c569efcbf/data-migrator-0.4.6.tar.gz" } ], "0.5.0": [], "0.6.0": [ { "comment_text": "", "digests": { "md5": "8bb9083dd384248115d2d9ce25d21563", "sha256": "c6873a3cf7c5133af6a1951ea06690756e11a4cc336e0a8f4d117572df893214" }, "downloads": -1, "filename": "data_migrator-0.6.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "8bb9083dd384248115d2d9ce25d21563", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 31724, "upload_time": "2017-08-18T16:05:48", "url": "https://files.pythonhosted.org/packages/21/f2/950f8f8dda2fbfedd8e3b2d81cbf54f6142f5fafabd65bf2578f96484c21/data_migrator-0.6.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "abe66e0b7988d08b1b69bc5333bb0ef3", "sha256": "1ae11d59089eded31b131b717db59f7b6a54b78cc2304cce04a610bc30a62500" }, "downloads": -1, "filename": "data-migrator-0.6.0.tar.gz", "has_sig": false, "md5_digest": "abe66e0b7988d08b1b69bc5333bb0ef3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 44613, "upload_time": "2017-08-18T16:05:50", "url": "https://files.pythonhosted.org/packages/9f/e7/71fdecd1cdd2ef75a4e2eefac114b985b1976daab2dc491e08b7c84845eb/data-migrator-0.6.0.tar.gz" } ], "0.6.1": [ { "comment_text": "", "digests": { "md5": "8d0e2279ea84b204af8f30169cd79bdc", "sha256": "affca514721a1ebe71afc7dbda560c10195e93e7831569a1ec526e8ce01db06e" }, "downloads": -1, "filename": "data_migrator-0.6.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "8d0e2279ea84b204af8f30169cd79bdc", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 36388, "upload_time": "2017-09-17T07:54:54", "url": "https://files.pythonhosted.org/packages/0b/5b/ebc22abe16513750e47a01736afae1ee0b901bc83c1375ac62f07f0724f7/data_migrator-0.6.1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "9fcc7870a7844e508a2a8a0c472826c7", "sha256": "e3d686eb1e084d1ea2e72301e0200b0c60dd77275a1acc05b88743ac13df0b84" }, "downloads": -1, "filename": "data-migrator-0.6.1.tar.gz", "has_sig": false, "md5_digest": "9fcc7870a7844e508a2a8a0c472826c7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 48865, "upload_time": "2017-09-17T07:54:57", "url": "https://files.pythonhosted.org/packages/8b/0c/104ea8f8a06fc910c9521acc47c5c3ab1374601f94bd6044fabe0ddd1c7c/data-migrator-0.6.1.tar.gz" } ], "0.6.2": [ { "comment_text": "", "digests": { "md5": "8f78836b855fb8e40d05395aa94d2ef0", "sha256": "51063b3ae01e837cf3ee5adbfbf73fb1409cf74f0a97c75ed50de1af8b9cf639" }, "downloads": -1, "filename": "data_migrator-0.6.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "8f78836b855fb8e40d05395aa94d2ef0", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 37250, "upload_time": "2017-12-16T19:16:39", "url": "https://files.pythonhosted.org/packages/66/f4/b8a3a568e2b522324537ea8658890120756b380bad35b6d2c1e3b77ea1a1/data_migrator-0.6.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "33aa50bbb941125f56a7861f3a4d7b6d", "sha256": "f1e7f908aaf70c509b0b567281f861047c92c41606e560c09280c1fc817fee11" }, "downloads": -1, "filename": "data-migrator-0.6.2.tar.gz", "has_sig": false, "md5_digest": "33aa50bbb941125f56a7861f3a4d7b6d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 50269, "upload_time": "2017-12-16T19:16:40", "url": "https://files.pythonhosted.org/packages/0d/4f/ec203c44e6f4b0ffcf829961893156c5ae086e6ed1444fd4780384a5a53a/data-migrator-0.6.2.tar.gz" } ], "0.6.3.dev1": [ { "comment_text": "", "digests": { "md5": "e37b9d7e0c64567b81c5501b3d5162a1", "sha256": "784637c7744daf50d08dd6ef4cd55f59ab66be5256e9b70ff911b2ece0ce8554" }, "downloads": -1, "filename": "data_migrator-0.6.3.dev1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "e37b9d7e0c64567b81c5501b3d5162a1", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 37355, "upload_time": "2018-01-08T07:18:57", "url": "https://files.pythonhosted.org/packages/24/a5/d8b104bdfc9771aa63d2a5c66d50fb7f4536410fc755942ff6c3029ff26b/data_migrator-0.6.3.dev1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "8ee4b75d15f023486ca501704a082208", "sha256": "34bcba3f6dc530ce1978dd3dfdf18a4dc71113e0a04c836dab624df150646fcf" }, "downloads": -1, "filename": "data-migrator-0.6.3.dev1.tar.gz", "has_sig": false, "md5_digest": "8ee4b75d15f023486ca501704a082208", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 50358, "upload_time": "2018-01-08T07:19:00", "url": "https://files.pythonhosted.org/packages/61/bf/2fb923a978f0c142ea71646425e2fded24ebd8b928210685aae346f009ca/data-migrator-0.6.3.dev1.tar.gz" } ], "0.6.3.dev2": [ { "comment_text": "", "digests": { "md5": "356aa802b73680422784e18a8e05cf04", "sha256": "337d3696ffc7f4a6f130cc7dba2c2aae024fd7e133b362c4f92e3d4510493f93" }, "downloads": -1, "filename": "data_migrator-0.6.3.dev2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "356aa802b73680422784e18a8e05cf04", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 37403, "upload_time": "2018-02-10T19:57:19", "url": "https://files.pythonhosted.org/packages/ba/58/457bfae7c120551ed7b0e5601ef9a62c096caa6a409e06dc11b56ee54f75/data_migrator-0.6.3.dev2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "3bee04989647a238efbf2870f6bcbb75", "sha256": "be2d76d7b5c8ef7873e402d34e3d00482fe98938d306d114aff87e18c2dade8e" }, "downloads": -1, "filename": "data-migrator-0.6.3.dev2.tar.gz", "has_sig": false, "md5_digest": "3bee04989647a238efbf2870f6bcbb75", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 50730, "upload_time": "2018-02-10T19:57:20", "url": "https://files.pythonhosted.org/packages/8a/92/7cc8b931ecd1f0d109b2f719d4791d7b252742f235da2ba92a4694ce1c08/data-migrator-0.6.3.dev2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "8f78836b855fb8e40d05395aa94d2ef0", "sha256": "51063b3ae01e837cf3ee5adbfbf73fb1409cf74f0a97c75ed50de1af8b9cf639" }, "downloads": -1, "filename": "data_migrator-0.6.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "8f78836b855fb8e40d05395aa94d2ef0", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 37250, "upload_time": "2017-12-16T19:16:39", "url": "https://files.pythonhosted.org/packages/66/f4/b8a3a568e2b522324537ea8658890120756b380bad35b6d2c1e3b77ea1a1/data_migrator-0.6.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "33aa50bbb941125f56a7861f3a4d7b6d", "sha256": "f1e7f908aaf70c509b0b567281f861047c92c41606e560c09280c1fc817fee11" }, "downloads": -1, "filename": "data-migrator-0.6.2.tar.gz", "has_sig": false, "md5_digest": "33aa50bbb941125f56a7861f3a4d7b6d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 50269, "upload_time": "2017-12-16T19:16:40", "url": "https://files.pythonhosted.org/packages/0d/4f/ec203c44e6f4b0ffcf829961893156c5ae086e6ed1444fd4780384a5a53a/data-migrator-0.6.2.tar.gz" } ] }