{ "info": { "author": "NL Healthcare (NLHC), Henk-Jan van Reenen", "author_email": "henk-jan.van.reenen@nlhealthcareclinics.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Intended Audience :: Developers", "Intended Audience :: Healthcare Industry", "Intended Audience :: Science/Research", "License :: OSI Approved :: GNU Lesser General Public License v3 or later (LGPLv3+)", "Natural Language :: Dutch", "Operating System :: POSIX :: Linux", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "PYELT\r\n=====\r\n\r\n\r\nUsage\r\n^^^^^\r\n\r\nThis example will create and fill the historical staging area::\r\n\r\n pipeline = Pipeline(config)\r\n pipe = pipeline.get_or_create_pipe('test_source', source_config)\r\n\r\n source_file = CsvFile(get_root_path() + '/sample_data/patienten1.csv', delimiter=';')\r\n source_file.reflect()\r\n source_file.set_primary_key(['patientnummer'])\r\n mapping = SourceToSorMapping(source_file, 'persoon_hstage', auto_map=True)\r\n pipe.mappings.append(mapping)\r\n\r\n pipeline.run()\r\n \r\nMore examples can be found on `the GitHub repository of NL Healthcare `_.\r\n\r\n\r\nIntroduction\r\n^^^^^^^^^^^^\r\n\r\nPyelt is a Python DDL and ETL framework for **creating and loading Data Vaults** for datawarehousing.\r\n\r\nPyelt supports **several data-layers**, including Source-of-Record (SOR), Raw datavault (RDV), Business datavault (BDV) and Datamarts (DM) \r\n\r\nPyelt can import data from several **different source systems** such as fixed length files, csv-files, and different databases.\r\n\r\nPyelt is developed to run on a **postgreSQL database**.\r\n\r\nPyelt uses the SQLAlchemy.core only for the connection and for reflection. All other SQL statements (ddl, copy, insert and update statements) are created by the pyelt framework itself.\r\n\r\n**Write your own mappings** to transfer and transform data from sources via staging into the data ware house.\r\n\r\nContent \r\n----------------------------\r\n\r\n(`current documentation on pythonhosted `_ is only in dutch):\r\n\r\n- `concepts `_\r\n- `config `_\r\n- `pipeline `_\r\n- `domain `_\r\n- `mappings `_\r\n- `run proces `_\r\n\r\nwork in progress:\r\n\r\n- api docs (https://github.com/NLHEALTHCARE/PYELT/tree/master/docs/source/09api.rst/>_\r\n\r\n\r\n\r\nBackground\r\n^^^^^^^^^^\r\nThe pyelt framework is presently under development at NL Healthcare, with the aim to implement our next-generation datawarehouse (DWH2.0). It serves as the foundation for our work in the area of clinical business intelligence (CBI) and machine-learning.\r\n\r\nArchitectural cornerstones of this project are:\r\n\r\n- the Data Vault (DV) design pattern of `Hans Hultgren `_ \r\n- Domain-specific modelling of the DV, following `HL7 v3 Reference Information Model `_ and the Dutch Detailed Clinical Model `Zorginformatiebouwstenen `_ (in Dutch).", "description_content_type": null, "docs_url": "https://pythonhosted.org/pyelt/", "download_url": "https://github.com/NLHEALTHCARE/PYELT.git", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/NLHEALTHCARE/PYELT", "keywords": "datavault, datawarehouse, ETL, ELT, healthcare, domain model", "license": "LGPL3", "maintainer": "Daniel Kapitan", "maintainer_email": "daniel@kapitan.net", "name": "pyelt", "package_url": "https://pypi.org/project/pyelt/", "platform": "", "project_url": "https://pypi.org/project/pyelt/", "project_urls": { "Download": "https://github.com/NLHEALTHCARE/PYELT.git", "Homepage": "https://github.com/NLHEALTHCARE/PYELT" }, "release_url": "https://pypi.org/project/pyelt/0.9.4.6a0/", "requires_dist": null, "requires_python": "", "summary": "Pyelt is a DDL and ETL framework for creating and filling data vault datawarehouses on a postgress database.", "version": "0.9.4.6a0" }, "last_serial": 2370489, "releases": { "0.9.4.5a0": [ { "comment_text": "", "digests": { "md5": "83a32ca92d07d25efb4ecec2933089d5", "sha256": "33ec9fb6e15c7d723c3455fd1842d3c87b31fc0372cb20d25453aae2efa1db1d" }, "downloads": -1, "filename": "pyelt-0.9.4.5a0.zip", "has_sig": false, "md5_digest": "83a32ca92d07d25efb4ecec2933089d5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 71020, "upload_time": "2016-09-15T13:06:24", "url": "https://files.pythonhosted.org/packages/8f/ba/ed89de774fb1660c36d75b3262344a417a173c7d13cae9e96cc005697405/pyelt-0.9.4.5a0.zip" } ], "0.9.4.6a0": [ { "comment_text": "", "digests": { "md5": "bba2caf36e9360ff28681226db0c05b5", "sha256": "862b0951210329ee83f5a689cb17cc163ff996bc8184206b3736229087425910" }, "downloads": -1, "filename": "pyelt-0.9.4.6a0.zip", "has_sig": false, "md5_digest": "bba2caf36e9360ff28681226db0c05b5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 71227, "upload_time": "2016-09-16T07:46:36", "url": "https://files.pythonhosted.org/packages/e0/30/3b41d481628374423ff7a4bcbb84672696bcfaded3eec214b41e0177fb90/pyelt-0.9.4.6a0.zip" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "bba2caf36e9360ff28681226db0c05b5", "sha256": "862b0951210329ee83f5a689cb17cc163ff996bc8184206b3736229087425910" }, "downloads": -1, "filename": "pyelt-0.9.4.6a0.zip", "has_sig": false, "md5_digest": "bba2caf36e9360ff28681226db0c05b5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 71227, "upload_time": "2016-09-16T07:46:36", "url": "https://files.pythonhosted.org/packages/e0/30/3b41d481628374423ff7a4bcbb84672696bcfaded3eec214b41e0177fb90/pyelt-0.9.4.6a0.zip" } ] }