{
"info": {
"author": "NL Healthcare (NLHC), Henk-Jan van Reenen",
"author_email": "henk-jan.van.reenen@nlhealthcareclinics.com",
"bugtrack_url": null,
"classifiers": [
"Development Status :: 3 - Alpha",
"Intended Audience :: Developers",
"Intended Audience :: Healthcare Industry",
"Intended Audience :: Science/Research",
"License :: OSI Approved :: GNU Lesser General Public License v3 or later (LGPLv3+)",
"Natural Language :: Dutch",
"Operating System :: POSIX :: Linux",
"Topic :: Software Development :: Libraries :: Python Modules"
],
"description": "PYELT\r\n=====\r\n\r\n\r\nUsage\r\n^^^^^\r\n\r\nThis example will create and fill the historical staging area::\r\n\r\n pipeline = Pipeline(config)\r\n pipe = pipeline.get_or_create_pipe('test_source', source_config)\r\n\r\n source_file = CsvFile(get_root_path() + '/sample_data/patienten1.csv', delimiter=';')\r\n source_file.reflect()\r\n source_file.set_primary_key(['patientnummer'])\r\n mapping = SourceToSorMapping(source_file, 'persoon_hstage', auto_map=True)\r\n pipe.mappings.append(mapping)\r\n\r\n pipeline.run()\r\n \r\nMore examples can be found on `the GitHub repository of NL Healthcare `_.\r\n\r\n\r\nIntroduction\r\n^^^^^^^^^^^^\r\n\r\nPyelt is a Python DDL and ETL framework for **creating and loading Data Vaults** for datawarehousing.\r\n\r\nPyelt supports **several data-layers**, including Source-of-Record (SOR), Raw datavault (RDV), Business datavault (BDV) and Datamarts (DM) \r\n\r\nPyelt can import data from several **different source systems** such as fixed length files, csv-files, and different databases.\r\n\r\nPyelt is developed to run on a **postgreSQL database**.\r\n\r\nPyelt uses the SQLAlchemy.core only for the connection and for reflection. All other SQL statements (ddl, copy, insert and update statements) are created by the pyelt framework itself.\r\n\r\n**Write your own mappings** to transfer and transform data from sources via staging into the data ware house.\r\n\r\nContent \r\n----------------------------\r\n\r\n(`current documentation on pythonhosted `_ is only in dutch):\r\n\r\n- `concepts `_\r\n- `config `_\r\n- `pipeline `_\r\n- `domain `_\r\n- `mappings `_\r\n- `run proces `_\r\n\r\nwork in progress:\r\n\r\n- api docs (https://github.com/NLHEALTHCARE/PYELT/tree/master/docs/source/09api.rst/>_\r\n\r\n\r\n\r\nBackground\r\n^^^^^^^^^^\r\nThe pyelt framework is presently under development at NL Healthcare, with the aim to implement our next-generation datawarehouse (DWH2.0). It serves as the foundation for our work in the area of clinical business intelligence (CBI) and machine-learning.\r\n\r\nArchitectural cornerstones of this project are:\r\n\r\n- the Data Vault (DV) design pattern of `Hans Hultgren `_ \r\n- Domain-specific modelling of the DV, following `HL7 v3 Reference Information Model `_ and the Dutch Detailed Clinical Model `Zorginformatiebouwstenen `_ (in Dutch).",
"description_content_type": null,
"docs_url": "https://pythonhosted.org/pyelt/",
"download_url": "https://github.com/NLHEALTHCARE/PYELT.git",
"downloads": {
"last_day": -1,
"last_month": -1,
"last_week": -1
},
"home_page": "https://github.com/NLHEALTHCARE/PYELT",
"keywords": "datavault, datawarehouse, ETL, ELT, healthcare, domain model",
"license": "LGPL3",
"maintainer": "Daniel Kapitan",
"maintainer_email": "daniel@kapitan.net",
"name": "pyelt",
"package_url": "https://pypi.org/project/pyelt/",
"platform": "",
"project_url": "https://pypi.org/project/pyelt/",
"project_urls": {
"Download": "https://github.com/NLHEALTHCARE/PYELT.git",
"Homepage": "https://github.com/NLHEALTHCARE/PYELT"
},
"release_url": "https://pypi.org/project/pyelt/0.9.4.6a0/",
"requires_dist": null,
"requires_python": "",
"summary": "Pyelt is a DDL and ETL framework for creating and filling data vault datawarehouses on a postgress database.",
"version": "0.9.4.6a0"
},
"last_serial": 2370489,
"releases": {
"0.9.4.5a0": [
{
"comment_text": "",
"digests": {
"md5": "83a32ca92d07d25efb4ecec2933089d5",
"sha256": "33ec9fb6e15c7d723c3455fd1842d3c87b31fc0372cb20d25453aae2efa1db1d"
},
"downloads": -1,
"filename": "pyelt-0.9.4.5a0.zip",
"has_sig": false,
"md5_digest": "83a32ca92d07d25efb4ecec2933089d5",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 71020,
"upload_time": "2016-09-15T13:06:24",
"url": "https://files.pythonhosted.org/packages/8f/ba/ed89de774fb1660c36d75b3262344a417a173c7d13cae9e96cc005697405/pyelt-0.9.4.5a0.zip"
}
],
"0.9.4.6a0": [
{
"comment_text": "",
"digests": {
"md5": "bba2caf36e9360ff28681226db0c05b5",
"sha256": "862b0951210329ee83f5a689cb17cc163ff996bc8184206b3736229087425910"
},
"downloads": -1,
"filename": "pyelt-0.9.4.6a0.zip",
"has_sig": false,
"md5_digest": "bba2caf36e9360ff28681226db0c05b5",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 71227,
"upload_time": "2016-09-16T07:46:36",
"url": "https://files.pythonhosted.org/packages/e0/30/3b41d481628374423ff7a4bcbb84672696bcfaded3eec214b41e0177fb90/pyelt-0.9.4.6a0.zip"
}
]
},
"urls": [
{
"comment_text": "",
"digests": {
"md5": "bba2caf36e9360ff28681226db0c05b5",
"sha256": "862b0951210329ee83f5a689cb17cc163ff996bc8184206b3736229087425910"
},
"downloads": -1,
"filename": "pyelt-0.9.4.6a0.zip",
"has_sig": false,
"md5_digest": "bba2caf36e9360ff28681226db0c05b5",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 71227,
"upload_time": "2016-09-16T07:46:36",
"url": "https://files.pythonhosted.org/packages/e0/30/3b41d481628374423ff7a4bcbb84672696bcfaded3eec214b41e0177fb90/pyelt-0.9.4.6a0.zip"
}
]
}