{ "info": { "author": "Jesse Brennan", "author_email": "brennan@ucsc.edu", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Intended Audience :: Science/Research", "License :: OSI Approved :: Apache Software License", "Natural Language :: English", "Programming Language :: Python :: 3.6", "Topic :: Scientific/Engineering :: Bio-Informatics" ], "description": "# newt-transformer\n[![Build Status](https://travis-ci.org/DataBiosphere/newt-transformer.svg?branch=master)](https://travis-ci.org/DataBiosphere/newt-transformer)\n\nMetadata transformer to convert from gen3 to something readable by \ncgp-dss-data-loader\n\n## Common Setup\n\n1. **(optional)** We recommend using a Python 3\n [virtual environment](https://docs.python.org/3/tutorial/venv.html).\n\n1. Run:\n\n `pip3 install newt-transformer`\n\n## Setup for Development\n1. Clone the repo:\n\n `git clone https://github.com/jessebrennan/newt-transformer.git`\n\n1. Go to the root directory of the cloned project:\n\n `cd newt-transformer`\n\n1. Run (ideally in a new [virtual environment](https://docs.python.org/3/tutorial/venv.html)):\n\n `make develop`\n\n## Running Tests\n1. make sure you followed Setup for Development\n\n1. Run:\n\n `make test`\n\n## Transforming data from sheepdog-exporter\n1. The first step is to extract the Gen3 data you want using the\n[sheepdog exporter](https://github.com/david4096/sheepdog-exporter). The TopMed public data extracted\nfrom sheepdog is available [on the release page](https://github.com/david4096/sheepdog-exporter/releases/tag/0.3.1)\nunder Assets. Assuming you use this data, you will now have a file called `topmed-public.json`\n\n1. Make sure you are running the virtual environment you set up in the **Setup** instructions.\n\n1. Now we need to transform the data. From the root of the project run:\n\n `newt new /path/to/topmed-public.json --output-json transformed-topmed-public.json`\n\n This will generate a transformed output file called `transformed-topmed-public.json`.\n\n The `new` argument specifies that we want the most recent version of the transformer output format.\n It can be replaced with a `gen3` argument, but this older format will soon be deprecated.\n\n1. Likely you want to upload this data to the DSS. Instructions for this can be found at\n [the DSS data loader repo](https://github.com/DataBiosphere/cgp-dss-data-loader).\n\n## Transformer Architecture\n![see github for details](diagrams/newt-architecture.svg)", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/DataBiosphere/newt-transformer", "keywords": "genomics,metadata,NIHDataCommons", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "newt-transformer", "package_url": "https://pypi.org/project/newt-transformer/", "platform": "", "project_url": "https://pypi.org/project/newt-transformer/", "project_urls": { "Homepage": "https://github.com/DataBiosphere/newt-transformer" }, "release_url": "https://pypi.org/project/newt-transformer/0.1.7/", "requires_dist": null, "requires_python": "", "summary": "Amphibious new data transformer to prepare various sources for CGP DSS Data Loader", "version": "0.1.7" }, "last_serial": 4016265, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "ed0694a555c1e253322380d22f2413de", "sha256": "95220f32fc61b877547e6dfb073dd045257c61ebc14d1341c3146f75f63c6735" }, "downloads": -1, "filename": "newt-transformer-0.1.0.tar.gz", "has_sig": false, "md5_digest": "ed0694a555c1e253322380d22f2413de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8059, "upload_time": "2018-06-28T18:57:53", "url": "https://files.pythonhosted.org/packages/fd/9d/6e9f2ca2474c7e251e432f6eee0c43dbcd1981a7e728115712e7ea4c0653/newt-transformer-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "6173d848a21b906e6e4f935dd2d1e6ba", "sha256": "4f47390c0284146222a842e22899c8fb919853cf0fe7d33fb1cc298176c6789e" }, "downloads": -1, "filename": "newt-transformer-0.1.1.tar.gz", "has_sig": false, "md5_digest": "6173d848a21b906e6e4f935dd2d1e6ba", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8066, "upload_time": "2018-06-28T19:27:41", "url": "https://files.pythonhosted.org/packages/9f/dc/9f614ae983caf75ae45129d4b5a4021e8a241a351be9cfce895611c13a22/newt-transformer-0.1.1.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "a638b074bab81d6bf0034ae22fe6b9ec", "sha256": "7906599565ed005423441f366c3e2c2d1f5f1572b19c80daec96e8974f7b181c" }, "downloads": -1, "filename": "newt-transformer-0.1.3.tar.gz", "has_sig": false, "md5_digest": "a638b074bab81d6bf0034ae22fe6b9ec", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8083, "upload_time": "2018-06-28T21:22:50", "url": "https://files.pythonhosted.org/packages/8b/94/b11d77260211c077d2cab95c63c704cd1da69f3525a91003b09b93691e53/newt-transformer-0.1.3.tar.gz" } ], "0.1.4": [ { "comment_text": "", "digests": { "md5": "e59eefc8d5f0f77539556f38889ea292", "sha256": "564f8050ff66be46b1f45e0a4357aa2880cf4447b7ef561ae96ca828eb001ebe" }, "downloads": -1, "filename": "newt-transformer-0.1.4.tar.gz", "has_sig": false, "md5_digest": "e59eefc8d5f0f77539556f38889ea292", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10980, "upload_time": "2018-06-28T22:14:33", "url": "https://files.pythonhosted.org/packages/a7/26/6773db53dc2aea5fc20f6e8087e71d75a8d1eab7f002b62c787aad1d45d6/newt-transformer-0.1.4.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "8c188afa98e8e1f37e7424248b439644", "sha256": "c9f89bc7bc8c9139b043a441e12225844a922c9651791f010ff6c5c186a12baa" }, "downloads": -1, "filename": "newt-transformer-0.1.5.tar.gz", "has_sig": false, "md5_digest": "8c188afa98e8e1f37e7424248b439644", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11742, "upload_time": "2018-06-28T22:44:56", "url": "https://files.pythonhosted.org/packages/2a/9b/19da317078e41ca986b3154011b3c5b5900f46f5476521b70f5beeb1980d/newt-transformer-0.1.5.tar.gz" } ], "0.1.6": [ { "comment_text": "", "digests": { "md5": "91a314908c3c5d59a22d94f580ea32de", "sha256": "ecdfb937132827366f18016d35f7aa17662af82d8f295edb72fe534b3d70825b" }, "downloads": -1, "filename": "newt-transformer-0.1.6.tar.gz", "has_sig": false, "md5_digest": "91a314908c3c5d59a22d94f580ea32de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11798, "upload_time": "2018-06-28T23:29:16", "url": "https://files.pythonhosted.org/packages/eb/3d/112ec1b47bd94e134b3b0aa29e3233edfbc2fbe181a030500abead80fc46/newt-transformer-0.1.6.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "58764d8448e9addc8736de34e8b096e6", "sha256": "85e2dad8ace31b747a570311619f5025cbb5daf3b4c93a76967819fa51cf1749" }, "downloads": -1, "filename": "newt-transformer-0.1.7.tar.gz", "has_sig": false, "md5_digest": "58764d8448e9addc8736de34e8b096e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11798, "upload_time": "2018-06-29T18:13:38", "url": "https://files.pythonhosted.org/packages/a4/a0/92d4788855e8edc13ccbfa39fbd22aa84a4fca7c58eca4ebb0aa2b46dbd1/newt-transformer-0.1.7.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "58764d8448e9addc8736de34e8b096e6", "sha256": "85e2dad8ace31b747a570311619f5025cbb5daf3b4c93a76967819fa51cf1749" }, "downloads": -1, "filename": "newt-transformer-0.1.7.tar.gz", "has_sig": false, "md5_digest": "58764d8448e9addc8736de34e8b096e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11798, "upload_time": "2018-06-29T18:13:38", "url": "https://files.pythonhosted.org/packages/a4/a0/92d4788855e8edc13ccbfa39fbd22aa84a4fca7c58eca4ebb0aa2b46dbd1/newt-transformer-0.1.7.tar.gz" } ] }