{ "info": { "author": "bars", "author_email": "barslmn@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 3", "Topic :: Software Development :: Build Tools" ], "description": "# Pigeon\n\n## Introduction\nTool for pipeing inputs and outputs of multiple cli tools.\nPigeon takes in only a config file as input. Everything required to run the pipeline are specified in config file. The config file is specified according to [python configparser](https://docs.python.org/3.4/library/configparser.html).\n\n## Quick Install\n#### Linux&Mac \n\n> sudo pip3 install --index-url https://test.pypi.org/simple/ pigeon\n\n#### Windows \n\n> pip install --index-url https://test.pypi.org/simple/ pigeon\n\n## Resources for NGS\nNone of the tools or data files are supplemented by pigeon so they need to be downloaded.\nFor example configuration file, exome sequencing pipeline,\n\n* Tools\n + [FastQC](https://www.bioinformatics.babraham.ac.uk/projects/fastqc/)\n + [BWA](https://github.com/lh3/bwa)\n + [Picard](https://broadinstitute.github.io/picard/)\n + [GATK](https://software.broadinstitute.org/gatk/)\n + [Annotation Tool](https://test.pypi.org/project/dove/)\n* Reference Files\n + [Reference genome and known SNP&INDELS](https://software.broadinstitute.org/gatk/download/bundle)\n * hg19 or\n * hg38\n + Bed file\n * See website of capture kit used in sequencing\n\n## How to use\nCreate yourself a configuration file\n\n> pigeon createconfig\n\nModify for your analysis. (See below.)\n\n> pigeon -c my_config.conf -d\n\nIf everything looks alright run for real.\n\n> pigeon -c my_config.conf\n\n## Config File\n\nConfig file consists of three parts.\n\n* General\n* Pipeline\n* Individual tool blocks\n\n## General\nArea used to define project name, output directory, input files, and resource files like reference genome or target file. Following variables are necessary for run.\n\nRequired:\n\n* project_name : name of your project\n* output_dir : where to write output files\n* input_files : input files for analysis, space separated, pairs should be next to each other. e.g.\n\n > input_files = A.txt B.txt C.txt \n\n or for paired \n\n > input_files = A1.txt A2.txt B1.txt B2.txt C1.txt C2.txt\n\nOptional variable can also be decleared here. Based on your or tool requirements. Later these variables can be called in the config file using ${GENERAL:optional_variable}.\n\nOptional(example): \n\n> reference_genome = /path/to/my/reference_genome.fa\n\n> bed_file = /path/to/my/target.bed\n\n> known_snp = /path/to/my/snp.vcf\n\n> my_database = /path/to/my/favorite.db\n\n## Pipeline\nThis area should contain paths to tools that is understanble by your shell. As well as the run order of tools. e.g.\n\n> pipeline = job1 job2 job3\n\n> A = path/to/A\n\n> B = path/to/B\n\n> C = path/to/C\n\n## Tool Blocks\nName of the block should be same as in **pipeline**. By continuing example above;\n\n> [job1]\n\n> [job2]\n\n> [job3]\n\nArguments that can be used in these blocks as follows:\n\n#### Run Args\n\n* tool: tool variable from pipeline block. e.g.\n\n > tool = ${PIPELINE:A}\n\n* sub_tool: if tool has a sub tool like 'bwa mem'. e.g.\n\n > sub_tool = mem\n\n* args: arguments of the tools\n* java: if tool is a jar file add java -jar before it.\n* pass: if True it won't run the block. But the block still be part of the pipeline. This option is helpful for resuming interrupted pipeline.\n\n#### Input Args\n* input_from: Name of the block that that's output is this jobs input. First jobs input_from should be input_files.\n* input_multi: can be 'paired' or 'all'. Paired option splits input files stream into groups of two. All option uses all of the input files.\n* input_flag_repeat: If tool requires input flag for each input this command will add given flag before each input.\n\n* secondary_in_placeholder\n\n#### Output Args\n\n* suffix: add suffix to output file name\n* ext: file extension of the output\n* dump_dir: creates a directory and outputs there.\n\n* paired_output: this option will pair the input and the output of the tool.\n\n* secondary_out_placeholder\n* secondary_suffix\n* secondary_ext\n* secondary_dump_dir\n\n#### Placeholders\nThese are joker words that can be used in **args**. \n\n* input_placeholder\n* secondary_input_placeholder\n\n* output_placeholder\n* secondary_output_placeholder\n\n### Example Config\n\n> [[GENERAL]] \n> project_name = my_project \n> output_dir = /path/to/output_directory \n> input_files = A.txt B.txt C.txt \n> my_db = /path/to/my.db \n\n> [[PIPELINE]] \n> pipeline = job1 job2 job3 \n> A = /path/to/A \n> B = /path/to/B \n> C = /path/to/C \n\n> [job1] \n> tool = A \n> input_from = input_files \n> args = -i input_placeholder -o output_placeholder \n> suffix = job1_A \n> ext = txt \n\n> [job2] \n> tool = B \n> input_from = job1 \n> args = -i input_placeholder -o output_placeholder \n> suffix = job2_B \n> ext = txt \n\n> [job3] \n> tool = C \n> input_from = job2 \n> args = -i input_placeholder -o output_placeholder \n> suffix = job3_C \n> ext = txt \n\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "", "keywords": "genomics next generation sequencing pipeline variant discovery clinical genetics", "license": "", "maintainer": "", "maintainer_email": "", "name": "seq-pigeon", "package_url": "https://pypi.org/project/seq-pigeon/", "platform": "", "project_url": "https://pypi.org/project/seq-pigeon/", "project_urls": null, "release_url": "https://pypi.org/project/seq-pigeon/0.3.8/", "requires_dist": null, "requires_python": "", "summary": "Pipeline tool for NGS data", "version": "0.3.8" }, "last_serial": 5144867, "releases": { "0.2.6": [ { "comment_text": "", "digests": { "md5": "8bf94c85d9c7ceb0ec58b001aab6d155", "sha256": "9a305019bff8493cd77bac42cc8252ab173fa90470d416de89360f0b9d37dbd8" }, "downloads": -1, "filename": "seq_pigeon-0.2.6-py3-none-any.whl", "has_sig": false, "md5_digest": "8bf94c85d9c7ceb0ec58b001aab6d155", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 14974, "upload_time": "2018-11-06T00:18:36", "url": "https://files.pythonhosted.org/packages/03/ae/9616ecc5db3c0da254ca8acfc81bfb585ce36728c56724f461ae485b047a/seq_pigeon-0.2.6-py3-none-any.whl" } ], "0.2.8": [ { "comment_text": "", "digests": { "md5": "b6bda12d6a1999974fedbc74b097c5fa", "sha256": "af329d271ca278a914f515530b59146f928c3556a207abc2446bee9c0f10e77a" }, "downloads": -1, "filename": "seq_pigeon-0.2.8-py3-none-any.whl", "has_sig": false, "md5_digest": "b6bda12d6a1999974fedbc74b097c5fa", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 14974, "upload_time": "2018-11-28T13:40:27", "url": "https://files.pythonhosted.org/packages/d5/36/0751611931b4b4fcef5a3332e70523b3f1ca2e0952e72b5234d49362cfe9/seq_pigeon-0.2.8-py3-none-any.whl" } ], "0.2.9": [ { "comment_text": "", "digests": { "md5": "79fdf9feee22d876cf8912ab40f56cb2", "sha256": "5feb02454c6f40d8f027185f010956ca533dde4e4b4fa73a57be6714e926d958" }, "downloads": -1, "filename": "seq_pigeon-0.2.9-py3-none-any.whl", "has_sig": false, "md5_digest": "79fdf9feee22d876cf8912ab40f56cb2", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 14990, "upload_time": "2018-12-05T09:56:16", "url": "https://files.pythonhosted.org/packages/67/1a/f0483f2c0602840ff5f2320575545a83eca5599931bc4bb2037d59e12b5c/seq_pigeon-0.2.9-py3-none-any.whl" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "c8f9c26b58cfa111ebb359c541cd3d9e", "sha256": "bc34894c0aba05c44c26d77d2f5884f8b0b45b449c8f91faf8ab624ac7b7fe94" }, "downloads": -1, "filename": "seq_pigeon-0.3.0-py3-none-any.whl", "has_sig": false, "md5_digest": "c8f9c26b58cfa111ebb359c541cd3d9e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 14971, "upload_time": "2019-02-10T02:15:16", "url": "https://files.pythonhosted.org/packages/a5/8b/d1c475c738a93757caf38810c02475c64df6678ac7acbd23fc54aebf6f7f/seq_pigeon-0.3.0-py3-none-any.whl" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "77572c6ab57722ff98670866a32cdc26", "sha256": "88feb00103dd1a3e147da8971b7780a5d62566751f3c1778eaaa594a86de1a14" }, "downloads": -1, "filename": "seq_pigeon-0.3.1-py3-none-any.whl", "has_sig": false, "md5_digest": "77572c6ab57722ff98670866a32cdc26", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12953, "upload_time": "2019-04-10T13:32:51", "url": "https://files.pythonhosted.org/packages/00/9b/9c1b37cbd30cf47a3599411ef17ee4abebe8af787db65a03129eaf2e42bf/seq_pigeon-0.3.1-py3-none-any.whl" } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "87dd1d33ccce1a175377dc0bd81ad722", "sha256": "bfa8cd0d53f07280035944bb39f3245793d658ab1cdfd0791699ff37def639d3" }, "downloads": -1, "filename": "seq_pigeon-0.3.2-py3-none-any.whl", "has_sig": false, "md5_digest": "87dd1d33ccce1a175377dc0bd81ad722", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12943, "upload_time": "2019-04-10T13:41:18", "url": "https://files.pythonhosted.org/packages/ad/5e/9f9987bbebb7bf0c910e86b66a07054414dd500d9e642e4bc205ecb8857c/seq_pigeon-0.3.2-py3-none-any.whl" } ], "0.3.3": [ { "comment_text": "", "digests": { "md5": "3753d63094f0d59e3b36fee7161aacc3", "sha256": "7bc4b5c7758c6f4c047e495ae22a7f4d93f1b6475b1cb5bf32bab6fd0e4fdb2f" }, "downloads": -1, "filename": "seq_pigeon-0.3.3-py3-none-any.whl", "has_sig": false, "md5_digest": "3753d63094f0d59e3b36fee7161aacc3", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12979, "upload_time": "2019-04-10T14:10:25", "url": "https://files.pythonhosted.org/packages/ec/d0/5d44b5450ad79c1c6e6752466f7646cf7c69da56110defe4dbb49714a02a/seq_pigeon-0.3.3-py3-none-any.whl" } ], "0.3.4": [ { "comment_text": "", "digests": { "md5": "8b9c873ca9129983df55bf7b92b140ab", "sha256": "293a7f796b249793baf4d6bca2726d418a89815f760a8f3100c1573a9a723362" }, "downloads": -1, "filename": "seq_pigeon-0.3.4-py3-none-any.whl", "has_sig": false, "md5_digest": "8b9c873ca9129983df55bf7b92b140ab", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13462, "upload_time": "2019-04-12T08:27:57", "url": "https://files.pythonhosted.org/packages/93/3b/4466c739f0bb90a17abc202d095065c6d4242c63a47a6942ea54cdd05258/seq_pigeon-0.3.4-py3-none-any.whl" } ], "0.3.5": [ { "comment_text": "", "digests": { "md5": "d4175a671910d2bbdaa02d2e73acb35d", "sha256": "e85d64147b5ab6658522891e4e6f1f3705d255d789413acbb8f5342a73857e7e" }, "downloads": -1, "filename": "seq_pigeon-0.3.5-py3-none-any.whl", "has_sig": false, "md5_digest": "d4175a671910d2bbdaa02d2e73acb35d", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13463, "upload_time": "2019-04-12T08:32:59", "url": "https://files.pythonhosted.org/packages/04/30/81d6458dc058b857b5625c923c60c2ddb0ba9da049d3ccafb782866da61e/seq_pigeon-0.3.5-py3-none-any.whl" } ], "0.3.6": [ { "comment_text": "", "digests": { "md5": "edd7a9fe4c660775246ff592c632e708", "sha256": "5a65e1ae67f023adf9bfa38341bbb139f58b2e38d381bff26e02c221314e0c4e" }, "downloads": -1, "filename": "seq_pigeon-0.3.6-py3-none-any.whl", "has_sig": false, "md5_digest": "edd7a9fe4c660775246ff592c632e708", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13510, "upload_time": "2019-04-12T12:08:55", "url": "https://files.pythonhosted.org/packages/2b/4d/45ab9d11f6f187df0f6acbc0c1feefcff4767d22327e88af0131a06f8b6e/seq_pigeon-0.3.6-py3-none-any.whl" } ], "0.3.7": [ { "comment_text": "", "digests": { "md5": "7faf42fda39106c7813aa62d535a37c7", "sha256": "db642fefcff4a405d8ed74abe8d80b2e9fab1055e628aa45a6e2bac5eff22068" }, "downloads": -1, "filename": "seq_pigeon-0.3.7-py3-none-any.whl", "has_sig": false, "md5_digest": "7faf42fda39106c7813aa62d535a37c7", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13599, "upload_time": "2019-04-15T13:41:04", "url": "https://files.pythonhosted.org/packages/50/b0/4cfd3b77ec8ee4b322e4e8adda95390f9b736d4eac4a03e755b76de34bfc/seq_pigeon-0.3.7-py3-none-any.whl" } ], "0.3.8": [ { "comment_text": "", "digests": { "md5": "67bbeb1e355a963e25cad3f888c83a27", "sha256": "97ee188a5ec331769dc6af50d64216b310d21e2d7a915d5226445e4bcc2512c6" }, "downloads": -1, "filename": "seq_pigeon-0.3.8-py3-none-any.whl", "has_sig": false, "md5_digest": "67bbeb1e355a963e25cad3f888c83a27", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13598, "upload_time": "2019-04-15T13:51:00", "url": "https://files.pythonhosted.org/packages/19/a2/d07d9b5c82ca86e9052df0a54bc61434b2bfa2d6fa715894a79a0ec4678c/seq_pigeon-0.3.8-py3-none-any.whl" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "67bbeb1e355a963e25cad3f888c83a27", "sha256": "97ee188a5ec331769dc6af50d64216b310d21e2d7a915d5226445e4bcc2512c6" }, "downloads": -1, "filename": "seq_pigeon-0.3.8-py3-none-any.whl", "has_sig": false, "md5_digest": "67bbeb1e355a963e25cad3f888c83a27", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 13598, "upload_time": "2019-04-15T13:51:00", "url": "https://files.pythonhosted.org/packages/19/a2/d07d9b5c82ca86e9052df0a54bc61434b2bfa2d6fa715894a79a0ec4678c/seq_pigeon-0.3.8-py3-none-any.whl" } ] }