{ "info": { "author": "Jingpeng Wu", "author_email": "jingpeng.wu@gmail.com", "bugtrack_url": null, "classifiers": [ "Environment :: Console", "Intended Audience :: Developers", "Intended Audience :: End Users/Desktop", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7" ], "description": "chunkflow \n----------------------\n[![Documentation Status](https://readthedocs.org/projects/pychunkflow/badge/?version=latest)](https://pychunkflow.readthedocs.io/en/latest/?badge=latest)\n[![Build Status](https://travis-ci.org/seung-lab/chunkflow.svg?branch=master)](https://travis-ci.org/seung-lab/chunkflow)\n[![PyPI version](https://badge.fury.io/py/chunkflow.svg)](https://badge.fury.io/py/chunkflow)\n[![Coverage Status](https://coveralls.io/repos/github/seung-lab/chunkflow/badge.svg?branch=master)](https://coveralls.io/github/seung-lab/chunkflow?branch=master)\n[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\n\nPerform Convolutional net inference to segment 3D image volume with one single command!\n\n```shell\nchunkflow read-tif --file-name path/of/image.tif -o image inference --convnet-model path/of/model.py --convnet-weight-path path/of/weight.pt --patch-size 20 256 256 --patch-overlap 4 64 64 --num-output-channels 3 -f pytorch --batch-size 12 --mask-output-chunk -i image -o affs write-h5 -i affs --file-name affs.h5 agglomerate --threshold 0.7 --aff-threshold-low 0.001 --aff-threshold-high 0.9999 -i affs -o seg write-tif -i seg -f seg.tif neuroglancer -c image,affs,seg -p 33333 -v 30 6 6\n```\nyou can see your 3D image and segmentation in [Neuroglancer](https://github.com/google/neuroglancer)!\n\n![Image_Segmentation](https://github.com/seung-lab/chunkflow/blob/master/docs/source/_static/image/image_seg.png)\n\n\n\n## Features\n- **Composable** operators. The chunk operators could be freely composed in commandline for flexible usage.\n- **Hybrid Cloud Distributed** computation in both local and cloud computers. The task scheduling frontend and computationally heavy backend are decoupled using AWS Simple Queue Service. The computational heavy backend could be any computer with internet connection and Amazon Web Services (AWS) authentication.\n- All operations support **3D** image volumes.\n\n## Available Operators\nAfter installation, You can simply type `chunkflow` and it will list all the operators with help message. We list the available operators here. We keep adding new operators and will keep it update here. For the detailed usage, please checkout our [Documentation](https://pychunkflow.readthedocs.io/en/latest/).\n\n| Operator Name | Function |\n| --------------- | -------- |\n| agglomerate | Watershed and agglomeration to segment affinity map |\n| cloud-watch | Realtime speedometer in AWS CloudWatch |\n| connected-components | Threshold the boundary map to get a segmentation |\n| copy-var | Copy a variable to a new name |\n| create-chunk | Create a fake chunk for easy test |\n| crop-margin | Crop the margin of a chunk |\n| custom-operator | Import local code as a customized operator |\n| cutout | Cutout chunk from a local/cloud storage volume |\n| delete-task-in-queue | Delete the task in AWS SQS queue |\n| downsample-upload | Downsample the chunk hierarchically and upload to volume |\n| evaluate-segmentation | Compare segmentation chunks |\n| fetch-task | Fetch task from AWS SQS queue one by one |\n| generate-tasks | Generate tasks one by one |\n| inference | Convolutional net inference |\n| log-summary | Summary of logs |\n| mask | Black out the chunk based on another mask chunk |\n| mesh | Build 3D meshes from segmentation chunk |\n| mesh-manifest | Collect mesh fragments for object |\n| neuroglancer | Visualize chunks using neuroglancer |\n| normalize-section-contrast | Normalize image contrast |\n| normalize-section-shang | Normalization algorithm created by Shang |\n| quantize | Quantize the affinity map |\n| read-h5 | Read HDF5 files |\n| read-tif | Read TIFF files |\n| save | Save chunk to local/cloud storage volume |\n| save-pngs | Save chunk as a serials of png files |\n| view | Another chunk viewer in browser using CloudVolume |\n| write-h5 | Write chunk as HDF5 file |\n| write-tif | Write chunk as TIFF file |\n\n\n## Citation\nIf you used this tool and is writing a paper, please cite this [paper](https://arxiv.org/abs/1904.10489):\n```bibtex\n@article{wu2019chunkflow,\n title={Chunkflow: Distributed Hybrid Cloud Processing of Large 3D Images by Convolutional Nets},\n author={Wu, Jingpeng and Silversmith, William M and Seung, H Sebastian},\n journal={arXiv preprint arXiv:1904.10489},\n year={2019}\n}\n```", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/seung-lab/chunkflow", "keywords": "", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "chunkflow", "package_url": "https://pypi.org/project/chunkflow/", "platform": "", "project_url": "https://pypi.org/project/chunkflow/", "project_urls": { "Homepage": "https://github.com/seung-lab/chunkflow" }, "release_url": "https://pypi.org/project/chunkflow/0.5.6/", "requires_dist": null, "requires_python": ">=3", "summary": "Composable image chunk operators to create pipeline for distributed computation.", "version": "0.5.6" }, "last_serial": 5997618, "releases": { "0.0.2": [ { "comment_text": "", "digests": { "md5": "29e1274533bc9506c1c8a8e4a0ce2f51", "sha256": "2b8b6b00d121858989f805047f270cc2f7f5a2537401434a5615c2a295c2444b" }, "downloads": -1, "filename": "chunkflow-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "29e1274533bc9506c1c8a8e4a0ce2f51", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 22643, "upload_time": "2019-02-11T14:27:05", "url": "https://files.pythonhosted.org/packages/b5/4a/02e00b272c4b754b93d4f69c8b233bf6454e6c2aab599236fc02e9dd377f/chunkflow-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "958d5de73f56187ee262de5b19b4384c", "sha256": "00ba62a18d380cfde0c24461a29a5051c48f91f44ffc106bafd348bdb3eba6af" }, "downloads": -1, "filename": "chunkflow-0.0.2.tar.gz", "has_sig": false, "md5_digest": "958d5de73f56187ee262de5b19b4384c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 14839, "upload_time": "2019-02-11T14:27:07", "url": "https://files.pythonhosted.org/packages/11/95/f6dcc6b620b875037e20373a4cb3895e75c99acd9ff1a615b37b3ac1203a/chunkflow-0.0.2.tar.gz" } ], "0.1.0": [ { "comment_text": "", "digests": { "md5": "1071f7b9ec22ba1594cf5929b0f04f6e", "sha256": "7b2ff2bb88dc3796784d92f03b3b71b341081086c4a318c34386cff107952757" }, "downloads": -1, "filename": "chunkflow-0.1.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "1071f7b9ec22ba1594cf5929b0f04f6e", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 2685, "upload_time": "2019-02-26T14:41:47", "url": "https://files.pythonhosted.org/packages/fe/f2/801ad547a08e94b578fa3c9d54e34bfb1894253cc91caca296c75d43a610/chunkflow-0.1.0-py2.py3-none-any.whl" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "b5904deb77dabecbb3df604f823ebe6f", "sha256": "9e85376b605aecef3eb5360080a2ef41d4598f621c7af0a0082dd45676dbea59" }, "downloads": -1, "filename": "chunkflow-0.1.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "b5904deb77dabecbb3df604f823ebe6f", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 2670, "upload_time": "2019-02-26T21:44:40", "url": "https://files.pythonhosted.org/packages/33/63/d93acfe02f643f1d9c8070bb5705b1ea5a1e989313ea226270c43288ae10/chunkflow-0.1.1-py2.py3-none-any.whl" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "9bee52ee80abc214f596ef80a0739347", "sha256": "1275e49e29c9d40d60eb89b8789785f469b6e2fa7eed6323ddbd56bd176e2958" }, "downloads": -1, "filename": "chunkflow-0.1.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "9bee52ee80abc214f596ef80a0739347", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 2671, "upload_time": "2019-02-26T22:06:04", "url": "https://files.pythonhosted.org/packages/08/04/d31316e716c35345d1b690df1dc2ffbcb8e93d8246634891ad031b80e6d1/chunkflow-0.1.2-py2.py3-none-any.whl" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "a8036a08442e5b3f1de126f2b38bdbcf", "sha256": "c0f4bd47b50f8bf00a75c65675ebbe2ed06042251db6bc45f04b656637413778" }, "downloads": -1, "filename": "chunkflow-0.1.3-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "a8036a08442e5b3f1de126f2b38bdbcf", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6805, "upload_time": "2019-03-01T14:45:10", "url": "https://files.pythonhosted.org/packages/6f/43/7d1cc0782f4834288a872eac1603ee717ded5af55e0b5ce345a64abb0ab8/chunkflow-0.1.3-py2.py3-none-any.whl" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "f501691f8c71d852a33beed3f1517b46", "sha256": "de765cb707b41165c3c383a5cc85e279a5c38a4750f143713e5954a59d839f36" }, "downloads": -1, "filename": "chunkflow-0.2.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "f501691f8c71d852a33beed3f1517b46", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6794, "upload_time": "2019-03-03T14:49:33", "url": "https://files.pythonhosted.org/packages/e1/b5/f5c8947cd0956526339df75bb8bace4b55c7c46b44acfbc34afe35fa1947/chunkflow-0.2.0-py2.py3-none-any.whl" } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "2f11e97718c21f57736371d0906bb2ce", "sha256": "3e8aa74b6b5e7a87bd50a43684fa98ad26dfec0b3685cfb817f82bfd1d759f70" }, "downloads": -1, "filename": "chunkflow-0.2.3-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "2f11e97718c21f57736371d0906bb2ce", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6921, "upload_time": "2019-03-05T15:22:02", "url": "https://files.pythonhosted.org/packages/a4/e0/309c847616462c4ed4ccaf487740a34d2fd33b0d74ff10fdfd4b6b83b7a3/chunkflow-0.2.3-py2.py3-none-any.whl" } ], "0.2.4": [ { "comment_text": "", "digests": { "md5": "38149dfbce4f9f3fd85ea6b57d20f3a2", "sha256": "197f81626a1214dfa3c1047ba09726a5ca6be8ffac98330545e1ddb6f1a36cc4" }, "downloads": -1, "filename": "chunkflow-0.2.4-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "38149dfbce4f9f3fd85ea6b57d20f3a2", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 6922, "upload_time": "2019-03-07T14:11:02", "url": "https://files.pythonhosted.org/packages/cf/00/927ee050389ef5c33c544e5930b019a4b415722e9d0c139e05bfd957ba3a/chunkflow-0.2.4-py2.py3-none-any.whl" } ], "0.2.6": [ { "comment_text": "", "digests": { "md5": "bb09db39003367d895d2cf0b1c79b193", "sha256": "560d1f8025802f376505eae417533d3ecd97dedeb77347b1cf0ba3810a3c8d96" }, "downloads": -1, "filename": "chunkflow-0.2.6-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "bb09db39003367d895d2cf0b1c79b193", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 7203, "upload_time": "2019-03-11T19:51:37", "url": "https://files.pythonhosted.org/packages/d7/77/a9bfd22c13d1d3b97526d9b22750ccdc37f0fe04f9f6db663bb0f5359537/chunkflow-0.2.6-py2.py3-none-any.whl" } ], "0.2.7": [ { "comment_text": "", "digests": { "md5": "99a353a292181ec396d81ee1a49d68bc", "sha256": "81ee2699de1901262d3b62bbdf095613fa7c873945a6a0de0e12f0b1760fc665" }, "downloads": -1, "filename": "chunkflow-0.2.7-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "99a353a292181ec396d81ee1a49d68bc", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 14095, "upload_time": "2019-07-12T16:07:22", "url": "https://files.pythonhosted.org/packages/89/79/0b885eb6a4ae4b47ce11363fa7718749d9b94e2ad1ce30676214989fbb43/chunkflow-0.2.7-py2.py3-none-any.whl" } ], "0.2.8": [ { "comment_text": "", "digests": { "md5": "7b05e5b298935fbf361a1651d6dfad97", "sha256": "24a574023a40489f0ec7472c29a46ef309afcefd8a3c21b8ae9374d0651bb02f" }, "downloads": -1, "filename": "chunkflow-0.2.8-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "7b05e5b298935fbf361a1651d6dfad97", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 14153, "upload_time": "2019-07-12T16:10:37", "url": "https://files.pythonhosted.org/packages/09/6d/245fd049fe668911bf747d97f38752a50bd69d32f423a8af579588ff274b/chunkflow-0.2.8-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "18d5bb6f2e22ea9e35e159de61305534", "sha256": "abd7911e21c707b6192f90d1e7176e1a32a4d369c6daac84be54807d5c57df78" }, "downloads": -1, "filename": "chunkflow-0.2.8.tar.gz", "has_sig": false, "md5_digest": "18d5bb6f2e22ea9e35e159de61305534", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 29630, "upload_time": "2019-07-12T17:39:00", "url": "https://files.pythonhosted.org/packages/d9/57/0126a947a7d1c02bcc3922b74e7981c17151bc11d8a3532a814606f1e326/chunkflow-0.2.8.tar.gz" } ], "0.2.9": [ { "comment_text": "", "digests": { "md5": "17e727226e14faa4e6e2329bc444b4b5", "sha256": "45f906583d00ba8ee1a28286a97b11cf4dcdf12f39fb386a8311840ecf6ab6f4" }, "downloads": -1, "filename": "chunkflow-0.2.9.tar.gz", "has_sig": false, "md5_digest": "17e727226e14faa4e6e2329bc444b4b5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 29637, "upload_time": "2019-07-12T17:40:35", "url": "https://files.pythonhosted.org/packages/d2/19/9d2c8f882aff7112ea46b80cdded4d876f94c3b4ded97c9ec5aed9f29be4/chunkflow-0.2.9.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "46b6ce7f9944158adcb590933e1c416a", "sha256": "4895ad9667d1d6909371afb589c228c1def1eb449690b818a7413a8278826cf1" }, "downloads": -1, "filename": "chunkflow-0.3.0.tar.gz", "has_sig": false, "md5_digest": "46b6ce7f9944158adcb590933e1c416a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 36096, "upload_time": "2019-07-12T17:42:31", "url": "https://files.pythonhosted.org/packages/45/e3/588b04c439c892d29c0911e435a41f269575cd194fda53767a7c27c6f7be/chunkflow-0.3.0.tar.gz" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "b5997296e8a9cbd889d126bb3e539a47", "sha256": "545ea9362c1f57c33a6b6a8c3e3348bb4f8c9aa6a91b6375856e75291fc08eb5" }, "downloads": -1, "filename": "chunkflow-0.3.1.tar.gz", "has_sig": false, "md5_digest": "b5997296e8a9cbd889d126bb3e539a47", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 38224, "upload_time": "2019-07-12T20:27:23", "url": "https://files.pythonhosted.org/packages/12/21/4dc5c5f9f53586b94f208b66f4fa2ba2c6c025204995e2f9303c2fd36944/chunkflow-0.3.1.tar.gz" } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "23794759f83848208578fd0cb09c97a6", "sha256": "b283f31a6cf1c3644ab206af67aa1d892ba8b68dcf547c2e6d267ee632044846" }, "downloads": -1, "filename": "chunkflow-0.3.2.tar.gz", "has_sig": false, "md5_digest": "23794759f83848208578fd0cb09c97a6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 39818, "upload_time": "2019-08-05T22:17:14", "url": "https://files.pythonhosted.org/packages/f1/43/05b00b451e0314f32cdf1fee3f448a4c931a28d7ed74130b79edaa2775b1/chunkflow-0.3.2.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "1c0038c6aec5a0d5ab568fd1bf8728d6", "sha256": "7cca88c64b47c02d84486b424334e2e2eff18656a96049aaa7391be2ab515c07" }, "downloads": -1, "filename": "chunkflow-0.4.0.tar.gz", "has_sig": false, "md5_digest": "1c0038c6aec5a0d5ab568fd1bf8728d6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 45758, "upload_time": "2019-08-10T03:34:38", "url": "https://files.pythonhosted.org/packages/1d/ed/8e37abb30eea9797844f8bf2acb3b371b065c556b7c1eec6588f27a77690/chunkflow-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "33ddcc22f854994c1394b7a28b223bd6", "sha256": "fdafc9a360f3e8668ed02bbb9416203466b1b022b6b12b9dff46aaebdc4878d2" }, "downloads": -1, "filename": "chunkflow-0.5.0.tar.gz", "has_sig": false, "md5_digest": "33ddcc22f854994c1394b7a28b223bd6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 48738, "upload_time": "2019-08-15T17:15:27", "url": "https://files.pythonhosted.org/packages/3c/96/f44a0d4d4e3d32347e070a5430300abd6db965051a1ea84b0f6807bdf83d/chunkflow-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "4c8de24a7da35f2d0470646f8ca55c96", "sha256": "05c814a49d735f51a7a2dde3c99c82d8de00ca7f100c18058221ec817378dd9e" }, "downloads": -1, "filename": "chunkflow-0.5.1.tar.gz", "has_sig": false, "md5_digest": "4c8de24a7da35f2d0470646f8ca55c96", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 48820, "upload_time": "2019-08-16T01:12:45", "url": "https://files.pythonhosted.org/packages/04/ad/1fcd6bc18cabecb7591001e18dbeade05ab34a72a1c5b3bd401a50c32322/chunkflow-0.5.1.tar.gz" } ], "0.5.2": [ { "comment_text": "", "digests": { "md5": "8de1fa25fe5610b9a713eddea9c10622", "sha256": "0b28b8d206ce7ed16d0c3767dfe8cbbcf2543c5029b5bf6f7c26671c48fd92ae" }, "downloads": -1, "filename": "chunkflow-0.5.2.tar.gz", "has_sig": false, "md5_digest": "8de1fa25fe5610b9a713eddea9c10622", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3", "size": 49473, "upload_time": "2019-08-16T20:55:27", "url": "https://files.pythonhosted.org/packages/73/1b/0f73e88463ceb72953e15805e6255b61bdb3d436d2263b669bc7c2876eef/chunkflow-0.5.2.tar.gz" } ], "0.5.3": [ { "comment_text": "", "digests": { "md5": "fd1d1e6fcff3c031f5fd148e5c814053", "sha256": "a863f1e7eb6024b01b107cbb22f698a605273a4835088f0ee24b2e14402397d2" }, "downloads": -1, "filename": "chunkflow-0.5.3.tar.gz", "has_sig": false, "md5_digest": "fd1d1e6fcff3c031f5fd148e5c814053", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3", "size": 49469, "upload_time": "2019-08-16T21:12:07", "url": "https://files.pythonhosted.org/packages/98/ba/735e2f2fe1e6240e6e5739cb7e4e71c344ec82719127569f8e1683dd45d7/chunkflow-0.5.3.tar.gz" } ], "0.5.6": [ { "comment_text": "", "digests": { "md5": "b2abe7bdb3305bf15d2e57a251ff003a", "sha256": "8b672be3fd66fae9e58ae8f5c0f1489f6277d7a1f95f4b1a9538f5893a5f7cf3" }, "downloads": -1, "filename": "chunkflow-0.5.6.tar.gz", "has_sig": false, "md5_digest": "b2abe7bdb3305bf15d2e57a251ff003a", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3", "size": 54425, "upload_time": "2019-10-18T21:16:38", "url": "https://files.pythonhosted.org/packages/29/59/e40c60bd0c9989038a078c46cc25babb0828e8ab745fedfc55c1a37ddace/chunkflow-0.5.6.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "b2abe7bdb3305bf15d2e57a251ff003a", "sha256": "8b672be3fd66fae9e58ae8f5c0f1489f6277d7a1f95f4b1a9538f5893a5f7cf3" }, "downloads": -1, "filename": "chunkflow-0.5.6.tar.gz", "has_sig": false, "md5_digest": "b2abe7bdb3305bf15d2e57a251ff003a", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3", "size": 54425, "upload_time": "2019-10-18T21:16:38", "url": "https://files.pythonhosted.org/packages/29/59/e40c60bd0c9989038a078c46cc25babb0828e8ab745fedfc55c1a37ddace/chunkflow-0.5.6.tar.gz" } ] }