{ "info": { "author": "Jacob Graving ", "author_email": "jgraving@gmail.com", "bugtrack_url": null, "classifiers": [ "Intended Audience :: Science/Research", "Programming Language :: Python :: 3", "Topic :: Scientific/Engineering :: Image Recognition" ], "description": "

\n\n

\n\n# You have just found DeepPoseKit.\n

\n\n

\n\nDeepPoseKit is a software toolkit with a high-level API for 2D pose estimation of user-defined keypoints using deep learning\u2014written in Python and built using [Tensorflow](https://github.com/tensorflow/tensorflow) and [Keras](https://www.tensorflow.org/guide/keras). Use DeepPoseKit if you need:\n\n- tools for annotating images or video frames with user-defined keypoints\n- a straightforward but flexible data augmentation pipeline using the [imgaug package](https://github.com/aleju/imgaug)\n- a Keras-based interface for initializing, training, and evaluating pose estimation models\n- easy-to-use methods for saving and loading models and making predictions on new data\n\nDeepPoseKit is designed with a focus on *usability* and *extensibility*, as being able to go from idea to result with the least possible delay is key to doing good research.\n\nDeepPoseKit is currently limited to *individual pose estimation*. If individuals can be easily distinguished visually (i.e., they have differently colored bodies or are marked in some way), then multiple individuals can simply be labeled with separate keypoints (head1, tail1, head2, tail2, etc.). Otherwise DeepPoseKit can be extended to multiple individuals by first localizing, tracking, and cropping individuals with additional software such as [idtracker.ai](https://idtracker.ai/), [pinpoint](https://github.com/jgraving/pinpoint), or [Tracktor](https://github.com/vivekhsridhar/tracktor).\n\nLocalization (without tracking) can also be achieved with deep learning software like [keras-retinanet](https://github.com/fizyr/keras-retinanet), the [Tensorflow Object Detection API](https://github.com/tensorflow/models/tree/master/research/object_detection), or [MatterPort's Mask R-CNN](https://github.com/matterport/Mask_RCNN).\n\n[Check out our paper](https://doi.org/10.7554/eLife.47994) to find out more.\n\n**NOTE:** This software is still in early-release development. *Expect some adventures.*\n\n

\n\n\n

\n\n# How to use DeepPoseKit\n\nDeepPoseKit is designed for easy use. For example, training and saving a model requires only a few lines of code:\n```python\nfrom deepposekit.io import DataGenerator, TrainingGenerator\nfrom deepposekit.models import StackedDenseNet\n\ndata_generator = DataGenerator('/path/to/annotation_data.h5')\ntrain_generator = TrainingGenerator(data_generator)\nmodel = StackedDenseNet(train_generator)\nmodel.fit(batch_size=16, n_workers=8)\nmodel.save('/path/to/saved_model.h5')\n```\nLoading a trained model and running predictions on new data is also straightforward. For example, running predictions on a new video:\n```python\nfrom deepposekit.models import load_model\nfrom deepposekit.io import VideoReader\n\nmodel = load_model('/path/to/saved_model.h5')\nreader = VideoReader('/path/to/video.mp4')\npredictions = model.predict(reader)\n```\n\n## Using DeepPoseKit is a 4-step process:\n\n- **1.** [Create an annotation set](https://github.com/jgraving/DeepPoseKit/blob/master/examples/step1_create_annotation_set.ipynb) \"Open\n- **2.** [Annotate your data](https://github.com/jgraving/DeepPoseKit/blob/master/examples/step2_annotate_data.ipynb) with our built-in GUI (no Colab support)\n- **3.** [Select and train a model](https://github.com/jgraving/DeepPoseKit/blob/master/examples/step3_train_model.ipynb) including our [`StackedDenseNet`](http://jakegraving.com/DeepPoseKit/html/deepposekit/models/StackedDenseNet.html) model and the [`DeepLabCut`](http://jakegraving.com/DeepPoseKit/html/deepposekit/models/DeepLabCut.html) model. \"Open\n- **4.** Use the trained model to:\n\t- a) [Initialize keypoints for unannotated data](https://github.com/jgraving/DeepPoseKit/blob/master/examples/step4a_initialize_annotations.ipynb) for faster annotations with *active learning*. \"Open\n\t- b) [Predict on new data and refine the training set](https://github.com/jgraving/DeepPoseKit/blob/master/examples/step4b_predict_new_data.ipynb) to improve performance. \"Open\n\n## For more details:\n\n- See [our example notebooks](https://github.com/jgraving/deepposekit/blob/master/examples/)\n- Check the [documentation](http://docs.deepposekit.org)\n- Read [our paper](https://doi.org/10.7554/eLife.47994)\n\n## \"I already have annotated data\"\n\nDeepPoseKit is designed to be extensible, so loading data in other formats is possible.\n\nIf you have data from DeepLabCut (http://deeplabcut.org), try [our (experimental) example notebook ](https://github.com/jgraving/DeepPoseKit/blob/master/examples/deeplabcut_data_example.ipynb) for loading data in this format. \"Open\n\nHave data in another format? You can write your own custom generator to load it.\nCheck out the [example for writing custom data generators](https://github.com/jgraving/DeepPoseKit/blob/master/examples/custom_data_generator.ipynb). \"Open\n\n\n# Installation\n\nDeepPoseKit requires [Tensorflow](https://github.com/tensorflow/tensorflow) for training and using pose estimation models. [Tensorflow](https://github.com/tensorflow/tensorflow) should be manually installed, along with dependencies such as CUDA and cuDNN, before installing DeepPoseKit:\n\n- [Tensorflow Installation Instructions](https://www.tensorflow.org/install)\n- Any Tensorflow version >=1.13.0 should be compatible (including 2.0).\n\nDeepPoseKit has only been tested on Ubuntu 18.04, which is the recommended system for using the toolkit. \n\nInstall the latest stable release with pip:\n```bash\npip install --update deepposekit\n```\n\nInstall the latest development version with pip:\n```bash\npip install --update git+https://www.github.com/jgraving/deepposekit.git\n```\n\nYou can download example datasets from our [DeepPoseKit Data](https://github.com/jgraving/deepposekit-data) repository:\n```bash\ngit clone https://www.github.com/jgraving/deepposekit-data\n```\n\n## Installing with Anaconda\n\nAnaconda cannot install the [imgaug package](https://github.com/aleju/imgaug) using pip, therefore as a temporary workaround we recommend installing imgaug manually:\n```bash\nconda config --add channels conda-forge\nconda install imgaug -c conda-forge\n```\nWe also recommend installing DeepPoseKit from within Python rather than using the command line, either from within Jupyter or another IDE, to ensure it is installed in the correct working environment:\n```python\nimport sys\n!{sys.executable} -m pip install --update deepposekit\n```\n# Contributors and Development \n \nDeepPoseKit was developed by [Jake Graving](https://github.com/jgraving) and [Daniel Chae](https://github.com/dchaebae), and is still being actively developed. .\n\nWe welcome community involvement and public contributions to the toolkit. If you wish to contribute, please [fork the repository](https://help.github.com/en/articles/fork-a-repo) to make your modifications and [submit a pull request](https://help.github.com/en/articles/creating-a-pull-request-from-a-fork).\n\nIf you'd like to get involved with developing DeepPoseKit, get in touch (jgraving@gmail.com) and check out [our development roadmap](https://github.com/jgraving/DeepPoseKit/blob/master/DEVELOPMENT.md) to see future plans for the package. \n\n# Issues \n \nPlease submit bugs or feature requests to the [GitHub issue tracker](https://github.com/jgraving/deepposekit/issues/new). Please limit reported issues to the DeepPoseKit codebase and provide as much detail as you can with a minimal working example if possible.\n\nIf you experience problems with [Tensorflow](https://github.com/tensorflow/tensorflow), such as installing CUDA or cuDNN dependencies, then please direct issues to those development teams.\n\n# License\n\nReleased under a Apache 2.0 License. See [LICENSE](https://github.com/jgraving/deepposekit/blob/master/LICENSE) for details.\n\n# References\n\nIf you use DeepPoseKit for your research please cite [our open-access paper](http://paper.deepposekit.org):\n\n @article{graving2019deepposekit,\n title={DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning},\n author={Graving, Jacob M and Chae, Daniel and Naik, Hemal and Li, Liang and Koger, Benjamin and Costelloe, Blair R and Couzin, Iain D},\n journal={eLife},\n volume={8},\n pages={e47994},\n year={2019},\n publisher={eLife Sciences Publications Limited}\n url={https://doi.org/10.7554/eLife.47994},\n }\n\nYou can also read [our open-access preprint](http://preprint.deepposekit.org):\n\n @article{graving2019preprint,\n title={DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning},\n author={Graving, Jacob M and Chae, Daniel and Naik, Hemal and Li, Liang and Koger, Benjamin and Costelloe, Blair R and Couzin, Iain D},\n journal={bioRxiv},\n pages={620245},\n year={2019},\n publisher={Cold Spring Harbor Laboratory}\n url={https://doi.org/10.1101/620245}\n }\n\n\n# News\n\n- **October 2019:** Our paper describing DeepPoseKit is published at eLife! (http://paper.deepposekit.org)\n- **September 2019**: \n - Nature News covers DeepPoseKit: [Deep learning powers a motion-tracking revolution](http://doi.org/10.1038/d41586-019-02942-5)\n - v0.3.0 is released. See [the release notes](https://github.com/jgraving/DeepPoseKit/releases/tag/v0.3.0).\n- **April 2019:** The DeepPoseKit preprint is on biorxiv (http://preprint.deepposekit.org)", "description_content_type": "text/markdown", "docs_url": null, "download_url": "https://github.com/jgraving/deepposekit.git", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/jgraving/deepposekit", "keywords": "", "license": "Apache 2.0", "maintainer": "Jacob Graving ", "maintainer_email": "jgraving@gmail.com", "name": "deepposekit", "package_url": "https://pypi.org/project/deepposekit/", "platform": "", "project_url": "https://pypi.org/project/deepposekit/", "project_urls": { "Download": "https://github.com/jgraving/deepposekit.git", "Homepage": "https://github.com/jgraving/deepposekit" }, "release_url": "https://pypi.org/project/deepposekit/0.3.4/", "requires_dist": null, "requires_python": "", "summary": "a toolkit for pose estimation using deep learning", "version": "0.3.4" }, "last_serial": 5950313, "releases": { "0.2.0": [ { "comment_text": "", "digests": { "md5": "8e4921ccc8662624a3b2bd2d4df3e03c", "sha256": "3ddd2137a49f958bf1b75f98de0d90f264cb1bc1be154f5e461b74047a2c0c61" }, "downloads": -1, "filename": "deepposekit-0.2.0.tar.gz", "has_sig": false, "md5_digest": "8e4921ccc8662624a3b2bd2d4df3e03c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 37048, "upload_time": "2019-09-29T11:49:17", "url": "https://files.pythonhosted.org/packages/79/ba/107d80e0e17c1af8d97a074ac0ace4aef2ca5722e10b511c1accd6b8085e/deepposekit-0.2.0.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "56251a52b0ea5480a52c249cfeeca736", "sha256": "7a48ddb00a26eb6f845a531efde66c01f8338506fdc519e66428bcbf256e3214" }, "downloads": -1, "filename": "deepposekit-0.2.1.tar.gz", "has_sig": false, "md5_digest": "56251a52b0ea5480a52c249cfeeca736", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 39861, "upload_time": "2019-09-29T13:38:48", "url": "https://files.pythonhosted.org/packages/5f/1b/131e8ae8fdae349369320f9c9d18d33be3f9814eb75dc8fca36cdd953017/deepposekit-0.2.1.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "b944cc9045e6b5ce89e7e5463da4a453", "sha256": "01eb6d263981be56792a024a16454a4a9cce4a46d3048f9f0794a1dbd6eda9f3" }, "downloads": -1, "filename": "deepposekit-0.3.0.tar.gz", "has_sig": false, "md5_digest": "b944cc9045e6b5ce89e7e5463da4a453", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 59832, "upload_time": "2019-09-30T11:23:53", "url": "https://files.pythonhosted.org/packages/f3/6b/1fde98db7b5ab5721d4e4e60fd59251cf5696bcc0439930311238b180f2c/deepposekit-0.3.0.tar.gz" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "d08aca7b97a709a742ebf2d673996c8a", "sha256": "a258c96c1fb7f43c7d23964416391c36fe962034c5bfacc060bcfd0a008fa596" }, "downloads": -1, "filename": "deepposekit-0.3.1.tar.gz", "has_sig": false, "md5_digest": "d08aca7b97a709a742ebf2d673996c8a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 60958, "upload_time": "2019-09-30T16:00:51", "url": "https://files.pythonhosted.org/packages/c1/3f/bde42881f39982fe203ebcde9af0c02ff85cd6d873df9b64aeb1da402183/deepposekit-0.3.1.tar.gz" } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "7d0521968063c95db9ce3b43c28f64e7", "sha256": "d99d59d2b0b0afb7349adc7c8b6b7de1c1a023491d8684dd7562ba3826cb0cfe" }, "downloads": -1, "filename": "deepposekit-0.3.2.tar.gz", "has_sig": false, "md5_digest": "7d0521968063c95db9ce3b43c28f64e7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 63117, "upload_time": "2019-10-04T13:20:55", "url": "https://files.pythonhosted.org/packages/f7/de/642d8a3847b6dad2cbbf57ab60d15511599df306bc54c654c8f4700a6a30/deepposekit-0.3.2.tar.gz" } ], "0.3.3": [ { "comment_text": "", "digests": { "md5": "44ea504ef1cdba2bac1de2a116c39536", "sha256": "af16d4a7fee4242efce17fb82d3330b2a4501f3a5704285bd2cc1e791e190581" }, "downloads": -1, "filename": "deepposekit-0.3.3.tar.gz", "has_sig": false, "md5_digest": "44ea504ef1cdba2bac1de2a116c39536", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 63105, "upload_time": "2019-10-04T13:26:45", "url": "https://files.pythonhosted.org/packages/7d/b7/d60dd5d7586968f9d41d2f9c91f448b779da6ffcaccb85f9b46b38beb745/deepposekit-0.3.3.tar.gz" } ], "0.3.4": [ { "comment_text": "", "digests": { "md5": "dc9054dbc6a9dc24ac9a24db34d253de", "sha256": "630681a55c4eb2fa43f375f3afa72e24928248bd73840ed4fa054a758753ba50" }, "downloads": -1, "filename": "deepposekit-0.3.4.tar.gz", "has_sig": false, "md5_digest": "dc9054dbc6a9dc24ac9a24db34d253de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 63164, "upload_time": "2019-10-09T14:55:03", "url": "https://files.pythonhosted.org/packages/bd/2f/f1f9d7f71f16b2c723d02f043d39e697256cf7d8b21f78b2bae066a1e334/deepposekit-0.3.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "dc9054dbc6a9dc24ac9a24db34d253de", "sha256": "630681a55c4eb2fa43f375f3afa72e24928248bd73840ed4fa054a758753ba50" }, "downloads": -1, "filename": "deepposekit-0.3.4.tar.gz", "has_sig": false, "md5_digest": "dc9054dbc6a9dc24ac9a24db34d253de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 63164, "upload_time": "2019-10-09T14:55:03", "url": "https://files.pythonhosted.org/packages/bd/2f/f1f9d7f71f16b2c723d02f043d39e697256cf7d8b21f78b2bae066a1e334/deepposekit-0.3.4.tar.gz" } ] }