{ "info": { "author": "Mohamed El-Kalioby", "author_email": "mkalioby@mkalioby.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: System Administrators", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "[![PyPI version](https://badge.fury.io/py/partialCopy.svg)](https://badge.fury.io/py/partialCopy)\n\n# partialCopy\nA tool to copy big data to multiple smaller disks\n\n## Motivation\n\nAs the storage becomes larger in big projects, we need to a tool to break large folders (100 TBs) to smaller chunks, so we can migrate to another location or storing it on tapes.\n\n## How does it work?\n\nThe tool finds the best placement for the files and it creates a files list in --save-to directory which can be passed rsync using `--files-from` parameter.\n## Installation\n\n```sudo pip install partialCopy```\n\n## Usage\n```\nusage: pcp.py [-h] [--dest DEST | --dest-size DEST_SIZE] [-s SAVE_TO] [-f]\n [-n] [-ma MODIFIED_AFTER] [-fp FIND_PARAMS]\n src\n\npositional arguments:\n src Source Directory\n\noptional arguments:\n -h, --help show this help message and exit\n --dest DEST Destionation mountpoint\n --dest-size DEST_SIZE\n Destination size, given in bytes or using 1 letter\n unit B,K,M,G,T,P\n -s SAVE_TO, --save-to SAVE_TO\n Where to save rsync list,default\n '$src/pcp_rsync_list/'\n -f, --force Rewrite all lists again\n -n, --new Find New Files\n -ma MODIFIED_AFTER, --modified-after MODIFIED_AFTER\n Find files modified after certain time (YYYY-mm-dd)\n -fp FIND_PARAMS, --find-params FIND_PARAMS\n Parameters to find command\n\n```\n## Changes\n* Allowing to provide size rather than mount point.\n* Finds only new files using `-n` parameter.\n* Finds files modified after a certain date using `-ma` parameter.\n* Allows rewriting all lists using `-f` flag. \n\n\n# Contributors\n* [Zeeshan Ali Shah](https://github.com/zeeshanali)", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/mkalioby/partialCopy", "keywords": "admin,utils,notification", "license": "", "maintainer": "", "maintainer_email": "", "name": "partialCopy", "package_url": "https://pypi.org/project/partialCopy/", "platform": "", "project_url": "https://pypi.org/project/partialCopy/", "project_urls": { "Homepage": "https://github.com/mkalioby/partialCopy" }, "release_url": "https://pypi.org/project/partialCopy/0.6.1/", "requires_dist": null, "requires_python": ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*", "summary": "A tool to copy big data to multiple smaller disks", "version": "0.6.1" }, "last_serial": 5994236, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "c6a0d538077b2e230a90271eef005512", "sha256": "de47a67837ee3883e632b49fd1bfbc1f35fb01186e3afedc0f9d91553f66de9e" }, "downloads": -1, "filename": "partialCopy-0.1.tar.gz", "has_sig": false, "md5_digest": "c6a0d538077b2e230a90271eef005512", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2578, "upload_time": "2019-10-16T09:54:15", "url": "https://files.pythonhosted.org/packages/b6/4c/7f17106683e0da60ffaf3146c1986e50eb1276478d9d5185d4cfe638252a/partialCopy-0.1.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "220feac834028fc368eae8e440b15c4d", "sha256": "d8e20f43c30f7cb5d59a3ba6dc6082b726c47e9c27559434c88ee69ae60248ec" }, "downloads": -1, "filename": "partialCopy-0.2.1.tar.gz", "has_sig": false, "md5_digest": "220feac834028fc368eae8e440b15c4d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2950, "upload_time": "2019-10-16T10:15:48", "url": "https://files.pythonhosted.org/packages/8b/e2/e897a8a8e5de39becc7fe8c8b81d0d7fbe33b31cabc0f01a226c962c7b1a/partialCopy-0.2.1.tar.gz" } ], "0.2.2": [ { "comment_text": "", "digests": { "md5": "05b6dc4895c8e1d7f6d87b92c546f259", "sha256": "b0d8a6b447f13063da96e8cf73afa9855217802b331f372ef7aeeaf4d37716a1" }, "downloads": -1, "filename": "partialCopy-0.2.2.tar.gz", "has_sig": false, "md5_digest": "05b6dc4895c8e1d7f6d87b92c546f259", "packagetype": "sdist", "python_version": "source", "requires_python": ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*", "size": 3946, "upload_time": "2019-10-16T11:15:04", "url": "https://files.pythonhosted.org/packages/e2/5a/8f898af13dccbeb516fb8bbaa58ad49e352a7d2c5a9eca34248db96d2967/partialCopy-0.2.2.tar.gz" } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "87ba84d2f6a3de8a7ee643f4c23a7619", "sha256": "c0bd643d6c84de0fe3805c549b20f8a9dc99cecefff3c8a9f96fc6828503a230" }, "downloads": -1, "filename": "partialCopy-0.2.3.tar.gz", "has_sig": false, "md5_digest": "87ba84d2f6a3de8a7ee643f4c23a7619", "packagetype": "sdist", "python_version": "source", "requires_python": ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*", "size": 3965, "upload_time": "2019-10-16T11:17:27", "url": "https://files.pythonhosted.org/packages/64/8c/14f482335c74bd6f011c2a1168c942fafd82e9ffca91563e1f23e5bee724/partialCopy-0.2.3.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "0bb24242a1485d782a65f223c972d165", "sha256": "65979421234ba7f6192af766f4753e5b1c5308ba8ffc43ad2c69e08df0920049" }, "downloads": -1, "filename": "partialCopy-0.5.0.tar.gz", "has_sig": false, "md5_digest": "0bb24242a1485d782a65f223c972d165", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4000, "upload_time": "2019-10-17T16:29:42", "url": "https://files.pythonhosted.org/packages/0b/2d/92645b063eae52e734cb9f269bbd13c33ef30a72735a33e105330eeedc4c/partialCopy-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "731018ca3d72122a746288e096d3f394", "sha256": "727db0ee86c9b56b4e20b6529cdc11de715db30e15ffdee914a5f5dd83119545" }, "downloads": -1, "filename": "partialCopy-0.5.1.tar.gz", "has_sig": false, "md5_digest": "731018ca3d72122a746288e096d3f394", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4016, "upload_time": "2019-10-17T19:52:28", "url": "https://files.pythonhosted.org/packages/07/2d/ce038e544093abbf42f3f162858e3244fd39a19e39459b3dacd4c3449cb0/partialCopy-0.5.1.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "48fadba3f7802c7a5a9a968568d28099", "sha256": "a016d7e1521c66f75b89d0782ba3b89abb75fc0d73e9965210133b6973fe0dfa" }, "downloads": -1, "filename": "partialCopy-0.6.0.tar.gz", "has_sig": false, "md5_digest": "48fadba3f7802c7a5a9a968568d28099", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4108, "upload_time": "2019-10-18T07:29:40", "url": "https://files.pythonhosted.org/packages/3b/25/6b7343f05ed371ddb94f251323ef02e31c647a9336aec73962a62e322d77/partialCopy-0.6.0.tar.gz" } ], "0.6.1": [ { "comment_text": "", "digests": { "md5": "ee9fab2207a1017fb8bb2fe13094208c", "sha256": "206c14f90d26066dcacb3719f3281dfa082493ddba3779f9613912d4d557fa73" }, "downloads": -1, "filename": "partialCopy-0.6.1.tar.gz", "has_sig": false, "md5_digest": "ee9fab2207a1017fb8bb2fe13094208c", "packagetype": "sdist", "python_version": "source", "requires_python": ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*", "size": 5368, "upload_time": "2019-10-18T07:44:57", "url": "https://files.pythonhosted.org/packages/45/66/4e63dd8e8a3d8fb9f047883260248382ade23a3a757b50e378412e877947/partialCopy-0.6.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ee9fab2207a1017fb8bb2fe13094208c", "sha256": "206c14f90d26066dcacb3719f3281dfa082493ddba3779f9613912d4d557fa73" }, "downloads": -1, "filename": "partialCopy-0.6.1.tar.gz", "has_sig": false, "md5_digest": "ee9fab2207a1017fb8bb2fe13094208c", "packagetype": "sdist", "python_version": "source", "requires_python": ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*", "size": 5368, "upload_time": "2019-10-18T07:44:57", "url": "https://files.pythonhosted.org/packages/45/66/4e63dd8e8a3d8fb9f047883260248382ade23a3a757b50e378412e877947/partialCopy-0.6.1.tar.gz" } ] }