{ "info": { "author": "Jim Fulton", "author_email": "jim@zope.com", "bugtrack_url": null, "classifiers": [ "Framework :: ZODB", "License :: OSI Approved :: Zope Public License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.6", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.2", "Programming Language :: Python :: 3.3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy" ], "description": "=====================\n ZODB Distributed GC\n=====================\n\nThis package provides 2 scripts, for multi-database garbage collection\nand database validation.\n\nThe scripts require that the databases provided to them use 64-bit\nobject ids. The garbage-collection script also assumes that the\ndatabases support efficient iteration from transactions near the end\nof the databases.\n\nmulti-zodb-gc\n=============\n\nThe multi-zodb-gc script takes one or 2 configuration files. If a\nsingle configuration file is given, garbage collection is performed on\nthe databases specified by the configuration files. If garbage is\nfound, then delete records are written to the databases. When the\ndatabases are subsequently packed to a time after the delete records\nare written, the garbage objects will be removed.\n\nIf a second configuration file is given, then the databases specified\nin the second configuration file will be used to find garbage.\nDeleted records are still written to the databases given in the first\nconfiguration file. When using replicated-database technology,\nanalysis can be performed using secondary storages, which are usually\nlightly loaded. This is helpful because finding garbage places a\nsignificant load on the databases used to find garbage.\n\nIf your database uses file-storages, then rather than specifying a\nsecond configuration file, you can use the -f option to specify\nfile-storage iterators for finding garbage. Using file storage\niterators is much faster than using a ZEO connection and is faster and\nrequires less memory than opening a read-only file storage on the files.\n\nSome number of trailing days (1 by default) of database records are\nconsidered good, meaning the objects referenced by them are not\ngarbage. This allows the garbage-collection algorithm to work more\nefficiently and avoids problems when applications (incorrectly) do\nthings that cause objects to be temporarily unreferenced, such as\nmoving objects in 2 transactions.\n\nOptions can be used to control the number of days of trailing data to\nbe treated as non garbage and to specify the logging level. Use the\n``--help`` option to get details.\n\n\nmulti-zodb-check-refs\n=====================\n\nThe multi-zodb-check-refs script validates a collection of databases\nby starting with their roots and traversing the databases to make sure\nall referenced objects are reachable. Any unreachable objects are\nreported. If any databases are configured to disallow implicit\ncross-database references, then invalid references are reported as\nwell. Blob records are checked to make sure their blob files can be\nloaded.\n\nOptionally, a database of reference information can be generated. This\ndatabase allows you to find objects referencing a given object id in a\ndatabase. This can be very useful to debugging missing objects.\nGeneration of the references database increases the analysis time\nsubstantially. The references database can become quite large, often a\nsubstantial percentage of the size of the databases being analyzed.\nTypically, you'll perform an initial analysis without a references\ndatabase and only create a references file in a subsequent run if\nproblems are found.\n\nYou can run the script with the ``--help`` option to get usage\ninformation.\n\n================\n Change History\n================\n\n1.0.1 (2015-09-23)\n==================\n\n- Fix #6: Add support for weak references.\n- Fixed: If the only references to an object were outside its home\n database, it would be incorrectly collected, breaking the\n cross-database references.\n\n1.0.0 (2015-08-28)\n==================\n\n- Add support for PyPy, Python 2.7, and Python 3.\n This requires the addition of the ``zodbpickle`` dependency, even on\n Python 2.6.\n- Fixed the ``--days`` argument to ``multi-zodb-gc`` with recent\n versions of ``persistent``.\n- The return values and arguments of the internal implementation\n functions ``gc`` and ``gc_command`` have changed for compatibility\n with Python 3. This will not impact users of the documented scripts\n and is noted only for developers.\n\n0.6.1 (2012-10-08)\n==================\n\n- Fixed: GC could fail in special cases with a NameError.\n\n0.6.0 (2010-05-27)\n==================\n\n- Added support for storages with transformed (e.g. compressed) data\n records.\n\n0.5.0 (2009-11-10)\n==================\n\n- Fixed a bug in the delay throttle that made it delete objects way\n too slowly.\n\n0.4.0 (2009-09-08)\n==================\n\n- The previous version deleted too many objects at a time, which could\n put too much load on a heavily loaded storage server.\n\n - Add a sleep or allow the storage to rest after a set of deletions.\n Sleep for twice the time taken to perform the deletions.\n\n - Adjust the deletion batch size to take about .5 seconds per\n batch of deletions, but do at least 10 at a time.\n\n0.3.0 (2009-09-03)\n==================\n\n- Optimized garbage collection by using a temporary file to\n store object references rather than loading them from the analysis\n database when needed.\n\n- Added an -f option to specify file-storage files directly. It is\n wildly faster to iterate over a file storage than over a ZEO\n connection. Using this option uses a file iterator rather than\n opening a file storage in read-only mode, which avoids scanning the\n database to build an index and avoids the memory cost of a\n file-storage index.\n\n0.2.0 (2009-06-15)\n==================\n\n- Added an option to ignore references to some databases.\n\n- Fixed a bug in handling of the logging level option.\n\n0.1.0 (2009-06-11)\n==================\n\nInitial release\n\nDownload\n========", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/zopefoundation/zc.zodbdgc", "keywords": "database nosql python zope zodb garbage collection distributed", "license": "ZPL 2.1", "maintainer": null, "maintainer_email": null, "name": "zc.zodbdgc", "package_url": "https://pypi.org/project/zc.zodbdgc/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/zc.zodbdgc/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/zopefoundation/zc.zodbdgc" }, "release_url": "https://pypi.org/project/zc.zodbdgc/1.0.1/", "requires_dist": null, "requires_python": null, "summary": "ZODB Distributed Garbage Collection", "version": "1.0.1" }, "last_serial": 1734701, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "ed325797f055d7fc13e9508c0d1e67cf", "sha256": "82c9730e3ad53de8b0353b9a3f4fd34ec87cca4e12de8e00fdca719703eb70bb" }, "downloads": -1, "filename": "zc.zodbdgc-0.1.0.tar.gz", "has_sig": false, "md5_digest": "ed325797f055d7fc13e9508c0d1e67cf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10209, "upload_time": "2009-06-11T21:47:02", "url": "https://files.pythonhosted.org/packages/1f/8f/35e68536af29a54dc18c506678f5b7c5c5ff8eb704565611d62150b425e1/zc.zodbdgc-0.1.0.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "542a065dd1d15e66334fe8265265cc5b", "sha256": "8d45f7784ffcc8b03a06dc62acacaba200899e1d136e3a5ed7d50ac4a23c60fc" }, "downloads": -1, "filename": "zc.zodbdgc-0.2.0.tar.gz", "has_sig": false, "md5_digest": "542a065dd1d15e66334fe8265265cc5b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10873, "upload_time": "2009-06-15T20:20:22", "url": "https://files.pythonhosted.org/packages/ce/67/944168e96aa6059d62dad6da054356bd729089305073a49f92049e360edd/zc.zodbdgc-0.2.0.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "919fe0ebb2848046a7f59b7ce4f78143", "sha256": "05ba8dad77b1287e47f9200ef5256887664ebfc28991c95bc49107307b58529b" }, "downloads": -1, "filename": "zc.zodbdgc-0.3.0.tar.gz", "has_sig": false, "md5_digest": "919fe0ebb2848046a7f59b7ce4f78143", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13581, "upload_time": "2009-09-03T21:54:30", "url": "https://files.pythonhosted.org/packages/f8/a0/3243309e30363d5790d5458ee7793b6b5863982de42df1c71af0dda3e05f/zc.zodbdgc-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "bc1f7ad0f6e61739fb1c883d05f6b18b", "sha256": "4986e6735fa833362303e3877818e4db625ab5dd9a12082b3ccc731914658e34" }, "downloads": -1, "filename": "zc.zodbdgc-0.4.0.tar.gz", "has_sig": false, "md5_digest": "bc1f7ad0f6e61739fb1c883d05f6b18b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 14001, "upload_time": "2009-09-08T12:37:22", "url": "https://files.pythonhosted.org/packages/a9/86/47fa518fdf5a26f5385dc05a9a49ac9b6932b65e2989a8380e02bd053fd3/zc.zodbdgc-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "2f9fe0e70292e6773d6869d954692095", "sha256": "f03d3730cd2fa71fba08a0f83e32aa879532a451f9220c47b161920f9fa926e1" }, "downloads": -1, "filename": "zc.zodbdgc-0.5.0.tar.gz", "has_sig": false, "md5_digest": "2f9fe0e70292e6773d6869d954692095", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 14040, "upload_time": "2009-11-11T00:12:15", "url": "https://files.pythonhosted.org/packages/72/63/01736c6bc7f27ed2ec96eb1e73298fdcff75f6c3f29bb26ade4ba10af91c/zc.zodbdgc-0.5.0.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "a9409937cb120b0da6b3653d5a9cbbf2", "sha256": "fcdd7a99d39caa16e96d24a11edd6b95347f6f3649815df4e891b0e2f54717ec" }, "downloads": -1, "filename": "zc.zodbdgc-0.6.0.tar.gz", "has_sig": false, "md5_digest": "a9409937cb120b0da6b3653d5a9cbbf2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 15178, "upload_time": "2010-05-27T21:20:42", "url": "https://files.pythonhosted.org/packages/be/42/9a90554169cc987eb67fd841479557fa421478d04464b7c245f1caad6edf/zc.zodbdgc-0.6.0.tar.gz" } ], "0.6.1": [ { "comment_text": "", "digests": { "md5": "75e431ba28994398f7b2f4b5f569393c", "sha256": "2ee17e0af06768ea2e5ed9ec34109022a10676e89191c588f5ae66d14cf046d2" }, "downloads": -1, "filename": "zc.zodbdgc-0.6.1.tar.gz", "has_sig": false, "md5_digest": "75e431ba28994398f7b2f4b5f569393c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 15450, "upload_time": "2012-10-08T18:03:32", "url": "https://files.pythonhosted.org/packages/7c/ad/516020f6df947bb2a4ca4e02be48d2194e7a57c9ff8b8de7da6504eca91a/zc.zodbdgc-0.6.1.tar.gz" } ], "1.0.0": [ { "comment_text": "", "digests": { "md5": "c17a3a38b31acb5b56fdddac545703f2", "sha256": "f71d5744d720b1f99a387f1f3872bcf037ca3ff870ce5bf1bb6b070cb509b30c" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "c17a3a38b31acb5b56fdddac545703f2", "packagetype": "bdist_wheel", "python_version": "3.4", "requires_python": null, "size": 22467, "upload_time": "2015-08-28T23:16:40", "url": "https://files.pythonhosted.org/packages/79/fe/1dfb53f920607ce51584f1a24c5f2f093e53689078afe79394d45fe68f91/zc.zodbdgc-1.0.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0f51333529acf1b61ee326e90d21a07c", "sha256": "44afb89dbb166552bd54a9b7dbac8dad8e07fcfbd2424aecaa2073fb354087f4" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.0.tar.gz", "has_sig": false, "md5_digest": "0f51333529acf1b61ee326e90d21a07c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18813, "upload_time": "2015-08-28T23:16:36", "url": "https://files.pythonhosted.org/packages/68/b2/384149d4ca94fdb6fe37fa70e97b00f287d6c5add82700de5118d3b3fcf9/zc.zodbdgc-1.0.0.tar.gz" } ], "1.0.1": [ { "comment_text": "", "digests": { "md5": "c0ef14b42b192edd6655d8ea75540061", "sha256": "c22883977aab48719d6d8ddf2c8b46766f041bd6d37f4bc733eec00f84f09310" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "c0ef14b42b192edd6655d8ea75540061", "packagetype": "bdist_wheel", "python_version": "3.4", "requires_python": null, "size": 24015, "upload_time": "2015-09-23T11:39:25", "url": "https://files.pythonhosted.org/packages/f0/e8/42b186bac4c0edcc707722fde72dd95778565ce126210947766521584d72/zc.zodbdgc-1.0.1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "cad8e210c1b5ff06559fcc84ca7b4c02", "sha256": "ff4aa06d62bf619882502a70ce37733b3284f127928b746c96640c62d38ceccf" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.1.tar.gz", "has_sig": false, "md5_digest": "cad8e210c1b5ff06559fcc84ca7b4c02", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20543, "upload_time": "2015-09-23T11:39:17", "url": "https://files.pythonhosted.org/packages/13/79/0108129049253ff738e4f64653d414d457a5a5c1212e10858059b8187074/zc.zodbdgc-1.0.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "c0ef14b42b192edd6655d8ea75540061", "sha256": "c22883977aab48719d6d8ddf2c8b46766f041bd6d37f4bc733eec00f84f09310" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.1-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "c0ef14b42b192edd6655d8ea75540061", "packagetype": "bdist_wheel", "python_version": "3.4", "requires_python": null, "size": 24015, "upload_time": "2015-09-23T11:39:25", "url": "https://files.pythonhosted.org/packages/f0/e8/42b186bac4c0edcc707722fde72dd95778565ce126210947766521584d72/zc.zodbdgc-1.0.1-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "cad8e210c1b5ff06559fcc84ca7b4c02", "sha256": "ff4aa06d62bf619882502a70ce37733b3284f127928b746c96640c62d38ceccf" }, "downloads": -1, "filename": "zc.zodbdgc-1.0.1.tar.gz", "has_sig": false, "md5_digest": "cad8e210c1b5ff06559fcc84ca7b4c02", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 20543, "upload_time": "2015-09-23T11:39:17", "url": "https://files.pythonhosted.org/packages/13/79/0108129049253ff738e4f64653d414d457a5a5c1212e10858059b8187074/zc.zodbdgc-1.0.1.tar.gz" } ] }