{ "info": { "author": "Madison Bahmer", "author_email": "madison.bahmer@istresearch.com", "bugtrack_url": null, "classifiers": [], "description": "************************\nScrapy Cluster Utilities\n************************\n\nOverview\n--------\n\nThe ``scutils`` package is a collection of utilities that are used by the Scrapy Cluster project. These utilities are agnostic enough that they can be used by any application.\n\nRequirements\n------------\n\n- Unix based machine (Linux or OS X)\n- Python 2.7.x\n\nInstallation\n------------\n\nInside a virtualenv, run ``pip install -U scutils``. This will install the latest version of the Scrapy Cluster Utilities. If you are running a Scrapy Cluster, ``scutils`` is included inside of the **requirements.txt** so there is no need to install it separately.\n\nDocumentation\n-------------\n\nFull documentation for the ``scutils`` package is included as part of the Official Scrapy Cluster Documentation, which can be found `here `_ under the **Utilities** section.\n\nargparse_helper.py\n==================\n\nThe ``argparse_helper`` module is used to help print top level ``--help`` arguments from argparse when used with subparsers. Useful for running applications that have multiple combinations of subcommands and command line arguments.\n\nlog_factory.py\n==============\n\nThe ``log_factory`` module provides a standardized way for creating logs for multithreaded and concurrent process log data. It supports all log levels, stdout or to a file, and various output formats including JSON.\n\nmethod_timer.py\n===============\n\nThe ``method_timer`` module provides a simple decorator that can be added to functions or methods requiring an execution timeout period.\n\nredis_queue.py\n==============\n\nThe ``redis_queue`` module provides 3 core queue classes which use Redis as the place to store data. Includes FIFO, Stack, and Priority Queues.\n\nredis_throttled_queue.py\n========================\n\nThe ``redis_throttled_queue`` module provides a throttled or moderated Redis queue structure that can be used to mitigate the number of pops from the queue within a given time frame.\n\nsettings_wrapper.py\n===================\n\nThe ``settings_wrapper`` module is a class the handles loading of default python application settings, which can then be overridden or added to by a local settings file. In the end provides a single dictionary object of all your loaded application settings.\n\n\nstats_collector.py\n==================\n\nThe ``stats_collector`` module generates Redis based statistics based on time windows or in total. Statistics collection includes time windows, rolling time windows, counters, unique counters, hyperloglog counters, and bitmap counters.\n\nzookeeper_watcher.py\n====================\n\nThe ``zookeeper_watcher`` module provides an easy way to tell an application that it's watched Zookeeper file has changed. It also handles Zookeeper session disconnects and reconnects behind the scenes of your application.", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/istresearch/scrapy-cluster", "keywords": "scrapy,scrapy-cluster,utilities", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "scutils", "package_url": "https://pypi.org/project/scutils/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/scutils/", "project_urls": { "Homepage": "https://github.com/istresearch/scrapy-cluster" }, "release_url": "https://pypi.org/project/scutils/1.2.0/", "requires_dist": null, "requires_python": "", "summary": "Utilities for Scrapy Cluster", "version": "1.2.0" }, "last_serial": 5568638, "releases": { "0.0.3": [ { "comment_text": "", "digests": { "md5": "c96cce08db52d0c0aebe166e3f4f3e0e", "sha256": "8ffeda229e1e61df200b60bf6ce9069eda2142743bf564a516faaf2cbace4e98" }, "downloads": -1, "filename": "scutils-0.0.3-py2.7.egg", "has_sig": false, "md5_digest": "c96cce08db52d0c0aebe166e3f4f3e0e", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 38763, "upload_time": "2015-11-16T21:58:03", "url": "https://files.pythonhosted.org/packages/d7/db/5593518fe77e35107810617ad5a45827f8988fc619aababdc0ebf3abbe01/scutils-0.0.3-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "c394072fa2cb2c5e641a3c6bed7cd114", "sha256": "4652a91c865f919f1941cf20ba2357a31aef3c7ac13b3d731c6fe9810d9a0792" }, "downloads": -1, "filename": "scutils-0.0.3.tar.gz", "has_sig": false, "md5_digest": "c394072fa2cb2c5e641a3c6bed7cd114", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16225, "upload_time": "2015-11-16T21:58:19", "url": "https://files.pythonhosted.org/packages/2a/2c/edd2e3b3fa62235cba76d0319fdd7463eddc5755a545e99c3e9684b03dd0/scutils-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "69a8dda1bd5d087895dc26989e292c86", "sha256": "b919ca87e5b5fe4e30ba7cbbf9abf2737f5588aa4bd0b00355a87138bc824b3e" }, "downloads": -1, "filename": "scutils-0.0.4.tar.gz", "has_sig": false, "md5_digest": "69a8dda1bd5d087895dc26989e292c86", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16361, "upload_time": "2015-11-24T18:52:31", "url": "https://files.pythonhosted.org/packages/05/d6/01d788f3aaa52fb91f07062427f12b312f8389ca920ee02a2aa63122bc57/scutils-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "b88e8b60c49ae5a646036e5cee4838f7", "sha256": "6d5571cb814bcb9d7b47e93ae1db8ba1b87710f8a74742d6596750b7130b8832" }, "downloads": -1, "filename": "scutils-0.0.5.tar.gz", "has_sig": false, "md5_digest": "b88e8b60c49ae5a646036e5cee4838f7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16595, "upload_time": "2015-12-09T18:51:50", "url": "https://files.pythonhosted.org/packages/47/fa/82262f33a873f0b255b387e52dbb9bd791eb188d8d6bfc30f326cd45ae66/scutils-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "4a705b776815d6634695c9e550728a07", "sha256": "25c6df709d3cbc1b4e0de5e9c95d762432598f5326eee64f12287254aea82656" }, "downloads": -1, "filename": "scutils-0.0.6.tar.gz", "has_sig": false, "md5_digest": "4a705b776815d6634695c9e550728a07", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16521, "upload_time": "2015-12-14T16:09:14", "url": "https://files.pythonhosted.org/packages/d9/09/6ec81e776129464c1d16f6a1c66f7538f31a0cc220f0107fd8eb0ab2f378/scutils-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "8dc65eeaa93171794c01fbf6a595e80b", "sha256": "49336aa7e4c5a7953c1b2020dae3b94330f13fc2707450e1e1cd64e8203090d9" }, "downloads": -1, "filename": "scutils-0.0.7.tar.gz", "has_sig": false, "md5_digest": "8dc65eeaa93171794c01fbf6a595e80b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16553, "upload_time": "2016-01-31T21:09:43", "url": "https://files.pythonhosted.org/packages/94/4b/ebfc38010c10e6dae25d3259f569f7fedbdb3461001ec047b24340e573a4/scutils-0.0.7.tar.gz" } ], "1.1.0": [ { "comment_text": "", "digests": { "md5": "6a8af6d9ca413765fe55c610e503f860", "sha256": "8c0cdb99f9c8a879fcf7e03922f21a5ee455ee402809be758d246cb7ee64e82c" }, "downloads": -1, "filename": "scutils-1.1.0.tar.gz", "has_sig": false, "md5_digest": "6a8af6d9ca413765fe55c610e503f860", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16638, "upload_time": "2016-02-23T17:12:01", "url": "https://files.pythonhosted.org/packages/29/0a/493b022385869cc8d712a4a4c9cea6cb547bc23e880355a2c1bd5a0a1d26/scutils-1.1.0.tar.gz" } ], "1.2.0": [ { "comment_text": "", "digests": { "md5": "71f0c187e38ccc935144e44c6feff013", "sha256": "2193e5733d9da2f6a2c91aa204f5d91d0c2d3a7ec61c65159a546d56ebbbf555" }, "downloads": -1, "filename": "scutils-1.2.0.tar.gz", "has_sig": false, "md5_digest": "71f0c187e38ccc935144e44c6feff013", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18082, "upload_time": "2017-03-29T22:22:03", "url": "https://files.pythonhosted.org/packages/9b/99/b56cc417866f529b3ebe0d19f43ae6d25eeb47363c1258b7c4e1ce432a0c/scutils-1.2.0.tar.gz" } ], "1.2.0.dev7": [ { "comment_text": "", "digests": { "md5": "5f0474e190874c2ba69d5ecbc53b0616", "sha256": "c826bebcd28484a46fcc228c1bb737c06d1939d4c5670dcaaa76e0dc9c3b416b" }, "downloads": -1, "filename": "scutils-1.2.0.dev7.tar.gz", "has_sig": false, "md5_digest": "5f0474e190874c2ba69d5ecbc53b0616", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18111, "upload_time": "2017-02-09T01:23:01", "url": "https://files.pythonhosted.org/packages/18/4f/93e9b16113a3eb2ac8a67dbe4ce7c2273042d2bc00eccefeeb96828b6685/scutils-1.2.0.dev7.tar.gz" } ], "1.2.0.dev8": [ { "comment_text": "", "digests": { "md5": "5fbbdd26e2d90979f52910d097edecae", "sha256": "775153e7d4cbb0bd652df6cf184fcd403b5100e197ef78566aa37f73da8e1bea" }, "downloads": -1, "filename": "scutils-1.2.0.dev8.tar.gz", "has_sig": false, "md5_digest": "5fbbdd26e2d90979f52910d097edecae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18112, "upload_time": "2017-03-18T16:38:29", "url": "https://files.pythonhosted.org/packages/b8/ec/5c89900fa4e5401b56a096df0ef85aad6d5e1148b7c3d5a016c8c951abcf/scutils-1.2.0.dev8.tar.gz" } ], "1.3.0.dev0": [ { "comment_text": "", "digests": { "md5": "ffe356df724fc394bf75d0079fa72153", "sha256": "b1919795d2b62a5ea7079840e61c68e54a637b2c3c40695e3a29d19b165e0c6e" }, "downloads": -1, "filename": "scutils-1.3.0.dev0.tar.gz", "has_sig": false, "md5_digest": "ffe356df724fc394bf75d0079fa72153", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18226, "upload_time": "2017-05-15T21:14:07", "url": "https://files.pythonhosted.org/packages/71/10/0ada91d2fd8043cec6a6e8d4cce6db6209bfd693c2b3673da3ac3f3bc5b8/scutils-1.3.0.dev0.tar.gz" } ], "1.3.0.dev2": [ { "comment_text": "", "digests": { "md5": "a8e072d989671ce25020cbc027afb149", "sha256": "ea6752e2267fefd88d47e410766430899cacc37a66b344161a30c871e596d255" }, "downloads": -1, "filename": "scutils-1.3.0.dev2.tar.gz", "has_sig": false, "md5_digest": "a8e072d989671ce25020cbc027afb149", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18248, "upload_time": "2017-05-25T17:57:19", "url": "https://files.pythonhosted.org/packages/87/25/6fc9a5d2320f7bd495751005d05a82a5c5da53e7dd34ae57d186c90bcc41/scutils-1.3.0.dev2.tar.gz" } ], "1.3.0.dev3": [ { "comment_text": "", "digests": { "md5": "61c8d2fbf38e3272126e984840b91be7", "sha256": "4aa4694d3c778c64329dcf3a2eff2c8d4d3992ace5f9d15a6c277359a3d7a098" }, "downloads": -1, "filename": "scutils-1.3.0.dev3.tar.gz", "has_sig": false, "md5_digest": "61c8d2fbf38e3272126e984840b91be7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18322, "upload_time": "2017-08-01T00:34:47", "url": "https://files.pythonhosted.org/packages/d0/6d/36a95fbb9a9ad39c1edf43881df35e31ac82a75605c287e4f25ee2bf0ec1/scutils-1.3.0.dev3.tar.gz" } ], "1.3.0.dev4": [ { "comment_text": "", "digests": { "md5": "0232dcaed25cd9a086712d84adc65908", "sha256": "e44b79f1609357b0f8318495dbe3febc880318835b7f9e84705b279560510352" }, "downloads": -1, "filename": "scutils-1.3.0.dev4.tar.gz", "has_sig": false, "md5_digest": "0232dcaed25cd9a086712d84adc65908", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18340, "upload_time": "2018-01-19T16:01:18", "url": "https://files.pythonhosted.org/packages/fd/5f/981bd90564db582a42036c4e87ec2057e53cd0654668429bc8faf80416ee/scutils-1.3.0.dev4.tar.gz" } ], "1.3.0.dev5": [ { "comment_text": "", "digests": { "md5": "faed89413d789d1d9352c56b91b9e7f9", "sha256": "38ae4b21cff55484ff50ca0f88bbbec8117bf39af1d3f100c6f8991f9f1a1e0c" }, "downloads": -1, "filename": "scutils-1.3.0.dev5.tar.gz", "has_sig": false, "md5_digest": "faed89413d789d1d9352c56b91b9e7f9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18352, "upload_time": "2019-07-22T18:51:17", "url": "https://files.pythonhosted.org/packages/6e/78/5594ed810b8ac81979b20a10f6f79ffeb2aeb6da4e98353f1385925d3e8c/scutils-1.3.0.dev5.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "71f0c187e38ccc935144e44c6feff013", "sha256": "2193e5733d9da2f6a2c91aa204f5d91d0c2d3a7ec61c65159a546d56ebbbf555" }, "downloads": -1, "filename": "scutils-1.2.0.tar.gz", "has_sig": false, "md5_digest": "71f0c187e38ccc935144e44c6feff013", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 18082, "upload_time": "2017-03-29T22:22:03", "url": "https://files.pythonhosted.org/packages/9b/99/b56cc417866f529b3ebe0d19f43ae6d25eeb47363c1258b7c4e1ce432a0c/scutils-1.2.0.tar.gz" } ] }