{ "info": { "author": "Rio Goodman", "author_email": "riogoodman@gmail.com", "bugtrack_url": null, "classifiers": [], "description": "SQS Workers\n===========\n\nSQS Workers gives the ability to process messages off an SQS queue using\nmultiple worker threads. It uses python multithreading to optimize CPU\nusage since a good portion of time is spent requesting messages and\npolling the SQS queue. It can be used similarly to an AWS Lambda which\ncannot (as of right now) be used in conjunction with SQS.\n\nVersions\n========\n\n:: 1.2 - support for bulk processing\n 1.1 - revert to best known working version 0.1.12\n 0.2.0 - rewrite implemention on top of concurrent.futures; adds tests\n 0.1.13 - support bulk message processor \n 0.1.12 - adding exception handler\n 0.1.11 - customize queue polling\n 0.1.10 - increase to max wait time for polling\n 0.1.9 - get messageattributenames \n 0.1.8 - tweaks for public pypi\n 0.1.7 - bugfix for thread naming\n 0.1.6 - bugfix for emptry sentry client\n 0.1.5 - bugfix for pip install\n 0.1.4 - support for elasticmq\n 0.1.2 - initial version\n\nUsage\n=====\n\nA basic call to SQS Workers would look like this:\n\n.. code:: python\n\n options = {\n 'sqs_session': sqs_session,\n 'queue_name': 'ddev-test-queue',\n 'sqs_resource': sqs_resource,\n 'MessageProcessor': MsgProcessor,\n 'logger': msg_logger,\n 'statsd': statsd,\n 'sentry': None,\n 'worker_limit': 1\n }\n c = Crew(**options)\n\n\nA basic call to SQS Workers for Bulk Processing would look like this:\n\n.. code:: python\n\n options = {\n 'sqs_session': sqs_session,\n 'queue_name': 'ddev-test-queue',\n 'sqs_resource': sqs_resource,\n 'MessageProcessor': MsgProcessor,\n 'logger': msg_logger,\n 'statsd': statsd,\n 'sentry': None,\n 'worker_limit': 1,\n 'bulk_mode': True\n\n }\n c = Crew(**options)\n\n\nInstallation\n============\n\nAdd SQS Workers to your package dependencies\n\n*requirements.txt*\n\n::\n\n sqsworkers\n\nAnd then install using pip ``pip install -r requirements.txt``\n\nTests\n=====\n\nMake sure tests pass: ``pytest tests/test_crew.py``\n\nContributors\n============\n\nPull requests, issues and comments welcome. For pull requests:\n\n- Add tests for new features and bug fixes\n- Follow the existing style\n- Separate unrelated changes into multiple pull requests\n\nSee the existing issues for things to start contributing.\n\nFor bigger changes, make sure you start a discussion first by creating\nan issue and explaining the intended change.\n\nAtlassian requires contributors to sign a Contributor License Agreement,\nknown as a CLA. This serves as a record stating that the contributor is\nentitled to contribute the code/documentation/translation to the project\nand is willing to have it used in distributions and derivative works (or\nis willing to transfer ownership).\n\nPrior to accepting your contributions we ask that you please follow the\nappropriate link below to digitally sign the CLA. The Corporate CLA is\nfor those who are contributing as a member of an organization and the\nindividual CLA is for those contributing as an individual.\n\n- `CLA for corporate\n contributors `__\n- `CLA for\n individuals `__\n\nLicense\n=======\n\nCopyright (c) 2017 Atlassian and others. Apache 2.0 licensed, see\n`LICENSE `__ file.", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/goodmanship/sqsworkers", "keywords": "", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "sqsworkers", "package_url": "https://pypi.org/project/sqsworkers/", "platform": "", "project_url": "https://pypi.org/project/sqsworkers/", "project_urls": { "Homepage": "https://github.com/goodmanship/sqsworkers" }, "release_url": "https://pypi.org/project/sqsworkers/1.2/", "requires_dist": null, "requires_python": "", "summary": "", "version": "1.2" }, "last_serial": 5908657, "releases": { "0.1.10": [ { "comment_text": "", "digests": { "md5": "06abfe4b552c44de0c91f0eecb7534d7", "sha256": "b165c6ab2c4187b105e99bc07e96736efe912d352c55354ce2f68b7cff2cec66" }, "downloads": -1, "filename": "sqsworkers-0.1.10.tar.gz", "has_sig": false, "md5_digest": "06abfe4b552c44de0c91f0eecb7534d7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4728, "upload_time": "2017-10-19T23:00:01", "url": "https://files.pythonhosted.org/packages/a1/50/3be9a491a92e9d05890e779fe4656f0528e5f0edd65b58f550a537e20617/sqsworkers-0.1.10.tar.gz" } ], "0.1.11": [ { "comment_text": "", "digests": { "md5": "9a60a113bb95e414bd4f079ca35eb8cc", "sha256": "90ec094855c0322acb49c2a3a1cdff7998b57903fc4d371bd016486035e56edd" }, "downloads": -1, "filename": "sqsworkers-0.1.11.tar.gz", "has_sig": false, "md5_digest": "9a60a113bb95e414bd4f079ca35eb8cc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4791, "upload_time": "2018-05-18T17:35:36", "url": "https://files.pythonhosted.org/packages/cc/52/4c85a6de4f8eb243b5b544c5ea0cf517bbb94d35e9f3c7d3cd16089a37d4/sqsworkers-0.1.11.tar.gz" } ], "0.1.12": [ { "comment_text": "", "digests": { "md5": "5eeb4b372cc634caa1c172453569405b", "sha256": "f2e1d46d263cdabe97dfed4b1f2ca9e732b2a371540a4bfb011d71531347d366" }, "downloads": -1, "filename": "sqsworkers-0.1.12.tar.gz", "has_sig": false, "md5_digest": "5eeb4b372cc634caa1c172453569405b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5176, "upload_time": "2018-06-25T22:11:54", "url": "https://files.pythonhosted.org/packages/e3/18/4a98e53ef6d29513a302345042bd083cff159a24855877719b890b17a4ac/sqsworkers-0.1.12.tar.gz" } ], "0.1.13": [ { "comment_text": "", "digests": { "md5": "b3c374373469e78457ed212247c59c2d", "sha256": "0618cf2c2cd949ea330ac3af3b15c8f478f41cb5518fed3172ba9ed5961adc12" }, "downloads": -1, "filename": "sqsworkers-0.1.13.tar.gz", "has_sig": false, "md5_digest": "b3c374373469e78457ed212247c59c2d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 6059, "upload_time": "2019-05-03T22:17:21", "url": "https://files.pythonhosted.org/packages/23/b9/7cf8b56596c8283e46bbc9a5eb97fa8751ea63dad4ab9b0996cebffd9a14/sqsworkers-0.1.13.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "7095c52024aa0f527e2812a403d52038", "sha256": "e958be38a9396623f8723ce999328a3bb06de5730178e586e4e56346135c58d4" }, "downloads": -1, "filename": "sqsworkers-0.1.7.tar.gz", "has_sig": false, "md5_digest": "7095c52024aa0f527e2812a403d52038", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4680, "upload_time": "2017-10-10T19:55:27", "url": "https://files.pythonhosted.org/packages/d5/0a/348fee41a92244c2e6f2fc6df18286755cc169311283676f5e6f6c078dde/sqsworkers-0.1.7.tar.gz" } ], "0.1.8": [ { "comment_text": "", "digests": { "md5": "aa80f2edaf417f2752c704e137c1fc3b", "sha256": "2da6d950dcb068eca6ce0ec0b02f76016615d45439020aa65590c9f4fdf957de" }, "downloads": -1, "filename": "sqsworkers-0.1.8.tar.gz", "has_sig": false, "md5_digest": "aa80f2edaf417f2752c704e137c1fc3b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4689, "upload_time": "2017-10-10T23:14:04", "url": "https://files.pythonhosted.org/packages/ed/02/6c0293aa04105e81548c31480b47b912b9dcef51d81b02e21a4d23eb5e02/sqsworkers-0.1.8.tar.gz" } ], "0.1.9": [ { "comment_text": "", "digests": { "md5": "9f7104d73bc6f95dbe0ee4e0a8141926", "sha256": "e5378b5b4c673207a881712c72fa6137b2ea4f3e84ac157bda898ff15a2b5c18" }, "downloads": -1, "filename": "sqsworkers-0.1.9.tar.gz", "has_sig": false, "md5_digest": "9f7104d73bc6f95dbe0ee4e0a8141926", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4697, "upload_time": "2017-10-18T20:08:14", "url": "https://files.pythonhosted.org/packages/60/a0/4503c1a256e33c657cae0460722ae33a1306e1b09995f38443b43739fc44/sqsworkers-0.1.9.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "9a88d6f3d155be3c80cc2386b03aa1d8", "sha256": "66bab4893e2274a8efb9b62e29a1552c11c6e6cc6b1255912d3eb14b0918d9ad" }, "downloads": -1, "filename": "sqsworkers-0.2.0.tar.gz", "has_sig": false, "md5_digest": "9a88d6f3d155be3c80cc2386b03aa1d8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7306, "upload_time": "2019-06-05T22:08:16", "url": "https://files.pythonhosted.org/packages/c8/0e/bd93ddcef715774fa7285a931208ce4b29797040015df8c1350f56a61b58/sqsworkers-0.2.0.tar.gz" } ], "0.2.2": [ { "comment_text": "", "digests": { "md5": "e3877d01ca29cfdd552b4b53a6e74208", "sha256": "dcf5717f7844785dada066fe9b37c22afbc24f4a76795afccfba4efe0067c430" }, "downloads": -1, "filename": "sqsworkers-0.2.2.tar.gz", "has_sig": false, "md5_digest": "e3877d01ca29cfdd552b4b53a6e74208", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7637, "upload_time": "2019-07-10T20:55:40", "url": "https://files.pythonhosted.org/packages/7a/98/5f909feab4b5aae32ca86f468a0e24dd23061c37c0af2f6c92be47f92164/sqsworkers-0.2.2.tar.gz" } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "34e53cb1033943770ee7d5a07e56397f", "sha256": "41637730dd73c4bec05d2ac0d6adea46802518280cc70ae5db89a78970dc44b6" }, "downloads": -1, "filename": "sqsworkers-0.2.3.tar.gz", "has_sig": false, "md5_digest": "34e53cb1033943770ee7d5a07e56397f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7660, "upload_time": "2019-07-12T22:01:39", "url": "https://files.pythonhosted.org/packages/0c/6f/abd2fdaedbfa6936c62f36331d10fdb79db7e9cccdf489770aaa20fa97bd/sqsworkers-0.2.3.tar.gz" } ], "0.2.4": [ { "comment_text": "", "digests": { "md5": "fc772521d8eb35cba611b2bf748be9ff", "sha256": "94bd843c4e2196d5f94c95c8489f6ffdceb119518f9eb6048aa35926e22eeb8b" }, "downloads": -1, "filename": "sqsworkers-0.2.4.tar.gz", "has_sig": false, "md5_digest": "fc772521d8eb35cba611b2bf748be9ff", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7643, "upload_time": "2019-07-17T22:41:59", "url": "https://files.pythonhosted.org/packages/5d/ae/1de835467d92f5b271bffd401b52bbf62e439128ef4b01b57399a41ae2ef/sqsworkers-0.2.4.tar.gz" } ], "0.2.5": [ { "comment_text": "", "digests": { "md5": "37f3f0bc012c56cb5c6ed0e6f5346f75", "sha256": "18e652120b8ca0b1b414f37427a4d366478a052077231d008070d86ff9ba9c8f" }, "downloads": -1, "filename": "sqsworkers-0.2.5.tar.gz", "has_sig": false, "md5_digest": "37f3f0bc012c56cb5c6ed0e6f5346f75", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7920, "upload_time": "2019-07-19T22:12:06", "url": "https://files.pythonhosted.org/packages/09/0d/05cc6772138ac9ceb72bb94824221188f9d03f4281a41ffda05b0c385c29/sqsworkers-0.2.5.tar.gz" } ], "1.0": [ { "comment_text": "", "digests": { "md5": "7b58acbaa99ded84653c94c2f6f713fc", "sha256": "c952b65729ef9b1ecc5a7a21a391905ca7151d681cb49079695e84fa8ee030d0" }, "downloads": -1, "filename": "sqsworkers-1.0.tar.gz", "has_sig": false, "md5_digest": "7b58acbaa99ded84653c94c2f6f713fc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8072, "upload_time": "2019-08-05T19:40:45", "url": "https://files.pythonhosted.org/packages/8c/93/7dcc9c359e7c9c376eb9cf7f4df281b3f0150b193321483174917e453945/sqsworkers-1.0.tar.gz" } ], "1.1": [ { "comment_text": "", "digests": { "md5": "bae50e4d0d3a4bce2cd43b7c36634636", "sha256": "d534869a8eaf0eb7cc003e021adbf69b31b4b8fba71186dffb4a00c20d7737ac" }, "downloads": -1, "filename": "sqsworkers-1.1.tar.gz", "has_sig": false, "md5_digest": "bae50e4d0d3a4bce2cd43b7c36634636", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5246, "upload_time": "2019-09-25T20:26:12", "url": "https://files.pythonhosted.org/packages/d6/31/24c44156f7a9e3b584fe1fdd9d3eb91aa366c426e90acf04a99219827625/sqsworkers-1.1.tar.gz" } ], "1.2": [ { "comment_text": "", "digests": { "md5": "9ade2c7c989de987cc6e413730076458", "sha256": "311f900918e196019bf96b19b9c0a51cf13b0a7a133bfbf3a21570334507c6fd" }, "downloads": -1, "filename": "sqsworkers-1.2.tar.gz", "has_sig": false, "md5_digest": "9ade2c7c989de987cc6e413730076458", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5856, "upload_time": "2019-09-30T19:48:24", "url": "https://files.pythonhosted.org/packages/79/ca/b4ed3e2b71649c4b4c8d920d156963fe4cd3760c55738552d0d76f363850/sqsworkers-1.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "9ade2c7c989de987cc6e413730076458", "sha256": "311f900918e196019bf96b19b9c0a51cf13b0a7a133bfbf3a21570334507c6fd" }, "downloads": -1, "filename": "sqsworkers-1.2.tar.gz", "has_sig": false, "md5_digest": "9ade2c7c989de987cc6e413730076458", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5856, "upload_time": "2019-09-30T19:48:24", "url": "https://files.pythonhosted.org/packages/79/ca/b4ed3e2b71649c4b4c8d920d156963fe4cd3760c55738552d0d76f363850/sqsworkers-1.2.tar.gz" } ] }