{ "info": { "author": "Nathan Muir", "author_email": "ndmuir@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "Celery CloudWatch\n=================\n\nMonitor your `celery `_ application from\nwithin `AWS CloudWatch `_!\n\nMetrics\n-------\n\nThe following events are tallied per task:\n\n- CeleryEventSent\n- CeleryEventStarted\n- CeleryEventSucceeded\n- CeleryEventFailed\n\nYou can then see how many tasks/day, tasks/week etc are being completed.\n\nAlso, we record the total waiting/running per task:\n\n- CeleryNumWaiting\n- CeleryNumRunning\n\nAlso, statistics on task duration are sent in the metrics:\n\n- CeleryQueuedTime\n- CeleryProcessingTime\n\nThese metrics are sent with all supported stats (No. Events, Sum, Max,\nMin), allowing you to gain insight into your task processing and match\nrequests and capacity.\n\nGetting Started\n===============\n\n1. Set up an `IAM\n Role `_\n for your instance.\n\n It must include a policy to perform 'PutMetricData', eg:\n\n ::\n\n {\n \"Version\": \"2000-01-01\",\n \"Statement\": [\n {\n \"Effect\": \"Allow\",\n \"Action\": [\n \"cloudwatch:PutMetricData\"\n ],\n \"Resource\": [\n \"*\"\n ]\n }\n ]\n }\n\n (Note: Alternatively, you can set up a ``User`` with the same policy\n and provide access details that way)\n\n2. Install via ``python-pip`` (and upgrade pip & boto)\n\n ::\n\n sudo apt-get install -y python-pip\n sudo pip install --upgrade pip boto\n\n # Install directly\n sudo pip install celery-cloudwatch\n\n # OR, install in a virtualenv\n sudo apt-get install -y python-virtualenv\n mkdir /var/python-envs\n virtualenv /var/python-envs/ccwatch\n source /var/python-envs/ccwatch/bin/activate\n pip install celery-cloudwatch\n\n3. Create your own ``boto.cfg`` at ``/etc/boto.cfg``-\n\n ::\n\n [Credentials]\n # if not using an IAM Role - provide aws key/secret\n aws_access_key_id = xxx\n aws_secret_access_key = yyy\n\n [Boto]\n cloudwatch_region_name = my-region\n cloudwatch_region_endpoint = monitoring.my-region.amazonaws.com\n\n4. Create your own config file in ``/etc/ccwatch.yaml``\n\n ::\n\n ccwatch:\n broker: null\n camera: celery_cloudwatch.CloudWatchCamera\n verbose: no\n camera:\n frequency: 60.0\n verbose: no\n cloudwatch-camera:\n dryrun: no\n namespace: celery\n tasks:\n - myapp.mytasks.taskname\n - myapp.mytasks.anothertask\n - myapp.mytasks.thirdtask\n - name: myapp.secondarytasks\n dimensions:\n task: myapp.secondarytasks\n customDim: value\n - name: myapp.tertiarytasks\n dimensions:\n task: myapp.tertiarytasks\n customDim: value\n\n5. Install upstart\n\n Create a file ``/etc/init/celery-cloudwatch.conf``-\n\n ::\n\n description \"Celery CloudWatch\"\n author \"nathan muir \"\n\n setuid nobody\n setgid nogroup\n\n start on runlevel [234]\n stop on runlevel [0156]\n\n exec /var/python-envs/ccwatch/bin/ccwatch\n respawn\n\n then-\n\n ::\n\n sudo initctl reload-configuration\n sudo service celery-cloudwatch start\n\n6. Start Celery your celery workers with the ``-E`` (or\n ``CELERY_SEND_EVENTS=1`` and ``CELERY_TRACK_STARTED=1``) options,\n and, start celery clients with ``CELERY_SEND_TASK_SENT_EVENT=1``\n\n7. All done! head over to your CloudWatch monitoring page to see the\n results!", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/3stack-software/celery-cloudwatch", "keywords": "celery cloudwatch monitor stats", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "celery-cloudwatch", "package_url": "https://pypi.org/project/celery-cloudwatch/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/celery-cloudwatch/", "project_urls": { "Homepage": "https://github.com/3stack-software/celery-cloudwatch" }, "release_url": "https://pypi.org/project/celery-cloudwatch/1.1.1/", "requires_dist": null, "requires_python": "", "summary": "A monitor for celery queues that reports to AWS CloudWatch", "version": "1.1.1" }, "last_serial": 2753402, "releases": { "1.0.0a": [ { "comment_text": "", "digests": { "md5": "f9e53812e64d7411ebb20f2ace1277d3", "sha256": "da1067749c63721c4f057ca507bd3888df1e92957c0475d7937cf8c8e0c0d779" }, "downloads": -1, "filename": "celery-cloudwatch-1.0.0a.tar.gz", "has_sig": false, "md5_digest": "f9e53812e64d7411ebb20f2ace1277d3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9128, "upload_time": "2015-02-15T12:36:01", "url": "https://files.pythonhosted.org/packages/d4/74/cdf40f49e08b89be15bf3263abdf24b4c78b7e1893fffae407e156361cdd/celery-cloudwatch-1.0.0a.tar.gz" } ], "1.1.0": [ { "comment_text": "", "digests": { "md5": "02823e53732ea42dc9af625db0945f2c", "sha256": "ff6bed24179da38acd7b261b6d83374f3e142fdb8dd4bb28647c75401d1d7886" }, "downloads": -1, "filename": "celery-cloudwatch-1.1.0.tar.gz", "has_sig": false, "md5_digest": "02823e53732ea42dc9af625db0945f2c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10944, "upload_time": "2016-09-21T23:41:33", "url": "https://files.pythonhosted.org/packages/60/5a/f3eca614c3d67b5ca0e84deef1940e9a39009a7f8121e235c78837ffe6cc/celery-cloudwatch-1.1.0.tar.gz" } ], "1.1.0.post0": [ { "comment_text": "", "digests": { "md5": "12829777241c20c741d6bf0d94dc573e", "sha256": "beb566154b158619ceafc4c017370cce2bf80b59a206c9b46c9c641f7037c855" }, "downloads": -1, "filename": "celery-cloudwatch-1.1.0.post0.tar.gz", "has_sig": false, "md5_digest": "12829777241c20c741d6bf0d94dc573e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10887, "upload_time": "2016-09-22T01:09:28", "url": "https://files.pythonhosted.org/packages/be/41/3e9979da76f30231e1011a6d2d547ef5b9135262c0eeea745f307a45efa3/celery-cloudwatch-1.1.0.post0.tar.gz" } ], "1.1.1": [ { "comment_text": "", "digests": { "md5": "0b5bead1633c7a365b0a16bff46d66ce", "sha256": "745cde10fb98829cafe78e8908ecbba6a6de01e7811e8ac3427a01757f10c21d" }, "downloads": -1, "filename": "celery-cloudwatch-1.1.1.tar.gz", "has_sig": false, "md5_digest": "0b5bead1633c7a365b0a16bff46d66ce", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10873, "upload_time": "2017-04-04T22:33:45", "url": "https://files.pythonhosted.org/packages/83/75/4c4bfe146c822ca53770fc5466e7f486b0315bcce01dfe6ad6e680f358bf/celery-cloudwatch-1.1.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "0b5bead1633c7a365b0a16bff46d66ce", "sha256": "745cde10fb98829cafe78e8908ecbba6a6de01e7811e8ac3427a01757f10c21d" }, "downloads": -1, "filename": "celery-cloudwatch-1.1.1.tar.gz", "has_sig": false, "md5_digest": "0b5bead1633c7a365b0a16bff46d66ce", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10873, "upload_time": "2017-04-04T22:33:45", "url": "https://files.pythonhosted.org/packages/83/75/4c4bfe146c822ca53770fc5466e7f486b0315bcce01dfe6ad6e680f358bf/celery-cloudwatch-1.1.1.tar.gz" } ] }