{ "info": { "author": "m_messiah", "author_email": "m.muzafarov@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Intended Audience :: System Administrators", "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Topic :: Utilities" ], "description": "S3 Logs Pusher\n==============\n\n.. image:: https://img.shields.io/pypi/v/s3logs.svg?style=flat-square\n :target: https://pypi.python.org/pypi/s3logs\n\n\n\n.. image:: https://img.shields.io/pypi/dm/s3logs.svg?style=flat-square\n :target: https://pypi.python.org/pypi/s3logs\n\nGet files from directory by mask and push them to S3\n\nInstall\n-------\n\n.. code:: bash\n\n pip install s3logs\n\nUsage\n-----\n\n.. code:: bash\n\n s3logs config.conf\n\nWhere config.conf can use that structure:\n\n.. code:: ini\n\n [S3]\n access_key = \n secret_key = \n host = \n bucket = \n chunk_size = \n\n [logs]\n\n suffix = .gz\n key_suffix = .gz\n directory = /var/log/nginx/\n depth = 30\n\n [map]\n\n example.com-access.log = example/access\n example.com-error.log = example/error\n mysite.me.access.log = mysite/access\n\nWhen it used with that config, script takes all files in directory `/var/log/nginx/`, filter only those, which ends with `.gz` and send it to S3, according to map.\n\nFor example, /var/log/nginx now consists of:\n\n.. code::\n\n example.com-access.log\n example.com-access.log.0.gz\n example.com-access.log.1.gz\n example.com-error.log\n example.com-error.log.0.gz\n example.com-error.log.1.gz\n mysite.me.access.log\n mysite.me.access.log.0.gz\n mysite.me.error.log\n mysite.me.error.log.0.gz\n\nSo, if today is 9 December 2015, and your hostname is node1, on your S3 `` would be those keys:\n\n.. code::\n\n node1/example/access/2015-12-09.gz\n node1/example/access/2015-12-08.gz\n node1/example/error/2015-12-09.gz\n node1/example/error/2015-12-08.gz\n node1/mysite/access/2015-12-09.gz\n\nBecause we have not explain how maps mysite.me.error.log.0.gz - it would be skipped.\n\nScript also checks whether file exists in S3 and push only those, which are not.\n\nParameter `depth` stops pushing, if filename is older, than `..gz`", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/m-messiah/s3logs", "keywords": "logs s3 nginx", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "s3logs", "package_url": "https://pypi.org/project/s3logs/", "platform": "", "project_url": "https://pypi.org/project/s3logs/", "project_urls": { "Homepage": "https://github.com/m-messiah/s3logs" }, "release_url": "https://pypi.org/project/s3logs/1.8/", "requires_dist": null, "requires_python": "", "summary": "Push logs to S3", "version": "1.8" }, "last_serial": 5931645, "releases": { "1.0": [ { "comment_text": "", "digests": { "md5": "7097898b4a8c42eb757fece2d2ec79fb", "sha256": "9a75e5b2443bdfefdae9c7ae9f5253ef239064ee7f77399a213d1133f18d275f" }, "downloads": -1, "filename": "s3logs-1.0.tar.gz", "has_sig": false, "md5_digest": "7097898b4a8c42eb757fece2d2ec79fb", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3232, "upload_time": "2015-12-10T07:11:29", "url": "https://files.pythonhosted.org/packages/83/7a/9839f50f38076232590ee1d306d8490ebcca9134afe76347260d8426257f/s3logs-1.0.tar.gz" } ], "1.1": [ { "comment_text": "", "digests": { "md5": "627a2574ac8437616c4295c34f4a63ae", "sha256": "72d02e1a6846f150511c11a52a343f7877e36708bd44d7c2bc54e848bed81e48" }, "downloads": -1, "filename": "s3logs-1.1.tar.gz", "has_sig": false, "md5_digest": "627a2574ac8437616c4295c34f4a63ae", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3262, "upload_time": "2015-12-10T07:37:11", "url": "https://files.pythonhosted.org/packages/a3/7a/762baa0d50f0f415c65168a2475cbc962106ac9f9d478b86fe2bebf7f781/s3logs-1.1.tar.gz" } ], "1.2": [ { "comment_text": "", "digests": { "md5": "294f9f9a0ef9634ff490329d83ccb2a5", "sha256": "a25a6d76ca3d8e3a585805452b73fdb04d19effa982a19d2adf0a0cfcfb2e27b" }, "downloads": -1, "filename": "s3logs-1.2.tar.gz", "has_sig": false, "md5_digest": "294f9f9a0ef9634ff490329d83ccb2a5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3279, "upload_time": "2015-12-10T09:30:48", "url": "https://files.pythonhosted.org/packages/f7/5a/c56124b911ea2566af1df1afd35248a60feea4d17ee16e0d89cd818633a6/s3logs-1.2.tar.gz" } ], "1.3": [ { "comment_text": "", "digests": { "md5": "f8f172accc65416113e8f7b97313f3af", "sha256": "63784c914811922cde82c214e61a7b6fbed87f3357f7a2645fb4174f2b47f2d3" }, "downloads": -1, "filename": "s3logs-1.3.tar.gz", "has_sig": false, "md5_digest": "f8f172accc65416113e8f7b97313f3af", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3292, "upload_time": "2015-12-15T13:34:34", "url": "https://files.pythonhosted.org/packages/f9/a8/412657fa703f3a1ecec04fd367f70726b3acf2078c220a1c92d875b2ef3c/s3logs-1.3.tar.gz" } ], "1.4": [ { "comment_text": "built for Darwin-15.3.0", "digests": { "md5": "a3aa24a790a6739de7ec0443a841e358", "sha256": "5cd691260978599d9bb8c07c83ff8168ee5ab80acd674a435dbb1b625a6a901d" }, "downloads": -1, "filename": "s3logs-1.4.macosx-10.11-x86_64.tar.gz", "has_sig": false, "md5_digest": "a3aa24a790a6739de7ec0443a841e358", "packagetype": "bdist_dumb", "python_version": "any", "requires_python": null, "size": 2761, "upload_time": "2016-02-02T13:00:37", "url": "https://files.pythonhosted.org/packages/e8/78/2fa0ec41a8128b21fc4a334c4ce4bd2540f4d4ddda0dfdf72103f60cbcc5/s3logs-1.4.macosx-10.11-x86_64.tar.gz" }, { "comment_text": "", "digests": { "md5": "cac003ec7d3db3361a5b3e2c522e99e4", "sha256": "e0671e8740b90b298492d1143a229bdd4267164774b20a21e83c656b6129369e" }, "downloads": -1, "filename": "s3logs-1.4.tar.gz", "has_sig": false, "md5_digest": "cac003ec7d3db3361a5b3e2c522e99e4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3295, "upload_time": "2016-02-02T13:00:27", "url": "https://files.pythonhosted.org/packages/19/a9/d5143eef2dbc3a36fc84ccb9d88c815d998f616b9a13098e025deb943895/s3logs-1.4.tar.gz" } ], "1.5": [ { "comment_text": "built for Darwin-15.3.0", "digests": { "md5": "203476c1943e83dabb539f77a1923907", "sha256": "9a8d4876707b748bab24f97853abb4eeda52fb2a22a74a6c9661c39afbcdbb94" }, "downloads": -1, "filename": "s3logs-1.5.macosx-10.11-x86_64.tar.gz", "has_sig": false, "md5_digest": "203476c1943e83dabb539f77a1923907", "packagetype": "bdist_dumb", "python_version": "any", "requires_python": null, "size": 2810, "upload_time": "2016-02-02T13:53:48", "url": "https://files.pythonhosted.org/packages/f9/4a/72535159cd598a2ab9cc344c95dac8477ec78c9baa030778d83fc6bbb7fb/s3logs-1.5.macosx-10.11-x86_64.tar.gz" }, { "comment_text": "", "digests": { "md5": "d007e1113d7035a45b032e71a162d159", "sha256": "1e6ca8553822d4f9de52fc3c9906a2dd9c96d3015b78bfff93bddd3796eb9068" }, "downloads": -1, "filename": "s3logs-1.5.tar.gz", "has_sig": false, "md5_digest": "d007e1113d7035a45b032e71a162d159", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3343, "upload_time": "2016-02-02T13:53:43", "url": "https://files.pythonhosted.org/packages/2c/b5/3391d6a505ef8944a485459d1c725b1bc80369ac59db2a6d1f34cd18c4b7/s3logs-1.5.tar.gz" } ], "1.6": [ { "comment_text": "built for Darwin-15.3.0", "digests": { "md5": "8f90fdee7ad3e1c52edd93fba353a111", "sha256": "2e87c98c397af111bd74b0b2bfd5d3bb48172d39d6961b0f4ce2d157a8cb30e8" }, "downloads": -1, "filename": "s3logs-1.6.macosx-10.11-x86_64.tar.gz", "has_sig": false, "md5_digest": "8f90fdee7ad3e1c52edd93fba353a111", "packagetype": "bdist_dumb", "python_version": "any", "requires_python": null, "size": 2905, "upload_time": "2016-02-02T14:04:45", "url": "https://files.pythonhosted.org/packages/c5/f2/32d4042e9b680f672efeea3e2e979ba213143fef9eb5cd9f81e14b05b808/s3logs-1.6.macosx-10.11-x86_64.tar.gz" }, { "comment_text": "", "digests": { "md5": "395d89dd3e10622141e1b3e0a303ad4e", "sha256": "3bed2ae05885b1f471bc927fb80f2365eb2d4e8ab4dd7758f4fd3d687efe812c" }, "downloads": -1, "filename": "s3logs-1.6.tar.gz", "has_sig": false, "md5_digest": "395d89dd3e10622141e1b3e0a303ad4e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3445, "upload_time": "2016-02-02T14:04:38", "url": "https://files.pythonhosted.org/packages/6c/45/68be6d0f55beb0368d6f42573867955bcec723dd86fedab98de4ca4140f5/s3logs-1.6.tar.gz" } ], "1.7": [ { "comment_text": "", "digests": { "md5": "555e07c1d265469fb8d36e940f612d1c", "sha256": "2d0600dfbe4fb47e014e1072c0030920191e69d0c459f4f0af7d87fa1d742ce0" }, "downloads": -1, "filename": "s3logs-1.7.tar.gz", "has_sig": false, "md5_digest": "555e07c1d265469fb8d36e940f612d1c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3884, "upload_time": "2016-07-11T17:24:23", "url": "https://files.pythonhosted.org/packages/56/1e/ca92749112101274c541402d47ccf9a3c3221f60a41b79ef99221fab4acc/s3logs-1.7.tar.gz" } ], "1.8": [ { "comment_text": "", "digests": { "md5": "41602c3742357e19abb41505ef62389d", "sha256": "88b7ed2e501465e4a770d44f80087b071f8ac0d376161dbfdb8449fa44c6612a" }, "downloads": -1, "filename": "s3logs-1.8.tar.gz", "has_sig": false, "md5_digest": "41602c3742357e19abb41505ef62389d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3729, "upload_time": "2019-10-05T10:34:00", "url": "https://files.pythonhosted.org/packages/1e/c4/1fc905d2dd3c56912ce3ce7d2b71fe61a5aa2f574c05e6a48c860ce3d8be/s3logs-1.8.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "41602c3742357e19abb41505ef62389d", "sha256": "88b7ed2e501465e4a770d44f80087b071f8ac0d376161dbfdb8449fa44c6612a" }, "downloads": -1, "filename": "s3logs-1.8.tar.gz", "has_sig": false, "md5_digest": "41602c3742357e19abb41505ef62389d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3729, "upload_time": "2019-10-05T10:34:00", "url": "https://files.pythonhosted.org/packages/1e/c4/1fc905d2dd3c56912ce3ce7d2b71fe61a5aa2f574c05e6a48c860ce3d8be/s3logs-1.8.tar.gz" } ] }