{
"info": {
"author": "Viktor Nagy",
"author_email": "v@pulilab.com",
"bugtrack_url": null,
"classifiers": [],
"description": "S3 Stat\n=======\n\nThis python module uses the really nice `goaccess `_ utility\nto provide you with an amazing Amazon log file analyser tool that is relatively easy to install, and is extremely\neasy to extend.\nGOACCESS version needed: 0.8.5 (it doesn't work with 0.9+)\n\nInstallation\n-------------\n\n::\n \n pip install s3stat\n\nThis installs `s3stat.py` in your PYTHONPATH in case you would like to run it from the command line.\n\nQuickstart\n------------\n\nInstall goaccess\n.................. \n\nYou should install `goaccess `_\n\n.. note::\n Cloudfront log file processing requires goaccess 0.7.1+\n\nGenerating an AWS user\n........................\n\nFirst you should create a user that has approriate rights to read your log files, and you should have its AWS access keys ready.\n\n#. Log in to the `aws console `_\n#. Create a new user and select the option to generate an access key for the user \n#. Save the access key and secure keys, as these will be needed soon \n#. Open the *Permissions* tab for the user, and attach a new user policy. Select custom policy, and copy the following::\n\n {\n \"Statement\": [\n {\n \"Sid\": \"Stmt1334764540928\",\n \"Action\": [\n \"s3:GetBucketAcl\",\n \"s3:GetBucketLogging\",\n \"s3:GetObject\",\n \"s3:ListAllMyBuckets\",\n \"s3:ListBucket\",\n \"s3:PutBucketAcl\",\n \"s3:PutBucketLogging\",\n \"s3:PutObject\",\n \"s3:PutObjectAcl\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws:s3:::*\"\n ]\n },\n {\n \"Sid\": \"Stmt1334764631669\",\n \"Action\": [\n \"cloudfront:GetDistribution\",\n \"cloudfront:GetDistributionConfig\",\n \"cloudfront:GetStreamingDistribution\",\n \"cloudfront:GetStreamingDistributionConfig\",\n \"cloudfront:ListDistributions\",\n \"cloudfront:ListStreamingDistributions\",\n \"cloudfront:UpdateDistribution\",\n \"cloudfront:UpdateStreamingDistribution\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n }\n ]\n }\n\nSet up logging in your buckets \n............................... \n\nFirst you should ask Amazon to generate logs for your buckets and cloudfront distributions. \n\nRun this script\n................ \n\n::\n\n s3stat.py \n\nThis will download all the log files for today, and start a goaccess instance in your console. \n\nFor further options you might run::\n\n s3stat.py -h\n\n\nExtending\n----------\n\nActually s3stat was designed to be easy to add to your pythonic workflow, as a result it defines \na single class that you can subclass to process the results in json format.::\n\n import s3stat\n\n class MyS3Stat(s3stat.S3Stat):\n\n def process_results(self, json):\n print json\n\n def process_error(self, exception, data=None):\n print data\n raise exception\n\n mytask = MyS3Stat(bucket, log_path, for_date, (aws_key, aws_secret))\n mytask.run()\n\nWhere the `aws_*` parameters are optional, if missing then they are taken from the environment variables as provided by boto.\nThe process_error method currently is called only when the JSON decoding fails, thus `data` is the non-decodeable string, while\nexception is the ValueError raised by Python.\n\nToDo\n-----\n\n* provide a command that adds logging to specified buckets and cloudfront distributions",
"description_content_type": null,
"docs_url": null,
"download_url": null,
"downloads": {
"last_day": -1,
"last_month": -1,
"last_week": -1
},
"home_page": "https://github.com/nagyv/s3stat",
"keywords": "s3stat amazon statistics goaccess",
"license": null,
"maintainer": null,
"maintainer_email": null,
"name": "s3stat",
"package_url": "https://pypi.org/project/s3stat/",
"platform": "UNKNOWN",
"project_url": "https://pypi.org/project/s3stat/",
"project_urls": {
"Homepage": "https://github.com/nagyv/s3stat"
},
"release_url": "https://pypi.org/project/s3stat/2.3.1/",
"requires_dist": null,
"requires_python": null,
"summary": "An extensible Amazon S3 and Cloudfront log parser.",
"version": "2.3.1"
},
"last_serial": 1545756,
"releases": {
"1.0.0": [
{
"comment_text": "",
"digests": {
"md5": "d3cdc85d620ba3a4b8e899f23b004678",
"sha256": "44e627c15b6b57069a0e652786d73ad17321e452b941fa78c1794c1c7c8f0932"
},
"downloads": -1,
"filename": "s3stat-1.0.0.tar.gz",
"has_sig": false,
"md5_digest": "d3cdc85d620ba3a4b8e899f23b004678",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4236,
"upload_time": "2014-05-06T19:40:52",
"url": "https://files.pythonhosted.org/packages/1b/eb/e1a15a8702f2e5e22a21baa6a223490007dd328a8c33dd9d75cae764a846/s3stat-1.0.0.tar.gz"
}
],
"1.0.2": [
{
"comment_text": "",
"digests": {
"md5": "52d5be7b7f3881df8e1891f7f4092a76",
"sha256": "3bafe5bb4b3b01e4cc27e21b1598a5799bbe7d98f033deb0846a1fd6689de136"
},
"downloads": -1,
"filename": "s3stat-1.0.2.tar.gz",
"has_sig": false,
"md5_digest": "52d5be7b7f3881df8e1891f7f4092a76",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4194,
"upload_time": "2014-05-06T19:52:57",
"url": "https://files.pythonhosted.org/packages/40/45/7d7214b008ca97c9b96a80a52e8f0f545714dfb39475a9161fdd7509fd92/s3stat-1.0.2.tar.gz"
}
],
"1.0.3": [
{
"comment_text": "",
"digests": {
"md5": "6fc5cc6ef2cf340db66a55c7cc1d97d7",
"sha256": "1da002a0a8da110b41c658215b0acbf082a5cae4f4defed8a7c85e314dad0b08"
},
"downloads": -1,
"filename": "s3stat-1.0.3.tar.gz",
"has_sig": false,
"md5_digest": "6fc5cc6ef2cf340db66a55c7cc1d97d7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4364,
"upload_time": "2014-05-06T20:24:55",
"url": "https://files.pythonhosted.org/packages/10/eb/328550857b579e4a7d52687ec2c7bdf58e912579103659c725f66d727491/s3stat-1.0.3.tar.gz"
}
],
"1.0.4": [
{
"comment_text": "",
"digests": {
"md5": "80bcabd475dfee206b509e7d08b00479",
"sha256": "283344c2e0aad55541689cac301104f7fd99f493f12d0950546abb0cb585cc66"
},
"downloads": -1,
"filename": "s3stat-1.0.4.tar.gz",
"has_sig": false,
"md5_digest": "80bcabd475dfee206b509e7d08b00479",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4399,
"upload_time": "2014-05-06T20:29:03",
"url": "https://files.pythonhosted.org/packages/2b/84/70547efde1fcfaeadee51bd74fbefe21b20f0976b3b07c0a023dabebece6/s3stat-1.0.4.tar.gz"
}
],
"1.1.0": [
{
"comment_text": "",
"digests": {
"md5": "7257e9546b941a67b6a02d5da2184ba0",
"sha256": "e87bca7c9e94480f8ad18b381b0908f95944e098765f5f20629cda67f216b24d"
},
"downloads": -1,
"filename": "s3stat-1.1.0.tar.gz",
"has_sig": false,
"md5_digest": "7257e9546b941a67b6a02d5da2184ba0",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4430,
"upload_time": "2014-05-08T15:03:37",
"url": "https://files.pythonhosted.org/packages/25/91/5e95067dc92dbdd64762f2282c78d3529369a0b3f640f887eba3fa4a7392/s3stat-1.1.0.tar.gz"
}
],
"2.0.0": [
{
"comment_text": "",
"digests": {
"md5": "f7238f4bd12e73a1bc8fe8d0d0e98e11",
"sha256": "75c0da747e2e394555de2f4b832ad451136dbadf24abc225cc94370749a7a8f1"
},
"downloads": -1,
"filename": "s3stat-2.0.0.tar.gz",
"has_sig": false,
"md5_digest": "f7238f4bd12e73a1bc8fe8d0d0e98e11",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4755,
"upload_time": "2014-05-09T08:28:41",
"url": "https://files.pythonhosted.org/packages/d3/e6/5ff5725d183fd5ff0244664af82c1029c89a81c0e5a148031a7b445f51dc/s3stat-2.0.0.tar.gz"
}
],
"2.0.1": [
{
"comment_text": "",
"digests": {
"md5": "1d5c503376cd018f88bc2beb36294d29",
"sha256": "9ba3792de6ae27812cd865095e4e45ac9cd3c621f99a66cda3b35156141d4576"
},
"downloads": -1,
"filename": "s3stat-2.0.1.tar.gz",
"has_sig": false,
"md5_digest": "1d5c503376cd018f88bc2beb36294d29",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 4845,
"upload_time": "2014-05-20T13:53:32",
"url": "https://files.pythonhosted.org/packages/f5/02/b5cbb73b40d41c16ab9398459ef6ba610096acacb83b2b88095d1157d90d/s3stat-2.0.1.tar.gz"
}
],
"2.1.0": [
{
"comment_text": "",
"digests": {
"md5": "a89dde8e066a21f9a957645599635f18",
"sha256": "a8f41961ccb6e2f5368a916d15586cf13c10d74b9bed0685124f182723a09f5a"
},
"downloads": -1,
"filename": "s3stat-2.1.0.tar.gz",
"has_sig": false,
"md5_digest": "a89dde8e066a21f9a957645599635f18",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 5136,
"upload_time": "2014-07-04T08:56:40",
"url": "https://files.pythonhosted.org/packages/1d/97/b2e74793088ec7a6a781a4786ae7646965093ea3ae66f456ba3623389919/s3stat-2.1.0.tar.gz"
}
],
"2.2.0": [
{
"comment_text": "",
"digests": {
"md5": "4d4e70ad6b3ca9f2700343a697bea390",
"sha256": "025334639f181b9edd3abd7f65932dc3e5c6a2b4ba59e6c622d275b1e222e1fb"
},
"downloads": -1,
"filename": "s3stat-2.2.0.tar.gz",
"has_sig": false,
"md5_digest": "4d4e70ad6b3ca9f2700343a697bea390",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 5292,
"upload_time": "2014-07-31T14:22:11",
"url": "https://files.pythonhosted.org/packages/13/17/09618bf35675f5b2206e7767b3ba92979e9d94dee9af74bf0ea618f6d886/s3stat-2.2.0.tar.gz"
}
],
"2.3.0": [
{
"comment_text": "",
"digests": {
"md5": "1d5ccb0a71cead3c0bc285fd497da601",
"sha256": "90d70499acf51991e13bea3f838541ded0ec1955ab03c0028889bfd810340c55"
},
"downloads": -1,
"filename": "s3stat-2.3.0.tar.gz",
"has_sig": false,
"md5_digest": "1d5ccb0a71cead3c0bc285fd497da601",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 5564,
"upload_time": "2014-10-20T15:19:28",
"url": "https://files.pythonhosted.org/packages/a0/3e/d5aa26321134f755b751b156af6307cbb32454516bc6d24dc931f8e862e0/s3stat-2.3.0.tar.gz"
}
],
"2.3.1": [
{
"comment_text": "",
"digests": {
"md5": "8cec5178a77ae5fb136c07bcdfdcbcb2",
"sha256": "80f6e933a022137493c5219ecb134ed79f66e0e75d5cd5e0478b5c73789e5b41"
},
"downloads": -1,
"filename": "s3stat-2.3.1.tar.gz",
"has_sig": false,
"md5_digest": "8cec5178a77ae5fb136c07bcdfdcbcb2",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 5659,
"upload_time": "2015-05-13T16:51:04",
"url": "https://files.pythonhosted.org/packages/3c/59/7193b1991c23ed57c96ff7988500fe918bcca243b33f4383b9b0306264c7/s3stat-2.3.1.tar.gz"
}
]
},
"urls": [
{
"comment_text": "",
"digests": {
"md5": "8cec5178a77ae5fb136c07bcdfdcbcb2",
"sha256": "80f6e933a022137493c5219ecb134ed79f66e0e75d5cd5e0478b5c73789e5b41"
},
"downloads": -1,
"filename": "s3stat-2.3.1.tar.gz",
"has_sig": false,
"md5_digest": "8cec5178a77ae5fb136c07bcdfdcbcb2",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 5659,
"upload_time": "2015-05-13T16:51:04",
"url": "https://files.pythonhosted.org/packages/3c/59/7193b1991c23ed57c96ff7988500fe918bcca243b33f4383b9b0306264c7/s3stat-2.3.1.tar.gz"
}
]
}