{ "info": { "author": "Rob Clarke", "author_email": "rob.clarke@cocoon.life", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Programming Language :: Python" ], "description": "==========\ns3logparse\n==========\n\nA simple tool for parsing AWS S3 access logs. Can either be used from Python or via a command line wrapper. \n\nInstallation\n------------\n\nUse pip\n\n.. code:: console\n\n pip install s3-log-parse\n\n\nCommand Line usage\n------------------\n\nThe s3logparse command line script will reformat logs according to the following conventions\n\n- All fields are tab separated\n- No fields are quoted\n- Null text fields (represented by -) are empty\n- Timestamp is ISO8601 formatted\n- Null numeric fields are converted to 0\n\nThe script can accept a single argument, the name of a log file\n\n.. code:: console\n\n s3logparse mys3logfile.txt\n\npiping will also work\n\n.. code:: console\n\n cat allmys3logs/* | s3logparse\n\n\nPython API\n----------\n\nThe parse_log_lines function iterates over raw log lines and converts them to a namedtuple with the following attributes: bucket_owner, bucket, timestamp, remote_ip, requester, request_id, operation, s3_key, request_uri, status_code, error_code, bytes_sent, object_size, total_time, turn_around_time, referrer, user_agent, version_id\n\nHere is a simple example which extracts IP addresses from logs\n\n.. code:: python\n\n from s3logparse import s3logparse\n\n with open('mys3logs.txt') as fh:\n for log_entry in parse_log_lines(fh.readlines()):\n print(log_entry.ip_address)\n\n\n", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/cocoonlife/s3-log-parse", "keywords": null, "license": "UNKNOWN", "maintainer": null, "maintainer_email": null, "name": "s3-log-parse", "package_url": "https://pypi.org/project/s3-log-parse/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/s3-log-parse/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/cocoonlife/s3-log-parse" }, "release_url": "https://pypi.org/project/s3-log-parse/0.1.1/", "requires_dist": null, "requires_python": null, "summary": "Tool for procesing AWS S3 access logs", "version": "0.1.1" }, "last_serial": 2955065, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "956f3aadfa88e2f40f33bb6ba8285ae0", "sha256": "794a759b1a328406c15bc0f51881aea960995813fca6393a275f877b98ee6c2b" }, "downloads": -1, "filename": "s3-log-parse-0.1.0.tar.gz", "has_sig": false, "md5_digest": "956f3aadfa88e2f40f33bb6ba8285ae0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2885, "upload_time": "2017-06-16T16:59:32", "url": "https://files.pythonhosted.org/packages/8b/b6/b6d089d3ef8b7c8525549b562a37370b2def661d06acf7ca0ed120aaceba/s3-log-parse-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "9904588a3d84d2212522db2435e5a0de", "sha256": "2cef0a2f7638c566b7fd7e33e421d300c2ba25fb89bb8b0a353a30f5147453c3" }, "downloads": -1, "filename": "s3-log-parse-0.1.1.tar.gz", "has_sig": false, "md5_digest": "9904588a3d84d2212522db2435e5a0de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2874, "upload_time": "2017-06-16T17:03:58", "url": "https://files.pythonhosted.org/packages/4a/62/e0e3c9320897aa33f81d84068d23f2c1929670eac3d8c8dde7621a3e50ad/s3-log-parse-0.1.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "9904588a3d84d2212522db2435e5a0de", "sha256": "2cef0a2f7638c566b7fd7e33e421d300c2ba25fb89bb8b0a353a30f5147453c3" }, "downloads": -1, "filename": "s3-log-parse-0.1.1.tar.gz", "has_sig": false, "md5_digest": "9904588a3d84d2212522db2435e5a0de", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2874, "upload_time": "2017-06-16T17:03:58", "url": "https://files.pythonhosted.org/packages/4a/62/e0e3c9320897aa33f81d84068d23f2c1929670eac3d8c8dde7621a3e50ad/s3-log-parse-0.1.1.tar.gz" } ] }