{ "info": { "author": "Brian Wylie", "author_email": "briford@supercowpowers.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 2 - Pre-Alpha", "Intended Audience :: Developers", "License :: OSI Approved :: Apache Software License", "Natural Language :: English", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy" ], "description": "## Zeek Analysis Tools (ZAT) [![travis](https://travis-ci.org/SuperCowPowers/zat.svg?branch=master)](https://travis-ci.org/SuperCowPowers/zat) [![codecov.io](http://codecov.io/github/SuperCowPowers/zat/coverage.svg?branch=master)](http://codecov.io/github/SuperCowPowers/zat?branch=master) [![supported-versions](https://img.shields.io/pypi/pyversions/zat.svg)](https://pypi.python.org/pypi/zat) [![license](https://img.shields.io/badge/License-Apache%202.0-green.svg)](https://choosealicense.com/licenses/apache-2.0)\n\nThe ZAT Python package supports the processing and analysis of Zeek data\nwith Pandas, scikit-learn, and Spark\n\n### Recent Improvements (Fall 2019):\n- Renamed to **Zeek** Analysis Tools \\:)\n- Better Docs ()\n- Faster/Smaller Pandas Dataframes for large log files: [Large Dataframes](https://supercowpowers.github.io/zat/large_dataframes.html)\n- Better Panda Dataframe to Matrix (ndarray) support: [Dataframe To Matrix](https://supercowpowers.github.io/zat/dataframe_to_matrix.html)\n- Scalable conversion from Zeek logs to Parquet: [Zeek to Parquet](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Parquet.ipynb)\n- Vastly improved Spark Dataframe Class: [Zeek to Spark](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Spark.ipynb)\n- Updated/improved Notebooks: [Analysis Notebooks](#analysis-notebooks)\n\n\n### BroCon 2017 Presentation\n\nData Analysis, Machine Learning, Bro, and You!\n([Video](https://www.youtube.com/watch?v=pG5lU9CLnIU))\n\n### Why ZAT?\n\nZeek already has a flexible, powerful scripting language why should I use\nZAT?\n\n**Offloading:** Running complex tasks like statistics, state machines,\nmachine learning, etc.. should be offloaded from Zeek so that Zeek can\nfocus on the efficient processing of high volume network traffic.\n\n**Data Analysis:** We have a large set of support classes that help\nbridge from raw Zeek data to packages like Pandas, scikit-learn, and\nSpark. We also have example notebooks that show step-by-step how to get\nfrom here to there.\n\n\n## Getting Started\n- [Examples of Using ZAT](https://supercowpowers.github.io/zat/examples.html)\n\n### Analysis Notebooks\n\n- [Zeek to Scikit-Learn](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Scikit_Learn.ipynb)\n- [Zeek to Parquet](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Parquet.ipynb)\n- [Zeek to Spark](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Spark.ipynb)\n- [Spark Clustering](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Spark_Clustering.ipynb)\n- [Zeek to Kafka](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Kafka.ipynb)\n- [Zeek to Kafka to Spark](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Kafka_to_Spark.ipynb)\n- [Clustering: Picking K (or not)](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Clustering_Picking_K.ipynb)\n- [Anomaly Detection Exploration](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Anomaly_Detection.ipynb)\n- [Risky Domains Stats and Deployment](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Risky_Domains.ipynb)\n- [Zeek to Matplotlib](https://nbviewer.jupyter.org/github/SuperCowPowers/zat/blob/master/notebooks/Zeek_to_Plot.ipynb)\n\n\n\n\n### Install\n\n $ pip install zat\n\n### Documentation\n\n\n\n### About SuperCowPowers\nThe company was formed so that its developers could follow their passion for Python, streaming data pipelines and having fun with data analysis. We also think cows are cool and should be superheros or at least carry around rayguns and burner phones. Visit SuperCowPowers\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/SuperCowPowers/zat", "keywords": "Zeek,Bro,Python,Networking,Security,Scikit-Learn,Spark,Kafka,Parquet", "license": "Apache", "maintainer": "", "maintainer_email": "", "name": "pyzeek", "package_url": "https://pypi.org/project/pyzeek/", "platform": "", "project_url": "https://pypi.org/project/pyzeek/", "project_urls": { "Homepage": "https://github.com/SuperCowPowers/zat" }, "release_url": "https://pypi.org/project/pyzeek/0.3.9/", "requires_dist": [ "requests", "watchdog", "numpy", "scipy", "pandas", "scikit-learn", "pyspark", "pyarrow", "yara-python ; extra == 'all'", "tldextract ; extra == 'all'" ], "requires_python": "", "summary": "Zeek Analysis Tools", "version": "0.3.9", "yanked": false, "yanked_reason": null }, "last_serial": 8202087, "releases": { "0.3.7": [ { "comment_text": "", "digests": { "md5": "0cd8d6475364f84dac07292e7936d126", "sha256": "3392d50f229ef53ba4de0b2c576ceae139db5f34fbfe77d6aa0112a5212f2d94" }, "downloads": -1, "filename": "pyzeek-0.3.7-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "0cd8d6475364f84dac07292e7936d126", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 165504, "upload_time": "2019-10-23T17:09:54", "upload_time_iso_8601": "2019-10-23T17:09:54.449899Z", "url": "https://files.pythonhosted.org/packages/43/db/be5d779c7395cd92cf61b0e6529b34bafd7c4888562004f44cff23b72176/pyzeek-0.3.7-py2.py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "07f1b8636b1af1e66bcf1d5cdbbe1ec8", "sha256": "b99b9ba9fa846a3a504bdccf89be5183cf324fb317bc793bb9e9278a927f5a77" }, "downloads": -1, "filename": "pyzeek-0.3.7.tar.gz", "has_sig": false, "md5_digest": "07f1b8636b1af1e66bcf1d5cdbbe1ec8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 142295, "upload_time": "2019-10-23T17:09:57", "upload_time_iso_8601": "2019-10-23T17:09:57.391442Z", "url": "https://files.pythonhosted.org/packages/7d/ce/b0eea52b5da3b923d5054e95788ac9ca8bb6186f276c293382e069b8b770/pyzeek-0.3.7.tar.gz", "yanked": false, "yanked_reason": null } ], "0.3.9": [ { "comment_text": "", "digests": { "md5": "0b94cc623446c12ca9c7f8d25ef15f9b", "sha256": "a14cefc920f466db1db2b99c762b7fec924614d84e40920b42cf631a2b7248a6" }, "downloads": -1, "filename": "pyzeek-0.3.9-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "0b94cc623446c12ca9c7f8d25ef15f9b", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 207338, "upload_time": "2020-09-16T18:47:54", "upload_time_iso_8601": "2020-09-16T18:47:54.859205Z", "url": "https://files.pythonhosted.org/packages/70/9c/03aa3f12343b4a62bc2a751e5c772560e9bc2167fecf3bd2e6c8f342fe86/pyzeek-0.3.9-py2.py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "54c5d8d7319823628dbd2ec6e5ccbe27", "sha256": "42798e38cced82ef0f7c4dc24926634b2832e16ec88eefede739a8bebedf020a" }, "downloads": -1, "filename": "pyzeek-0.3.9.tar.gz", "has_sig": false, "md5_digest": "54c5d8d7319823628dbd2ec6e5ccbe27", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 147953, "upload_time": "2020-09-16T18:47:56", "upload_time_iso_8601": "2020-09-16T18:47:56.296538Z", "url": "https://files.pythonhosted.org/packages/83/da/160fe10b62e967f109d6230d78b48b9b24195e9a7956e9bd5cd214694a56/pyzeek-0.3.9.tar.gz", "yanked": false, "yanked_reason": null } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "0b94cc623446c12ca9c7f8d25ef15f9b", "sha256": "a14cefc920f466db1db2b99c762b7fec924614d84e40920b42cf631a2b7248a6" }, "downloads": -1, "filename": "pyzeek-0.3.9-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "0b94cc623446c12ca9c7f8d25ef15f9b", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 207338, "upload_time": "2020-09-16T18:47:54", "upload_time_iso_8601": "2020-09-16T18:47:54.859205Z", "url": "https://files.pythonhosted.org/packages/70/9c/03aa3f12343b4a62bc2a751e5c772560e9bc2167fecf3bd2e6c8f342fe86/pyzeek-0.3.9-py2.py3-none-any.whl", "yanked": false, "yanked_reason": null }, { "comment_text": "", "digests": { "md5": "54c5d8d7319823628dbd2ec6e5ccbe27", "sha256": "42798e38cced82ef0f7c4dc24926634b2832e16ec88eefede739a8bebedf020a" }, "downloads": -1, "filename": "pyzeek-0.3.9.tar.gz", "has_sig": false, "md5_digest": "54c5d8d7319823628dbd2ec6e5ccbe27", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 147953, "upload_time": "2020-09-16T18:47:56", "upload_time_iso_8601": "2020-09-16T18:47:56.296538Z", "url": "https://files.pythonhosted.org/packages/83/da/160fe10b62e967f109d6230d78b48b9b24195e9a7956e9bd5cd214694a56/pyzeek-0.3.9.tar.gz", "yanked": false, "yanked_reason": null } ], "vulnerabilities": [] }