{
    "info": {
        "author": "Zak Hassan",
        "author_email": "zak.hassan@redhat.com",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 1 - Planning",
            "Natural Language :: English",
            "Programming Language :: Python :: 3.6"
        ],
        "description": "\nLog Anomaly Detector\n====================\nLog anomaly detector is an open source project code named \"Project Scorpio\". LAD is also used for short. It can connect to streaming sources and produce predictions of abnormal log lines. Internally it uses unsupervised machine learning. We incorporate a number of machine learning models to achieve this result. In addition it includes a human in the loop feedback system. \n\n\n\nProject background\n==================\nThe original goal for this project was to develop an automated means of notifying users when problems occur with their applications based on the information contained in their application logs. Unfortunately logs are full of messages that contain warnings or even errors that are safe to ignore, so simple \u201cfind-keyword\u201d methods are insufficient . In addition, the number of logs are increasing constantly and no human will, or can, monitor them all. In short, our original aim was to employ natural language processing tools for text encoding and machine learning methods for automated anomaly detection, in an effort to construct a tool that could help developers perform root cause analysis more quickly on failing applications by highlighting the logs most likely to provide insight into the problem or to generate an alert if an application starts to produce a high frequency of anomalous logs.\n\nComponents\n----------\nIt currently contains the following components:\n\n\n1. LAD-Core: Contains custom code to train model and predict if a log line is an anomaly. We are currently use W2V (word 2 vec) and SOM (self organizing map) with unsupervised machine learning. We are planning to add more models.\n2. Metrics: To monitor this system in production we utilize grafana and prometheus to visualize the health of this machine learning system.\n3. Fact-Store: In addition we have a metadata registry for tracking feedback from false_positives in the machine learning system and to providing a method for ML to self correcting false predictions called the \u201cfact-store\u201d.\n\nInstalling\n==========\n\nInstall Log Anomaly Detector (LAD):\n\n\n`pip install -i https://test.pypi.org/simple/ scorpio`\n\n\n`LAD requires python 3.6 or greater`\n\nDocumentation\n-------------\nOfficial documentation for LAD can be found at `https://log-anomaly-detector.readthedocs.io/en/latest`\n\nCommunity\n---------\nFor help or questions about Log Anomaly Detector usage (e.g. \"how do I do X?\") then you can open an issue and mark it as question. One of our engineers would be glad to answer.\n\nTo report a bug, file a documentation issue, or submit a feature request, please open a GitHub issue.\n\nFor release announcements and other discussions, please subscribe to our mailing list (`https://groups.google.com/forum/#!members/aiops`)\n\nMajor updates will be presented at our  AiOps special interest group meeting which is a part of openshift commons\n\nOpenShift Commons AiOps Sig Calendar: `https://bit.ly/2lMn6yU`\n\n\n\nContributing\n============\nWe happily welcome contributions to LAD. Please see our\u00a0contribution guide\u00a0for details.\n\n\n\n\n\n\n",
        "description_content_type": "text/markdown",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/AICoE/log-anomaly-detector",
        "keywords": "",
        "license": "",
        "maintainer": "",
        "maintainer_email": "",
        "name": "log-anomaly-detector",
        "package_url": "https://pypi.org/project/log-anomaly-detector/",
        "platform": "",
        "project_url": "https://pypi.org/project/log-anomaly-detector/",
        "project_urls": {
            "Homepage": "https://github.com/AICoE/log-anomaly-detector"
        },
        "release_url": "https://pypi.org/project/log-anomaly-detector/0.0.1b5/",
        "requires_dist": [
            "Click",
            "elasticsearch5",
            "gensim",
            "matplotlib",
            "numpy",
            "pandas",
            "prometheus-client",
            "Flask (==1.0.4)",
            "scikit-learn",
            "scipy",
            "tqdm",
            "SQLAlchemy",
            "PyMySQL",
            "sompy",
            "pyyaml",
            "boto3",
            "numba",
            "kafka-python",
            "jaeger-client",
            "opentracing-instrumentation"
        ],
        "requires_python": ">3.5",
        "summary": "Log anomaly detector for streaming logs",
        "version": "0.0.1b5"
    },
    "last_serial": 5951375,
    "releases": {
        "0.0.1b3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f213776a034e879260c6e4f681331629",
                    "sha256": "1670cb6f379572291fe058fbdb1ad5d082f3177e8a7690f8d63ea7fe49cfb652"
                },
                "downloads": -1,
                "filename": "log_anomaly_detector-0.0.1b3-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "f213776a034e879260c6e4f681331629",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">3.5",
                "size": 49509,
                "upload_time": "2019-09-18T13:51:07",
                "url": "https://files.pythonhosted.org/packages/e6/55/e47f8cb21fcea71fb94ef543e41970cdc5eb388181be3e0f8a0f7c2a1ab5/log_anomaly_detector-0.0.1b3-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "9284620a51fe8d75f471cb0a2bd9adcf",
                    "sha256": "e0096f6bbfc6a0ab4d7f588e1eb5a1d8834793c37e0c6b4581ecf1fb486aac16"
                },
                "downloads": -1,
                "filename": "log-anomaly-detector-0.0.1b3.tar.gz",
                "has_sig": false,
                "md5_digest": "9284620a51fe8d75f471cb0a2bd9adcf",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">3.5",
                "size": 24768,
                "upload_time": "2019-09-18T13:51:09",
                "url": "https://files.pythonhosted.org/packages/27/9e/32adde31245ee6c1955a968db72c3d6ca73e27f4b51ea775740e634d3959/log-anomaly-detector-0.0.1b3.tar.gz"
            }
        ],
        "0.0.1b4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "61fcacc127f8729fc68c7a9a08d55f26",
                    "sha256": "ba086d0fe8ed0fa143b5aadd02fbe864b155bad271a396e835b04a3f2010759b"
                },
                "downloads": -1,
                "filename": "log_anomaly_detector-0.0.1b4-py3.6.egg",
                "has_sig": false,
                "md5_digest": "61fcacc127f8729fc68c7a9a08d55f26",
                "packagetype": "bdist_egg",
                "python_version": "3.6",
                "requires_python": ">3.5",
                "size": 40191,
                "upload_time": "2019-10-09T18:32:48",
                "url": "https://files.pythonhosted.org/packages/52/fb/6e0e8da8f0c72f764a115ddacc1b3c803b85b89d1b15294bf6fe60d425a9/log_anomaly_detector-0.0.1b4-py3.6.egg"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "64d41166bfb15c03df4308021e66d8fc",
                    "sha256": "4b4c0316ba526544d180f14385c22702b200eb23a89bfa12792c27803b4eac50"
                },
                "downloads": -1,
                "filename": "log_anomaly_detector-0.0.1b4-py3.7.egg",
                "has_sig": false,
                "md5_digest": "64d41166bfb15c03df4308021e66d8fc",
                "packagetype": "bdist_egg",
                "python_version": "3.7",
                "requires_python": ">3.5",
                "size": 40191,
                "upload_time": "2019-10-09T18:32:50",
                "url": "https://files.pythonhosted.org/packages/36/09/e5f9f71118dc5cd6a05eaa94633510afb38dac0d343a46156dd2a8d6c7d7/log_anomaly_detector-0.0.1b4-py3.7.egg"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "4f11f57beb6cc2c326fe1fe30fffe690",
                    "sha256": "50174117d1a9a6b38a8c99914322b3a62ebfa069a66942028fd5a4f7bf24c0a0"
                },
                "downloads": -1,
                "filename": "log_anomaly_detector-0.0.1b4-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "4f11f57beb6cc2c326fe1fe30fffe690",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">3.5",
                "size": 54693,
                "upload_time": "2019-10-09T17:33:57",
                "url": "https://files.pythonhosted.org/packages/f7/d9/59b232f2d1d4eeb01c3722d2e7a796e65c341a95d9a818822b0a6c0218c2/log_anomaly_detector-0.0.1b4-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "5d63402d3bafd35a4cd9af67ae2ec646",
                    "sha256": "46fbb153664d5ce3fb387f0b7b8e09f67d10d11e66471087a21499c94ae7bf96"
                },
                "downloads": -1,
                "filename": "log-anomaly-detector-0.0.1b4.tar.gz",
                "has_sig": false,
                "md5_digest": "5d63402d3bafd35a4cd9af67ae2ec646",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">3.5",
                "size": 27233,
                "upload_time": "2019-10-09T17:33:59",
                "url": "https://files.pythonhosted.org/packages/bd/25/c1f374520a2d04af8f43837a9f88f77507a0126c604405444372282a3441/log-anomaly-detector-0.0.1b4.tar.gz"
            }
        ],
        "0.0.1b5": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "bb81dc6a757c15666181472c2879a80d",
                    "sha256": "90ad392693cc44c9987271fe483f85fd9b35d18c5cd15960e84a24d133cf29f5"
                },
                "downloads": -1,
                "filename": "log_anomaly_detector-0.0.1b5-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "bb81dc6a757c15666181472c2879a80d",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">3.5",
                "size": 54712,
                "upload_time": "2019-10-09T18:32:46",
                "url": "https://files.pythonhosted.org/packages/03/51/e378f1aa51b64ef6a57541121192d9fceaed00c27ff4de55ae48df823bbb/log_anomaly_detector-0.0.1b5-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "e723deb2d8e5a671fba9ad3005c258d9",
                    "sha256": "219fb3567b6d5a4921816150519a1913d5a687aee951a8931f04d7638a43c98f"
                },
                "downloads": -1,
                "filename": "log-anomaly-detector-0.0.1b5.tar.gz",
                "has_sig": false,
                "md5_digest": "e723deb2d8e5a671fba9ad3005c258d9",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">3.5",
                "size": 27388,
                "upload_time": "2019-10-09T18:32:51",
                "url": "https://files.pythonhosted.org/packages/74/25/2e06ddebf0d03267585b4f6bcbb297c99efa3461afbdd5eded27b6164b84/log-anomaly-detector-0.0.1b5.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "bb81dc6a757c15666181472c2879a80d",
                "sha256": "90ad392693cc44c9987271fe483f85fd9b35d18c5cd15960e84a24d133cf29f5"
            },
            "downloads": -1,
            "filename": "log_anomaly_detector-0.0.1b5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "bb81dc6a757c15666181472c2879a80d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">3.5",
            "size": 54712,
            "upload_time": "2019-10-09T18:32:46",
            "url": "https://files.pythonhosted.org/packages/03/51/e378f1aa51b64ef6a57541121192d9fceaed00c27ff4de55ae48df823bbb/log_anomaly_detector-0.0.1b5-py3-none-any.whl"
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "e723deb2d8e5a671fba9ad3005c258d9",
                "sha256": "219fb3567b6d5a4921816150519a1913d5a687aee951a8931f04d7638a43c98f"
            },
            "downloads": -1,
            "filename": "log-anomaly-detector-0.0.1b5.tar.gz",
            "has_sig": false,
            "md5_digest": "e723deb2d8e5a671fba9ad3005c258d9",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">3.5",
            "size": 27388,
            "upload_time": "2019-10-09T18:32:51",
            "url": "https://files.pythonhosted.org/packages/74/25/2e06ddebf0d03267585b4f6bcbb297c99efa3461afbdd5eded27b6164b84/log-anomaly-detector-0.0.1b5.tar.gz"
        }
    ]
}