{ "info": { "author": "my8100", "author_email": "my8100@gmail.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: GNU General Public License v3 (GPLv3)", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.6" ], "description": "ScrapydWeb: Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization\n==========================\n\n[![PyPI - scrapydweb Version](https://img.shields.io/pypi/v/scrapydweb.svg)](https://pypi.org/project/scrapydweb/)\n[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/scrapydweb.svg)](https://pypi.org/project/scrapydweb/)\n[![Coverage Status](https://coveralls.io/repos/github/my8100/scrapydweb/badge.svg?branch=master)](https://coveralls.io/github/my8100/scrapydweb?branch=master)\n[![GitHub license](https://img.shields.io/github/license/my8100/scrapydweb.svg)](https://github.com/my8100/scrapydweb/blob/master/LICENSE)\n[![Twitter](https://img.shields.io/twitter/url/https/github.com/my8100/scrapydweb.svg?style=social)](https://twitter.com/intent/tweet?text=ScrapydWeb:%20Full-featured%20web%20UI%20for%20Scrapyd%20cluster%20management,%20Scrapy%20log%20analysis%20%26%20visualization%20%23python%20%20%23scrapy%20%23scrapyd%20%23webscraping%20%23scrapydweb%20@my8100_%20&url=https%3A%2F%2Fgithub.com%2Fmy8100%2Fscrapydweb)\n\nFeatures\n---------------\n\n- Scrapyd Cluster Management\n - Group, filter and select any numbers of nodes\n - Execute command on multinodes with one click\n\n- Scrapy Log Analysis\n - Stats collection\n - Progress visualization\n - Logs categorization\n\n- All Scrapyd API Supported\n - Deploy project, Run Spider, Stop job\n - List projects/versions/spiders/running_jobs\n - Delete version/project\n\n- Others\n - Auto eggifying\n - Basic auth for web UI\n - Accessing Scrapyd servers protected by basic auth\n\n\nDevolopers\n---------------\n- [my8100](https://github.com/my8100)\n- [simplety](https://github.com/simplety) (Front-End)\n\n\nInstallation\n------------\n\nTo install ScrapydWeb, simply use pip:\n\n```\npip install scrapydweb\n```\n\n\nStart Up\n------------\n\n1. Run `scrapydweb -h` to get help,\nand a config file named **scrapydweb_settings_vN.py** (N for a number) would be copied to current working directory,\nthen you can custom settings in it.\n2. Run `scrapydweb`\n3. Visit [http://127.0.0.1:5000](http://127.0.0.1:5000) **(It's recommended to use Google Chrome to get better experience.)**\n\n\nSettings\n---------------\n[default_settings.py](https://github.com/my8100/scrapydweb/blob/master/scrapydweb/default_settings.py)\n\n\nScreenshots\n------------\n\n- Overview\n![overview](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/overview.png)\n\n- Dashboard\n![dashboard](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/dashboard.png)\n\n- Log Analysis\n - Stats collection\n![log_stats](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_stats.png)\n\n - Progress visualization\n![log_charts](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_charts.png)\n\n - Logs categorization\n![log_logs](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_logs.png)\n\n- Deploy a Project\n![deploy](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/deploy.png)\n\n- Run a Spider\n![run](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/run.png)\n\n- Manage Projects\n![manage](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/manage.png)\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/my8100/scrapydweb", "keywords": "", "license": "GNU General Public License v3.0", "maintainer": "", "maintainer_email": "", "name": "scrapyd_UI", "package_url": "https://pypi.org/project/scrapyd_UI/", "platform": "", "project_url": "https://pypi.org/project/scrapyd_UI/", "project_urls": { "Homepage": "https://github.com/my8100/scrapydweb" }, "release_url": "https://pypi.org/project/scrapyd_UI/0.9.9/", "requires_dist": null, "requires_python": "", "summary": "Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization", "version": "0.9.9" }, "last_serial": 4413467, "releases": { "0.9.9": [ { "comment_text": "", "digests": { "md5": "26e8e59451e88058af468f1ba32dce7c", "sha256": "822a77550b7b91c89559cef29988111bfae5b8b265ea12ec1bf29badb845d0b7" }, "downloads": -1, "filename": "scrapyd_UI-0.9.9.tar.gz", "has_sig": false, "md5_digest": "26e8e59451e88058af468f1ba32dce7c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 617743, "upload_time": "2018-10-25T03:25:38", "url": "https://files.pythonhosted.org/packages/7e/fc/aa69ba9c80d45c2e27793fcbe3b318a008c45487efd2d26d3ae468e5cb8d/scrapyd_UI-0.9.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "26e8e59451e88058af468f1ba32dce7c", "sha256": "822a77550b7b91c89559cef29988111bfae5b8b265ea12ec1bf29badb845d0b7" }, "downloads": -1, "filename": "scrapyd_UI-0.9.9.tar.gz", "has_sig": false, "md5_digest": "26e8e59451e88058af468f1ba32dce7c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 617743, "upload_time": "2018-10-25T03:25:38", "url": "https://files.pythonhosted.org/packages/7e/fc/aa69ba9c80d45c2e27793fcbe3b318a008c45487efd2d26d3ae468e5cb8d/scrapyd_UI-0.9.9.tar.gz" } ] }