{ "info": { "author": "huangzhen", "author_email": "huangzhen@baixing.com", "bugtrack_url": null, "classifiers": [ "Environment :: Web Environment", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Operating System :: MacOS", "Operating System :: Microsoft", "Operating System :: POSIX", "Operating System :: Unix", "Programming Language :: Python :: 2.6", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Topic :: Internet", "Topic :: Multimedia :: Video", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "# spider-common\n\nCommon code used in python spider.\n\n## Changelog\nSee [CHANGELOG](CHANGELOG.md)\n\n## Project Structure\n- common_utils\n >\u901a\u7528\u5168\u5c40\u51fd\u6570\n- clue\n >clue(\u722c\u866b\u7ebf\u7d22)\u6a21\u5757\n- notify\n >\u4e8b\u4ef6\u3001\u4fe1\u53f7\u901a\u77e5\n- persistent\n >\u901a\u7528\u6570\u636e\u6a21\u578b\n \n >\u6293\u53d6\u6570\u636e\u6301\u4e45\u5316\n \n\u4ee3\u7801\u7ed3\u6784\uff1a\n```\n\u251c\u2500\u2500 clue\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 api.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 constants.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 models.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 scrapy\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 extensions.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 items.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 middlewares.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 pipelines.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 spider.py\n\u251c\u2500\u2500 common_utils\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 exceptions.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 time.py\n\u251c\u2500\u2500 __init__.py\n\u251c\u2500\u2500 notify\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 constants\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u2514\u2500\u2500 signals.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __pycache__\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 scrapy\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 extensions\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u2514\u2500\u2500 signal_handler.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 __init__.py\n\u251c\u2500\u2500 persistent\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 items\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u251c\u2500\u2500 base.py\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2502\u00a0\u00a0 \u2514\u2500\u2500 shop.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 scrapy\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 dw_logger.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 pipelines\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 dw_pipeline.py\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 __init__.py\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 mysql_pipeline.py\n```", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://gitlab.baixing.cn/spider/spider-common", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "spider-common", "package_url": "https://pypi.org/project/spider-common/", "platform": "", "project_url": "https://pypi.org/project/spider-common/", "project_urls": { "Homepage": "https://gitlab.baixing.cn/spider/spider-common" }, "release_url": "https://pypi.org/project/spider-common/0.0.1/", "requires_dist": null, "requires_python": "", "summary": "utils for spider, like middlewares, pipelines, common design implementation, etc", "version": "0.0.1" }, "last_serial": 5149347, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "79aa67e1554eb38c9441811f26f6d9e4", "sha256": "5991b457b60ec399b4423001413c2975b311df46cd133f29c11c22aa1eb2c98f" }, "downloads": -1, "filename": "spider_common-0.0.1-py3.6.egg", "has_sig": false, "md5_digest": "79aa67e1554eb38c9441811f26f6d9e4", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 59845, "upload_time": "2019-04-16T10:18:13", "url": "https://files.pythonhosted.org/packages/47/88/a0078eefda77fa43b71bf5c517659c42abc7f742977905533149c1c63c26/spider_common-0.0.1-py3.6.egg" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "79aa67e1554eb38c9441811f26f6d9e4", "sha256": "5991b457b60ec399b4423001413c2975b311df46cd133f29c11c22aa1eb2c98f" }, "downloads": -1, "filename": "spider_common-0.0.1-py3.6.egg", "has_sig": false, "md5_digest": "79aa67e1554eb38c9441811f26f6d9e4", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 59845, "upload_time": "2019-04-16T10:18:13", "url": "https://files.pythonhosted.org/packages/47/88/a0078eefda77fa43b71bf5c517659c42abc7f742977905533149c1c63c26/spider_common-0.0.1-py3.6.egg" } ] }