{ "info": { "author": "Scrapy developers", "author_email": "zhling2012@live.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "Environment :: No Input/Output (Daemon)", "License :: OSI Approved :: BSD License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Topic :: Internet :: WWW/HTTP" ], "description": "\u672c\u9879\u76eefork\u81eaScrapydArt: https://github.com/dequinns/ScrapydArt\n=====================================================================================================\n\n\u5efa\u8bae\u4f7f\u7528anaconda\u73af\u5883\uff0c\u8bf7\u524d\u5f80[\u4e3b\u7ad9](https://www.anaconda.com/distribution/#download-section)\u6216\u8005[\u6e05\u534e\u7ad9\u70b9]\n(https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/?C=M&O=D)\u4e0b\u8f7d\u5e76\u5b89\u88c5\n\n$ bash Anaconda3-2019.03-Linux-x86_64.sh\n\n\u5728ScrapydArtEnv\u6587\u4ef6\u5939\u5185\u6709 ScrapydArt.txt \u4e0e ScrapydArt.yaml \u6587\u4ef6\uff0c\u5728\u7ec8\u7aef\u5185\u8f93\u5165:\n\n$ conda env create -f ScrapydArt.yaml\n\n$ conda activate ScrapydArt\n\n$ pip install -r ScrapydArt.txt\n\n\u5373\u53ef\u89e3\u51b3\u73af\u5883\u95ee\u9898\n\n++++++++++++++++++++++++++++++++++++\n\npip \u5b89\u88c5\uff1a pip install scrapydartx\n\n++++++++++++++++++++++++++++++++++++\n\n\u529f\u80fd\u6269\u5c55\u8bf4\u660e\uff1a\n\n1. \u96c6\u6210\u4e86\u52a8\u6001\u8c03\u5ea6\u529f\u80fd\nscrapydartx \u73b0\u5728\u53ef\u4ee5\u5728\u8bbe\u7f6e\u6587\u4ef6\u91cc(default_scrapyd.conf)\u8bbe\u7f6e\u8c03\u5ea6\u6570\u636e\u5e93\u4e3amysql \u6216\u8005\u662fsqlite:\n```\n...\ndatabase_type = sqlite\n...\n```\n\u82e5\u8bbe\u7f6e\u4e3amysql \u5219\u9700\u8981\u586b\u5199mysql \u7684\u914d\u7f6e\u4fe1\u606f, \u53ef\u4ee5\u662f\u8fd0\u884c\u73af\u5883\u4e2d\u7684\u6570\u636e\u5e93\u6216\u8005\u5728\u7ebf\u6570\u636e\u5e93:\n```\n...\nmysql_host = 127.0.0.1\nmysql_port = 3306\nmysql_user = root\nmysql_password = mysql\nmysql_db = scrapydartTest\n...\n```\n\u5176\u4e2dmysql_db\u662f\u6307\u4f7f\u7528 mysql \u7684\u54ea\u4e00\u4e2a\u6570\u636e\u5e93\n\u82e5database_type\u8bbe\u7f6e\u4e3a sqlite \u5219\u4e0d\u9700\u8981\u8bbe\u7f6e\u8fd9\u4e9b\n\n\u914d\u7f6e\u6587\u4ef6\u7684\u5176\u5b83\u8bbe\u7f6e\uff1a\n```\n...\nclear_up_database_when_start = yes // yes/no, \u6bcf\u6b21\u8fd0\u884c\u524d\u6e05\u7406\u89c2\u5bdf\u6570\u636e\nobservation_times = 20 // >0\u7684\u6574\u6570\uff0c\u8bbe\u7f6e\u5f02\u5e38\u76d1\u63a7\u7684\u89c2\u5bdf\u6b21\u6570\nstrict_mode = no // yes/no\uff0c\u8bbe\u7f6e\u662f\u5426\u4e25\u683c\u6a21\u5f0f\nstrict_degree = 4 // >0\u7684\u4efb\u610f\u6570\uff0c\u8bbe\u7f6e\u4e25\u683c\u6a21\u5f0f\u7684\u4e25\u683c\u7a0b\u5ea6\uff0c\u8d8a\u4f4e\u8d8a\u4e25\u683c\n...\n```\n\u5728\u7a0b\u5e8f\u6b63\u786e\u5b89\u88c5\u540e\uff0c\u6bcf\u6b21\u8fd0\u884c\u65f6\u90fd\u4f1a\u6709\u914d\u7f6e\u6587\u4ef6\u4fee\u6539\u63d0\u793a\uff08\u5305\u542b\u4ee5\u4e0a\u90e8\u5206\u914d\u7f6e\u9009\u9879\uff09\uff0c\u60a8\u53ef\u4ee5\u624b\u52a8\u4fee\u6539\u8fd9\u4e9b\u914d\u7f6e\uff0c\u6240\u4ee5\u4e0d\u7528\u62c5\u5fc3\u914d\u7f6e\u6587\u4ef6\u7684\u4f4d\u7f6e\u95ee\u9898\uff0c\u4e5f\u4e0d\u7528\u62c5\u5fc3\u7a0b\u5e8f\u914d\u7f6e\u9519\u8bef\u4e86\uff0c\u76f4\u63a5\u91cd\u542f\u7a0b\u5e8f\u518d\u914d\u7f6e\u5c31\u884c\u4e86\uff0c\u7a0b\u5e8f\u4f1a\u4fdd\u7559\u60a8\u6700\u540e\u4e00\u6b21\u4fee\u6539\u7684\u4fe1\u606f\u3002\n\n\u5e73\u53f0\u88ab\u5b89\u88c5\u5e76\u4e14\u542f\u52a8\u540e\uff0c\u4f1a\u81ea\u52a8\u5728\u8c03\u5ea6\u6570\u636e\u5e93\u67e5\u627e\u9700\u8981\u8c03\u5ea6\u7684\u722c\u866b\uff0c\u5e76\u4e14\u6839\u636e\u8c03\u5ea6\u5b57\u5178\u8ba1\u7b97\u4e0b\u6b21\u8fd0\u884c\u65f6\u95f4\u3002\n\u9700\u8981\u6ce8\u610f\u7684\u662f\uff0c\u52a0\u5165\u5230\u8c03\u5ea6\u6570\u636e\u5e93\u91cc\u7684\u722c\u866b\u7684\u9879\u76ee\u540d\u79f0\uff08project\uff09\u662f\u5fc5\u987b\u7684\uff0c\u5e76\u4e14\u4e0d\u540c\u7684\u9879\u76ee\u5efa\u8bae\u4f7f\u7528\u4e0d\u540c\u7684\u9879\u76ee\u540d\u79f0\n\n\u4e0b\u9762\u4ecb\u7ecd\u5c06\u722c\u866b\u52a0\u5165\u5230\u8c03\u5ea6\u6570\u636e\u5e93\u7684\u65b9\u6cd5\n\u6269\u5c55\u5e73\u53f0\u52a0\u5165\u4e86\u6570\u4e2aapi\u4ee5\u65b9\u4fbf\u64cd\u63a7\uff0c\u5305\u62ec\u8c03\u5ea6\u6570\u636e\u5e93\u7684\u589e\u5220\u6539\u67e5\u90fd\u53ef\u4ee5\u901a\u8fc7\u5411\u7aef\u53e3\u53d1\u9001\u8bf7\u6c42\u5b8c\u6210\n\u589e\u52a0\u8c03\u5ea6\u722c\u866b\uff1a\n```\n$ curl http://localhost:6800/scheduletodb.json -d project=MyProject -d spider=my_spider -d schedule='{\"year\":\"2019\", \"month\": \"08\", \"day\": \"28\", \"hour\": \"09\", \"minute\": \"19\", \"second\": \"00\"}' -d spider_args='{}' -d status='1'\n```\n\n\u8fd9\u6837\u663e\u5f97\u592a\u957f\u800c\u4e14\u590d\u7528\u6027\u592a\u5dee\uff0c\u4e0d\u5efa\u8bae\u8fd9\u6837\uff0c\u5efa\u8bae\u76f4\u63a5\u4f7f\u7528 python \u7684 requests \u65b9\u6cd5\u53d1\u9001\u8bf7\u6c42\uff0c\u6548\u679c\u662f\u4e00\u6837\u7684\uff0c\u5982\u4e0b\u9762\u7684\u7b80\u5355\u4f8b\u5b50\uff1a\n```\nimport requests\n\npost_data = {\n 'project': project_name, # str\n 'spider': spider_name, # str\n 'schedule': spider_schedule_dict, # dict\n 'args': spider_args_dict, # dict\n 'status': spider_status, # int\n }\nresult = requests.post(url='http://localhost:6800/scheduletodb.json', data=post_data)\n```\n\u4e0a\u9762post_data\u53d8\u91cf\u4e2d\u7684 \u201cargs\u201d \u5982\u6709\u9700\u8981\u8bf7\u4f20\u5165\u4e00\u4e2a\u5b57\u5178\uff0c\u91cc\u9762\u7684\u952e\u548c\u503c\u5c06\u81ea\u52a8\u4f20\u9012\u7ed9\u76f8\u5e94\u7684\u722c\u866b\uff08\u9700\u8981\u63d0\u524d\u5728\u722c\u866b\u5185\u63a5\u6536\uff09\uff0c\u6b64\u9879\u4e3a\u53ef\u9009\u9879\uff0c\u53ef\u4e0d\u4f20\u3002\n\n\u201cstatus\u201d \u53c2\u6570\uff0c\u6570\u636e\u7c7b\u578b\u4e3a int \uff0c\u503c\u4e3a 0 \u6216\u80051 \u6216\u80052 \u6216\u80053\n0 \uff1a \u4e0d\u542f\u7528\u6b64\u6761\u8c03\u5ea6\n1 \uff1a \u6b63\u5e38\u542f\u7528\n2 \uff1a \u9ad8\u7ea7\u6a21\u5f0f\n3 \uff1a \u6700\u9ad8\u7ea7\u6a21\u5f0f\n\u8bbe\u5b9a\u4e3a1\u7684\u65f6\u5019\uff0c\u722c\u866b\u4f1a\u88ab\u7cfb\u7edf\u8d44\u6e90\u9650\u5236\u8fd0\u884c\uff0c\u5373\u5f53\u5e73\u53f0\u68c0\u6d4b\u5230\u7cfb\u7edfcpu\u6216\u8005\u5185\u5b58\u4e25\u91cd\u4e0d\u8db3\u65f6\uff0c\u5ef6\u7f13\u6570\u79d2\u5230\u4e00\u4e2a\u5468\u671f\u6267\u884c\uff0c\u666e\u901a\u60c5\u51b5\u4e0b\u8bf7\u8bbe\u7f6e\u4e3a1\uff0c\u540c\u65f6\u5982\u679c\u8fd0\u884c\u65f6\u95f4\u5f02\u5e38\uff0c\u5c06\u4f1a\u88ab\u5e73\u53f0\u5f02\u5e38\u7ba1\u7406\u673a\u5236\u81ea\u52a8\u7ec8\u7ed3\n\u8bbe\u5b9a\u4e3a2\u7684\u65f6\u5019\uff0c\u722c\u866b\u5c06\u5ffd\u7565\u7cfb\u7edf\u8d44\u6e90\u60c5\u51b5\uff0c\u4e0d\u7ba1\u7cfb\u7edf\u8d44\u6e90\u5360\u7528\u591a\u5c11\u90fd\u4f1a\u6309\u65f6\u6267\u884c\uff0c\u4f46\u5982\u679c\u8fd0\u884c\u65f6\u95f4\u5f02\u5e38\uff0c\u4e5f\u5c06\u4f1a\u88ab\u5e73\u53f0\u5f02\u5e38\u7ba1\u7406\u673a\u5236\u81ea\u52a8\u7ec8\u7ed3\n\u8bbe\u5b9a\u4e3a3\u7684\u65f6\u5019\uff0c\u722c\u866b\u4e3a\u8d85\u7ea7\u6743\u9650\u6a21\u5f0f\uff0c\u4e0d\u4f1a\u88ab\u5f02\u5e38\u7ba1\u7406\u673a\u5236\u7ec8\u6b62\uff0c\u540c\u65f6\u5ffd\u7565\u7cfb\u7edf\u8d44\u6e90\u72b6\u51b5\n\n\u201cschedule\u201d \u7684\u503c\u9700\u8981\u4e00\u4e2a\u5b57\u5178\uff0c\u6216\u8005\u9017\u53f7\u5206\u5272\u7684\u65e5\u671f\u5b57\u7b26\u4e32\uff0c\u5b57\u5178\u7684\u503c\u7c7b\u4f3c: \n```\n{\"second\": \"*/30\"}\n```\n\u610f\u601d\u662f\u6bcf30\u79d2\u8fd0\u884c\u4e00\u6b21\uff0c\u4e5f\u53ef\u4ee5\u8bbe\u7f6e\u4e3a\u5177\u4f53\u7684\u67d0\u4e2a\u65f6\u95f4\u70b9\uff0c\u4f8b\u5982\uff1a\n\n```\n...\n'schedule': {\n 'year': 2019,\n 'month': 6,\n 'day': 4,\n 'hour': 10,\n 'minute': 50,\n 'second': 50\n }\n```\n\n \u8fd9\u6837\u7684\u8bbe\u7f6e\u662f\u5355\u6b21\u4efb\u52a1\u6a21\u5f0f\uff0c\u722c\u866b\u53ea\u5728\u8bbe\u5b9a\u7684\u65f6\u95f4\u70b9\n ```\n \uff082019-06-04 10:50:50\uff09\n ```\n \u8fd0\u884c\u4e00\u6b21\n \u4e5f\u53ef\u4ee5\u662f\u53ea\u6709\u5206\u949f\uff0c\u6216\u8005\u53ea\u6709\u79d2\uff0c\u6216\u8005\u53ea\u6709\u5c0f\u65f6\u3001\u5929\u3001\u6708\u3001\u5e74\uff0c\u5e73\u53f0\u5c06\u81ea\u52a8\u8ba1\u7b97\u4e0b\u6b21\u5230\u8fbe\u8bbe\u5b9a\u7684\u65f6\u95f4\u7684\u65f6\u95f4\u95f4\u9694\uff0c\n\u4f8b\u5982\u53ea\u7ed9\u5b9a {'hour': 10}\uff0c\u5219\u722c\u866b\u4f1a\u5728\u4ece\u660e\u5929\u5f00\u59cb\u7684\u6bcf\u4e00\u5929\u768410\u70b9\u7684\u5f53\u524d\u5206\u79d2\u6570\u542f\u52a8\uff0c\u4f8b\u5982\u5f53\u53d1\u9001\u4e86 \"schedule\" \u53c2\u6570\u4e3a\uff1a \n```\n\"schedule\": {\"hour\": 10}\n```\n \u800c\u6b64\u65f6\u7cfb\u7edf\u65f6\u95f4\u4e3a 16:37:12\uff0c\u5219\u722c\u866b\u5c06\u5728\u660e\u5929\uff0c\u4ee5\u53ca\u63a5\u4e0b\u6765\u7684\u6bcf\u4e00\u5929\u7684\u4e0a\u5348\u7684 10:37:12 \u81ea\u52a8\u53d1\u9001\u4efb\u52a1\u5230\u8fd0\u884c\u5e73\u53f0\u5e76\u542f\u52a8\u3002 \n\u82e5\u53ea\u8bbe\u7f6e\u4e3a {'day': 4}\uff0c\u5219\u610f\u601d\u662f\u4ece\u4e0b\u4e2a\u6708\u5f00\u59cb\u7684\u6bcf\u4e2a\u6708\u76844\u53f7\u7684\u5f53\u524d\u65f6\u5206\u79d2\u542f\u52a8\uff0c\u4ee5\u6b64\u7c7b\u63a8\n \u9700\u8981\u6ce8\u610f\u7684\u662f\uff0c\u8bbe\u5b9a\u7684\u6708\u4e3a1-12\uff0c \u65e5\u5c0f\u4e8e\u7b49\u4e8e\u6708\u6700\u5927\u5929\u6570\uff0c\u5c0f\u65f6\u4e3a0-23\uff0c \u5206\u949f\u65700-59\uff0c\u79d2\u65700-59\n\u6b64\u5916\uff0c\u6211\u60f3\u4f60\u5e94\u8be5\u5df2\u7ecf\u5b8c\u5168\u4e86\u89e3\u5728\u53c2\u6570\u4e2d\u52a0 \u201c*/\u201d \u6216 \u4e0d\u52a0 \u201c*/\u201d \u7684\u4f5c\u7528\u4e86\uff0c\u82e5\u4ecd\u89c9\u5f97\u4e0d\u6e05\u695a\uff0c\u76f4\u63a5\u4f7f\u7528\u5b83\u4f60\u4f1a\u53d1\u73b0\u5176\u4e2d\u7684\u542b\u4e49\u3002\n \u6b64\u5916\u8fd8\u53ef\u4ee5\u8bbe\u5b9a\u661f\u671f\u6570\uff0c\u4f8b\u5982\uff1a\n ```\n {'week': '*/2'}\n ```\n \u610f\u601d\u662f\u6bcf\u5468\u7684\u5468\u4e09\u6267\u884c\uff0c\u5bf9\u7684\uff0c\u661f\u671f\u7684\u8303\u56f4\u4e3a0~6\n \u661f\u671f\u53ef\u4ee5\u914d\u5408\u5e74\u3001\u6708\u3001\u65f6\u3001\u5206\u3001\u79d2\u540c\u65f6\u8bbe\u5b9a\uff0c\u4f46\u662f\u4e0d\u53ef\u540c\u65f6\u8bbe\u5b9a\u661f\u671f\u6570\u548c\u5929\uff0c\u5426\u5219\u5c06\u53ea\u6309\u7167\u5929\u6765\u8ba1\u7b97\uff0c\u5e76\u5ffd\u7565\u661f\u671f\u7684\u8bbe\u5b9a\u3002\n\n\u82e5 schedule \u7684\u503c\u4e3a\u5b57\u7b26\u4e32\uff0c\u5219\u9700\u8981\u8fd9\u6837\u7684\u683c\u5f0f\uff1a\n```\n'2019,9,13,16,30,0' # 2019\u5e749\u670813\u65e516\u70b930\u520600\u79d2\n```\n\u6ce8\u610f\u5168\u65e5\u671f\u662f\u5fc5\u987b\u7684\uff0c\u82e5\u4e2d\u95f4\u7f3a\u5931\u67d0\u4e2a\u503c\u5c06\u65e0\u6cd5\u6b63\u5e38\u90e8\u7f72\u3002\n\u8fd9\u6837\u8bbe\u7f6e\uff0c\u65b9\u6cd5\u4e5f\u662f\u53ea\u4f1a\u88ab\u6267\u884c\u4e00\u6b21\n\n \u82e5\u5165\u5e93\u6210\u529f\uff0c\u5219\u8fd4\u56de\u7684result\u5982\u4e0b\uff1a\n```\n\u00a0{\"node_name\": \"name of node\", \"status\": \"ok\"}\n```\n \u5165\u5e93\u6210\u529f\u540e\uff0c\u7b49\u5f85\u51e0\u79d2\u949f\u5e73\u53f0\u4f1a\u53d1\u73b0\u5b83\u5e76\u4e14\u81ea\u52a8\u8ba1\u7b97\u4e0b\u6b21\u8fd0\u884c\u65f6\u95f4\uff0c\u540e\u53f0\u5c06\u663e\u793a\u7c7b\u4f3c\u5982\u4e0b\u8bed\u53e5\u7684\u65e5\u5fd7\uff1a\n```\n [- Scheduler -#info] job default-xinhua is waiting, countdown 540s\n \u2191 \u2191 \u2191\n \u9879\u76ee\u540d \u722c\u866b\u540d \u8ddd\u4e0b\u6b21\u8fd0\u884c\u79d2\u6570\n```\n \u67e5\u770b\u8c03\u5ea6\u722c\u866b\uff1a\n```\n $ curl http://localhost:6800/listdbschedule.json -d projects=\"['project_name1', 'project_name2']\" -d spiders=\"['spider1', 'spider2']\"\n```\n\n \u6ce8\u610f\uff0c\u53c2\u6570projects\u4e0espiders\u9700\u8981\u4f20\u5165\u5b57\u7b26\u4e32\u7c7b\u578b\u7684\u5217\u8868\uff0c\u4e5f\u53ef\u4ee5\u4ec0\u4e48\u90fd\u4e0d\u4f20\uff0c\u5c06\u8fd4\u56de\u6240\u6709\u5728\u6570\u636e\u5e93\u4e2d\u7684\u5f85\u8c03\u5ea6\u722c\u866b\u548c\u8c03\u5ea6\u53c2\u6570\n\n requests \u65b9\u6cd5\uff1a\n```\nimport requests\nurl = 'http://127.0.0.1:6800/listdbschedule.json?un=&pwd='\ndata = {\n 'projects': str(['project1', 'project2']),\n 'spiders': str(['spider1', 'spider2']),\n }\nres = json.loads(requests.post(url=url, data=data).content)\nprint(res)\n```\n\n \u6b63\u786e\u8fd4\u56de\uff1a\n```\n{\"node_name\": \"name of node\", \"status\": \"ok\", \"database_schedules\": \n [{'id': schedule_id,\n 'project': project_name,\n 'spider': spider_name,\n 'schedule': spider_schedule,\n 'args': spider_args,\n 'status': spider_status\n },\n {... ...},\n ...\n ] }\n```\n\n \u66f4\u6539\u8c03\u5ea6\u722c\u866b\uff1a\n```\n $ curl http://localhost:6800/updatedbschedule.json -d id=update_id -d schedule=new_schedule -d args=new_args -d status=new_status\n```\n\n \u53c2\u6570 id \u662f\u9700\u8981\u4fee\u6539\u7684\u90a3\u4e00\u6761\u6570\u636e\u7684id\u503c\uff0c\u6839\u636e\u67e5\u770b\u8c03\u5ea6\u722c\u866b listdbschedule.json \u5f97\u77e5\n requests \u65b9\u6cd5\uff1a\n```\nimport requests\npost_data = {\n 'id': update_id,\n 'schedule': new_schedule,\n 'args': new_args,\n 'status': new_status,\n }\nresult = requests.post(url='http://localhost:6800/updatedbschedule.json', data=post_data)\n```\n\n \u64cd\u4f5c\u6210\u529f\u5219\u8fd4\u56de\uff1a\n```\n {\"node_name\": \"name of node\", 'update': \"ok\"}\n```\n\n \u5220\u9664\u8c03\u5ea6\u722c\u866b\uff1a\n```\n $ curl http://localhost:6800/rmschedulefromdb.json -d id=delete_id\n```\n delete_id \u6839\u636e\u67e5\u8be2\u8c03\u5ea6\u722c\u866b\u5f97\u77e5\n requests \u65b9\u6cd5\uff1a\n```\nimport requests\n\npost_data = {\n 'id': delete_id,\n }\nresult = requests.post(url='http://localhost:6800/rmschedulefromdb.json', data=post_data)\n```\n\n \u6b63\u786e\u8fd4\u56de:\n```\n\u00a0 {\"node_name\": \"name of node\", 'delete': \"ok\"}\n```\n\n \u82e5\u5728\u914d\u7f6e\u4e2d\u8bbe\u7f6e\u4e86auth_username \u548c auth_password\uff0c\u5219\u9700\u8981\u5728\u6bcf\u6b21post\u8bf7\u6c42\u7684data\u4e2d\u52a0\u5165 {'un': user_name, 'pwd': password}\uff0c get \u8bf7\u6c42\u4e2d\u52a0\u5165 ?un=user_name&pwd=password\n\n2. \u5f02\u5e38\u722c\u866b\u7ba1\u7406\u529f\u80fd\n\n \u6b64\u9879\u529f\u80fd\u9ed8\u8ba4\u5728\u5e73\u53f0\u542f\u52a8\u7684\u65f6\u5019\u81ea\u52a8\u542f\u52a8\uff0c\u4e5f\u53ef\u4ee5\u5728\u914d\u7f6e\u6587\u4ef6\u5185\u8bbe\u7f6e\u4e3a\u4e0d\u542f\u7528 (\u9ed8\u8ba4 activate)\n```\n...\nTerminator = deactivate\n...\n```\n \u6b64\u529f\u80fd\u4f1a\u6bcf\u9694\u6570\u79d2\u5de1\u89c6\u4e00\u904d\u6240\u6709\u6b63\u5728\u8fd0\u884c\u7684\u722c\u866b\uff0c\u5e76\u6839\u636e\u4e4b\u524d\u7684\u8fd0\u884c\u65f6\u95f4\u8ba1\u7b97\u65b9\u5dee\u6570\u4e0e\u5747\u503c\uff0c\u63a8\u7b97\u5224\u65ad\u672c\u6b21\u8fd0\u884c\u7684\u65f6\u95f4\u662f\u5426\u5408\u7406\uff0c\u82e5\u4e0d\u5408\u7406\uff0c\u5219\u4f1a\u5728\u51e0\u79d2\u949f\u5185\u7ec8\u7ed3\u6b64\u4efb\u52a1, \u4e0d\u9700\u8981\u62c5\u5fc3\u722c\u866b\u4efb\u52a1\u6c38\u8fdc\u88ab\u6740\u6b7b\u4e86\uff0c\u9664\u975e\u4f60\u8bbe\u7f6e\u7684\u662f\u5355\u6b21\u5b9a\u65f6\u4efb\u52a1\uff0c\u5426\u5219\u722c\u866b\u5c06\u5728\u4e0b\u4e00\u4e2a\u5468\u671f\u7ee7\u7eed\u6b63\u5e38\u542f\u52a8, \u82e5\u8bbe\u7f6e\u4e3a Terminator \u8bbe\u7f6e\u4e3a \"activate\"\uff0c\u5c06\u4f1a\u5728\u5e73\u53f0\u542f\u52a8\u65f6\u5728\u540e\u53f0\u663e\u793a\u65e5\u5fd7\uff1a\n```\n[- TERMINATOR -#info] Terminator Started\n```\n Terminator \u5728\u6bcf\u6b21\u5de1\u89c6\u540e\u5728\u540e\u53f0\u6253\u5370\u65e5\u5fd7\uff1a\n```\n[- TERMINATOR -#warn] Scan completed\n```\n \u82e5\u672c\u6b21\u5de1\u89c6\u53d1\u73b0\u5f02\u5e38\u722c\u866b\uff0c\u4e14\u88ab\u7ec8\u7ed3\uff0c\u5219\u5de1\u89c6\u65e5\u5fd7\u4e3a\uff1a\n```\n[- TERMINATOR -#warn] Scan completed, Terminated target: '[default-xinhua-6796090a940b11e98d6854e1adc0a997, default-fifa-6796090a940b11e98d6854e1adc0a997]'\n```\n \u65e5\u5fd7\u4e2d \u201cTerminated target\u201d \u4e3a\u88ab\u7ec8\u7ed3\u7684\u722c\u866b\u7684\u5217\u8868\u5b57\u7b26\u4e32\uff0c\u683c\u5f0f\u4e3a:\n```\n [project-spider-jobid, ...]\n```\n\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/GuardianGH/scrapydartx", "keywords": "", "license": "", "maintainer": "Scrapy developers", "maintainer_email": "info@scrapy.org", "name": "scrapydartx", "package_url": "https://pypi.org/project/scrapydartx/", "platform": "", "project_url": "https://pypi.org/project/scrapydartx/", "project_urls": { "Homepage": "https://github.com/GuardianGH/scrapydartx" }, "release_url": "https://pypi.org/project/scrapydartx/1.2.1.0/", "requires_dist": [ "Twisted (==18.9)", "Scrapy (>=1.0)", "six", "enum-compat", "pymysql", "numpy" ], "requires_python": "", "summary": "a extension from ScrapydArt", "version": "1.2.1.0" }, "last_serial": 5780192, "releases": { "1.2.0.5": [ { "comment_text": "", "digests": { "md5": "995d87c05a5abadca97b82acd3c0b7e1", "sha256": "8613996abf12174d8884be928c178269fecb4b2c55e7f2338c4cfad1ded5a657" }, "downloads": -1, "filename": "scrapydartx-1.2.0.5.tar.gz", "has_sig": false, "md5_digest": "995d87c05a5abadca97b82acd3c0b7e1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 105617, "upload_time": "2019-08-12T10:14:39", "url": "https://files.pythonhosted.org/packages/4a/d1/8951beae966d09d156132be24853568a43108c16bbd0518685c58961af81/scrapydartx-1.2.0.5.tar.gz" } ], "1.2.1.0": [ { "comment_text": "", "digests": { "md5": "7b070d9bd5ea6e7c025a8f8a8216de58", "sha256": "659894e89c3cecfde71be36641797ef097bdf2f6c6b1a3c463e5bfbb5ee2976c" }, "downloads": -1, "filename": "scrapydartx-1.2.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "7b070d9bd5ea6e7c025a8f8a8216de58", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 216368, "upload_time": "2019-09-04T09:17:52", "url": "https://files.pythonhosted.org/packages/12/f5/87d093976076c0c46971d9353e7347839c223bc146e926586167c7fe5006/scrapydartx-1.2.1.0-py3-none-any.whl" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "7b070d9bd5ea6e7c025a8f8a8216de58", "sha256": "659894e89c3cecfde71be36641797ef097bdf2f6c6b1a3c463e5bfbb5ee2976c" }, "downloads": -1, "filename": "scrapydartx-1.2.1.0-py3-none-any.whl", "has_sig": false, "md5_digest": "7b070d9bd5ea6e7c025a8f8a8216de58", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 216368, "upload_time": "2019-09-04T09:17:52", "url": "https://files.pythonhosted.org/packages/12/f5/87d093976076c0c46971d9353e7347839c223bc146e926586167c7fe5006/scrapydartx-1.2.1.0-py3-none-any.whl" } ] }