{ "info": { "author": "Jerry_suye", "author_email": "jerry_suye@163.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3" ], "description": "# \u6296\u97f3\u722c\u866b\n\n\u6293\u53d6\u6296\u97f3App\u7684\u89c6\u9891\u722c\u866b\n\n## \u73af\u5883\n\n> Python3\n\n## \u5b89\u88c5\u914d\u7f6e\n\u9996\u5148\uff0c\u4f60\u9700\u8981\u5b89\u88c5\u5e76\u914d\u7f6e\u597d**Node.js**\u73af\u5883,\u7136\u540ebash\u8fd0\u884c\n\n```bash\n$ git clone git@github.com:ErisYoung/douyin_spider.git\n$ cd douyin_spider\n$ pip install -r requirements.txt\n```\n\n\u6216\u8005\n\n```bash\npip install douyin-spider\n```\n\n## \u4f7f\u7528\u65b9\u6cd5\n\n#### \u7b2c\u4e00\u79cd\u65b9\u5f0f:\u9009\u62e9\u4e0b\u8f7d\u5668\u548c\u5904\u7406\u5668,\u81ea\u884c\u7f16\u5199\n\n\u4f60\u53ef\u4ee5\u6309\u5982\u4e0b\u65b9\u5f0f\u4f7f\u7528:\n\n```python\nfrom douyin_spider.downloaders.video import VideoDownloader\nfrom douyin_spider.handler.video import VideoHandler\nfrom douyin_spider.handler.music import MusicHandler\nfrom douyin_spider.handler.mongodb import MongoHandler\nfrom douyin_spider.enter.hot_top import hot_top20\n\nvideo_handler = VideoHandler(folder='./videos')\nmusic_handler = MusicHandler(folder='./musics')\nmongo_handler = MongoHandler()\ndownloader = VideoDownloader([video_handler,music_handler,mongo_handler])\n\nresult = hot_top20()\n\nfor item in result.data:\n downloader.download(item)\n\nprint(\"success\")\n\n```\n\n\ud83d\udca8\u6ce8\u610f:\u5982\u679c\u8981\u4f7f\u7528mongo_handler,\u5219\u9700\u8981\u63d0\u524d\u542f\u52a8mongodb\n\n\u7ed3\u679c:\n\n![4.jpg](https://ws3.sinaimg.cn/large/005BYqpggy1g2yux5fnxzj30wp0e078x.jpg)\n![5.jpg](https://ws3.sinaimg.cn/large/005BYqpggy1g2yux5kulnj319x09uwmp.jpg)\n![6.jpg](https://ws3.sinaimg.cn/large/005BYqpggy1g2yux4gxauj319k09ldg6.jpg)\n![7.jpg](https://ws3.sinaimg.cn/large/005BYqpggy1g2yux4i58yj312b0e8ju0.jpg)\n\n\n#### \u7b2c\u4e8c\u79cd\u65b9\u5f0f:\u4f7f\u7528\u547d\u4ee4\u884c\u53c2\u6570\n\u9996\u5148\u83b7\u53d6\u4f60\u6240\u9700\u8981\u7684share-url\n\n

\n\n\n\n

\n\n\n\u7136\u540e\u628a\u5f97\u5230\u7684url,\u8f93\u5165\u547d\u4ee4\u884c\uff0c\u9ed8\u8ba4\u4e0b\u8f7d10\u4e2a\u89c6\u9891\n```bash\ncd douyin_spider/douyin_spider\npython assign_share_url.py -u \"http://v.douyin.com/6Gf7FG/\" \n\n```\n\ud83d\udca8\u6ce8\u610f:\u8fd9\u91cc\u8981\u4f7f\u7528\"\",\u5426\u5219Windows\u73af\u5883\u4e0b\u4f1a\u51fa\u73b0error\n\n\u66f4\u591a\u7684\u53c2\u6570\u4f7f\u7528\u81ea\u884chelp\u67e5\u9605:\n```bash\npython assign_share_url.py --help\n```\n\n##### \ud83d\udca8\u63d0\u793a:\u6709\u5176\u4ed6\u95ee\u9898\u53ef\u4ee5\u81ea\u884cissue\n\n## \u66f4\u591a\u7684\u4f8b\u5b50\u548c\u5165\u53e3\n\n\u8bf7\u770b [tests](tests)\n\n## \u66f4\u591a\u7684\u4e0b\u8f7d\u5668\n\n\u8bf7\u770b [downloaders](douyin_spider/downloaders)\n\n## \u66f4\u591a\u7684\u5904\u7406\u5668\n\n\u8bf7\u770b [handler](douyin_spider/handler)\n\n#### \u66f4\u65b0\u65f6\u95f4\n\n* 2019-5-13: \ud83d\udc4c\u5904\u7406_signature \u7b7e\u540d\u53c2\u6570,\u5b9e\u6d4b\u53ef\u884c\n* 2019-6-26: \ud83d\udc4c\u6253\u5305\u4e0a\u4f20\u81f3pypi\uff0c\u6296\u97f3\u52a0\u5bc6\u63a5\u53e3\u672a\u53d8\uff0c\u6d4b\u8bd5\u53ef\u884c\n\n\n\n\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/ErisYoung/douyin_spider", "keywords": "", "license": "", "maintainer": "", "maintainer_email": "", "name": "douyin-spider", "package_url": "https://pypi.org/project/douyin-spider/", "platform": "", "project_url": "https://pypi.org/project/douyin-spider/", "project_urls": { "Homepage": "https://github.com/ErisYoung/douyin_spider" }, "release_url": "https://pypi.org/project/douyin-spider/0.0.2/", "requires_dist": [ "aiohttp (>=3.4.4)", "retrying (>=1.3.3)", "motor (>=2.0.0)", "tqdm (>=4.26.0)", "requests (>=2.19.1)", "dateparser (>=0.7.1)" ], "requires_python": "", "summary": "One simple and easy to use crawler for DouYin", "version": "0.0.2" }, "last_serial": 5479518, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "bce0b126420c0d4c40b9d0cff682be6a", "sha256": "157c9e882b11c675c84b3640f66bc3af471a7f09ef83d8e0ae0d0051ad478e44" }, "downloads": -1, "filename": "douyin_spider-0.0.1-py3-none-any.whl", "has_sig": false, "md5_digest": "bce0b126420c0d4c40b9d0cff682be6a", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26066, "upload_time": "2019-06-26T07:32:20", "url": "https://files.pythonhosted.org/packages/96/94/780d5cbcda8bd586c4d22fc1a2c2d2133202f64decbb32c624504c697ce4/douyin_spider-0.0.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "fd0149221262a46d16660bc42ab4de34", "sha256": "3be7ee20eec233efdbdfe8db92e186d40bc1f9a2bb3156feb1a052bf349842f0" }, "downloads": -1, "filename": "douyin_spider-0.0.1.tar.gz", "has_sig": false, "md5_digest": "fd0149221262a46d16660bc42ab4de34", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16229, "upload_time": "2019-06-26T07:32:22", "url": "https://files.pythonhosted.org/packages/4f/47/1986a00dc248fe22e72a0cfb2cd24ebb5e501fa1e13b2737a6a422f755bb/douyin_spider-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "d075d72e0f1ef9ebddd99a9989753ad9", "sha256": "74dca37a8761b1cdf8f6ac26b3d857f713afb34f7061088a35affbba9a72f508" }, "downloads": -1, "filename": "douyin_spider-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "d075d72e0f1ef9ebddd99a9989753ad9", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26173, "upload_time": "2019-07-03T05:00:04", "url": "https://files.pythonhosted.org/packages/50/8e/69361e7c917750eeabeb5f52dc9fd32ab5f8808be0e6bc5f970eaf5e90dd/douyin_spider-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0e05d47e5e2547121d8e0aeb96ca7dc6", "sha256": "a2b885aea70c9e512c7fe32e73a294a3837b3f24a845d7f8d2cf9c1faee0e6c3" }, "downloads": -1, "filename": "douyin_spider-0.0.2.tar.gz", "has_sig": false, "md5_digest": "0e05d47e5e2547121d8e0aeb96ca7dc6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16439, "upload_time": "2019-07-03T05:00:06", "url": "https://files.pythonhosted.org/packages/0d/c6/9924bf56e6b101ad18d4caf43370fd46b287fb57ecf5ed249afd97c0a25e/douyin_spider-0.0.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "d075d72e0f1ef9ebddd99a9989753ad9", "sha256": "74dca37a8761b1cdf8f6ac26b3d857f713afb34f7061088a35affbba9a72f508" }, "downloads": -1, "filename": "douyin_spider-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "d075d72e0f1ef9ebddd99a9989753ad9", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 26173, "upload_time": "2019-07-03T05:00:04", "url": "https://files.pythonhosted.org/packages/50/8e/69361e7c917750eeabeb5f52dc9fd32ab5f8808be0e6bc5f970eaf5e90dd/douyin_spider-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0e05d47e5e2547121d8e0aeb96ca7dc6", "sha256": "a2b885aea70c9e512c7fe32e73a294a3837b3f24a845d7f8d2cf9c1faee0e6c3" }, "downloads": -1, "filename": "douyin_spider-0.0.2.tar.gz", "has_sig": false, "md5_digest": "0e05d47e5e2547121d8e0aeb96ca7dc6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16439, "upload_time": "2019-07-03T05:00:06", "url": "https://files.pythonhosted.org/packages/0d/c6/9924bf56e6b101ad18d4caf43370fd46b287fb57ecf5ed249afd97c0a25e/douyin_spider-0.0.2.tar.gz" } ] }