{ "info": { "author": "Akaisorani", "author_email": "cavsolar@gmail.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3" ], "description": "# pixiv-crawler\npixiv image crawler\n\nGithub [https://github.com/Akaisorani/pixiv-crawler](https://github.com/Akaisorani/pixiv-crawler)\n## How to install\n\n```\npip install pixiv_crawler\n```\n\nTo pass the captcha in login, we use selenium+phantomjs. So you need to install selenium and phantomjs (or chrome/firefox with headless model).\n\n## Functions\n\nDownload image by\n* ranklist such as dailyrank\n* tags\n* illustrator's illustration list\n* your bookmark list\n* DIY urls\n\nor random a image by\n* ranklist\n* tags\n\n## How to use\n\n### Example\n\n```\nimport pixiv_crawler as pc\n\npc.set_value('username','your account name')\npc.set_value('password','your account password')\n# pc.set_value('socks','127.0.0.1:8388')\n# pc.set_value(\"local_save_root\",\"./%y.%m.%d\")\n# pc.set_value(\"cookies_file\",\"./cookies.txt\")\n# pc.set_value(\"garage_file\",\"./garage.txt\")\npc.set_value(\"phantomjs\",\"/usr/local/bin/phantomjs\")\npc.login()\n\npc.dl_rank_daily(20)\npc.dl_bookmark(20)\npc.dl_artist(4187518,pic_num=-1,deep_into_manga=False)\npc.dl_tag('azur lane',20)\npc.dl_diy_urls(['https://www.pixiv.net/ranking.php?mode=weekly'],20)\n```\n\n## ~~Features~~\n\n* it can download images by **_8 threads_**(the maxnumber of threads can be adjusted) to accelerate the progress\n* in most case it download the first picture of a **_manga_** type illustration, but in the illustrator's illustration list it will download the **_full manga_**(of course you can adjust the condition to decide when to download full)\n* it can **_login_** with your account automatically with your account name and password\n* after once login it will save **_cookies_** to local to avoid login each time\n* it can save a **_garage file_** as a list of the image id you have downloaded to avoid download images repeatedly(because some ranklist doesn't change a lot next day)\n* it can also **_synchronize_** your garage file with your remote server(if you have) to make sure not download repeatedly on your different computers\n* for illustrator's illustration list, **_artist id_** must be provided, if set artist name as \"?\" then it will be found on the website, if set download page number as -1, then it will download all pages from this artist.\n* for some reasons, you know, it need **_proxies_** to visit pixiv.net in some area, so you can set proxies in the config.properties.\n* **_config.properties_** contains most configs so you needn't to edit the code source file.\n\n## Function List\n```\nlogin (save_cookies=True)\nset_value (value_name,value)\nget_value (value_name,value)\nsave_garage (garage_file = None)\ndl_tag (tag,pic_num,deep_into_manga=False,add_classname_in_path=True)\ndl_artist (artist_id,pic_num,deep_into_manga=True,add_classname_in_path=True)\ndl_bookmark (pic_num,deep_into_manga=True,add_classname_in_path=True)\ndl_rank_global (pic_num,deep_into_manga=False,add_classname_in_path=True)\ndl_rank_daily (pic_num,deep_into_manga=False,add_classname_in_path=True)\ndl_rank_weekly (pic_num,deep_into_manga=False,add_classname_in_path=True)\ndl_rank_original (pic_num,deep_into_manga=False,add_classname_in_path=True)\n...\ndl_diy_urls (urls,pic_num,deep_into_manga=False,add_classname_in_path=True)\nrandom_one_by_classfi (classi,label=\"\")\n```\n\n## Attribute List\n```\nusername\npassword\nlocal_save_root\ngarage_file\ncookies_file\nmax_thread_num\nsocks: set None if not use\nphantomjs\nfirefox\nchrome\n```\n\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/Akaisorani/pixiv-crawler", "keywords": "", "license": "", "maintainer": "", "maintainer_email": "", "name": "pixiv-crawler", "package_url": "https://pypi.org/project/pixiv-crawler/", "platform": "", "project_url": "https://pypi.org/project/pixiv-crawler/", "project_urls": { "Homepage": "https://github.com/Akaisorani/pixiv-crawler" }, "release_url": "https://pypi.org/project/pixiv-crawler/0.0.7/", "requires_dist": [ "requests (>=2.18.4)", "selenium" ], "requires_python": "", "summary": "A tool to download pixiv pictures", "version": "0.0.7" }, "last_serial": 5832255, "releases": { "0.0.3": [ { "comment_text": "", "digests": { "md5": "b5ec16a55d064ab95f0e3a7b957f8947", "sha256": "bea4d1b109fa3ba8db371d0b903d7a6fb867070c63fd55877aff7456ee87c01c" }, "downloads": -1, "filename": "pixiv_crawler-0.0.3-py3-none-any.whl", "has_sig": false, "md5_digest": "b5ec16a55d064ab95f0e3a7b957f8947", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9039, "upload_time": "2018-07-17T12:44:27", "url": "https://files.pythonhosted.org/packages/fe/2c/5255e82cc25c0cd6089c331f5f86afb904817a0d521b420f732a2ab3f455/pixiv_crawler-0.0.3-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "9a40bc773d9ec74dbe6e094526c1de22", "sha256": "a4f2542494c4147bb088b6f5abf24b5f94074aa4f845902a217708eae1afaff1" }, "downloads": -1, "filename": "pixiv_crawler-0.0.3.tar.gz", "has_sig": false, "md5_digest": "9a40bc773d9ec74dbe6e094526c1de22", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8220, "upload_time": "2018-07-17T12:44:28", "url": "https://files.pythonhosted.org/packages/8d/40/8085caa3b5d068e4109de762829bf10fed5b6fd088b7b03ef134468f3670/pixiv_crawler-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "caca7631e4cb5766536e41219d8714f7", "sha256": "92c525ccb95f9a86ea0903e099860a9f24c5510bcb2148b8184713050ddcf864" }, "downloads": -1, "filename": "pixiv_crawler-0.0.4-py3-none-any.whl", "has_sig": false, "md5_digest": "caca7631e4cb5766536e41219d8714f7", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9059, "upload_time": "2018-08-22T04:55:26", "url": "https://files.pythonhosted.org/packages/f1/d9/912beb0a03ffe5c158cd3f5f9f6224dee279bfe1c86bfe6615f80f9eb684/pixiv_crawler-0.0.4-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "a17111221e52ad2528f7f5a5638790bf", "sha256": "039f1ec8bdfa736923bdbcb07edbc43e0eacbcac6b8b27e8b65cec8d437ff0d9" }, "downloads": -1, "filename": "pixiv_crawler-0.0.4.tar.gz", "has_sig": false, "md5_digest": "a17111221e52ad2528f7f5a5638790bf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8244, "upload_time": "2018-08-22T04:55:28", "url": "https://files.pythonhosted.org/packages/03/18/d843e168f3080f1aa66123d76ec4c4c8d8e36c7646401174c51129190e9d/pixiv_crawler-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "180ebcb81200909ac9c7e3872bddbdf6", "sha256": "8bf4f3e09e19a524b3993a52d800dd41c285f58482f25dff6f42b1895db388b8" }, "downloads": -1, "filename": "pixiv_crawler-0.0.5-py3-none-any.whl", "has_sig": false, "md5_digest": "180ebcb81200909ac9c7e3872bddbdf6", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9198, "upload_time": "2018-11-20T21:39:53", "url": "https://files.pythonhosted.org/packages/4b/32/35d09603016149f1dffe9143dfbd7edc94632bcd627c3bf6ea65e734e877/pixiv_crawler-0.0.5-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "776166b96212655be3de640e84d2ecab", "sha256": "4eeef8143fd17bf7e58cffb8e16c5d12d8790496a7bc96ed6157d46af273069c" }, "downloads": -1, "filename": "pixiv_crawler-0.0.5.tar.gz", "has_sig": false, "md5_digest": "776166b96212655be3de640e84d2ecab", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8398, "upload_time": "2018-11-20T21:39:56", "url": "https://files.pythonhosted.org/packages/22/86/f3dcc5625a4de0425a9c3eecb3d0701b7535144077fd7ac093c0ffdb6a39/pixiv_crawler-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "d572da71cf9c4035e54771d98f10eead", "sha256": "7b1372fc3dc62f7629cf6e476bf5b29ac1e15abab8e259381ae9cd040e527023" }, "downloads": -1, "filename": "pixiv_crawler-0.0.6-py3.6.egg", "has_sig": false, "md5_digest": "d572da71cf9c4035e54771d98f10eead", "packagetype": "bdist_egg", "python_version": "3.6", "requires_python": null, "size": 18234, "upload_time": "2019-05-06T10:30:19", "url": "https://files.pythonhosted.org/packages/1b/f2/d2012d287ef107ea01b0440816e7695d71a46b29acfa705f8baf357eb63f/pixiv_crawler-0.0.6-py3.6.egg" }, { "comment_text": "", "digests": { "md5": "bb66655b876012cf6b1f4d4608a4ad00", "sha256": "74fe5310df0db738c13c3d6bdefb6df9a696e4d87e11c05749680bf3bb1cfe1f" }, "downloads": -1, "filename": "pixiv_crawler-0.0.6-py3-none-any.whl", "has_sig": false, "md5_digest": "bb66655b876012cf6b1f4d4608a4ad00", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 10093, "upload_time": "2019-05-06T10:30:13", "url": "https://files.pythonhosted.org/packages/80/0e/ba77c3c06cb371e17a6edd88ff0766f1e4ef305e32938858084ac72bc814/pixiv_crawler-0.0.6-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "323d90cc758eb9cfb92e569fc45b1aea", "sha256": "f48ed40fb3a731b0ea8150a06d3d7adff56d383d96d4a9d6839755bb2c759d4e" }, "downloads": -1, "filename": "pixiv_crawler-0.0.6.tar.gz", "has_sig": false, "md5_digest": "323d90cc758eb9cfb92e569fc45b1aea", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8488, "upload_time": "2019-05-06T10:30:20", "url": "https://files.pythonhosted.org/packages/50/fe/48ee5f30d8846d6df9f09820d4242b7a418b873dc2e7f6a653511ced7aa1/pixiv_crawler-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "aa41b32d84d9979cb8b7f6e8d4bdbe72", "sha256": "b1f67d50294e1a65e26de5154c3a717d69ce2ba1b870cf3d22db55373ada2191" }, "downloads": -1, "filename": "pixiv_crawler-0.0.7-py3-none-any.whl", "has_sig": false, "md5_digest": "aa41b32d84d9979cb8b7f6e8d4bdbe72", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11545, "upload_time": "2019-09-15T15:01:00", "url": "https://files.pythonhosted.org/packages/80/26/6c402d72225cfc92385f51c3fade249da1bc8e38132fa753bd8a60c2847e/pixiv_crawler-0.0.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "5f5d5edc78163692a61f0adc5a626fbd", "sha256": "a301061038f491fed787c0c7d715fe71e65a93405849cc44e4c3e8a7ba4a473b" }, "downloads": -1, "filename": "pixiv_crawler-0.0.7.tar.gz", "has_sig": false, "md5_digest": "5f5d5edc78163692a61f0adc5a626fbd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9584, "upload_time": "2019-09-15T15:01:06", "url": "https://files.pythonhosted.org/packages/fb/2b/4c1c9b2f18b9fbe4487064a7f2df695850a4ce8e58d0b18f74bbca13e00b/pixiv_crawler-0.0.7.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "aa41b32d84d9979cb8b7f6e8d4bdbe72", "sha256": "b1f67d50294e1a65e26de5154c3a717d69ce2ba1b870cf3d22db55373ada2191" }, "downloads": -1, "filename": "pixiv_crawler-0.0.7-py3-none-any.whl", "has_sig": false, "md5_digest": "aa41b32d84d9979cb8b7f6e8d4bdbe72", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11545, "upload_time": "2019-09-15T15:01:00", "url": "https://files.pythonhosted.org/packages/80/26/6c402d72225cfc92385f51c3fade249da1bc8e38132fa753bd8a60c2847e/pixiv_crawler-0.0.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "5f5d5edc78163692a61f0adc5a626fbd", "sha256": "a301061038f491fed787c0c7d715fe71e65a93405849cc44e4c3e8a7ba4a473b" }, "downloads": -1, "filename": "pixiv_crawler-0.0.7.tar.gz", "has_sig": false, "md5_digest": "5f5d5edc78163692a61f0adc5a626fbd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9584, "upload_time": "2019-09-15T15:01:06", "url": "https://files.pythonhosted.org/packages/fb/2b/4c1c9b2f18b9fbe4487064a7f2df695850a4ce8e58d0b18f74bbca13e00b/pixiv_crawler-0.0.7.tar.gz" } ] }