{ "info": { "author": "Antonizoon Overtwater , Daniel Oaks ", "author_email": "antonizoon@bibanon.org", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "Natural Language :: English", "Programming Language :: Python :: 2", "Programming Language :: Python :: 3" ], "description": "BASC Archiver\n=============\n\nThe **BASC Archiver** is a Python library (packaged with the\n**thread-archiver** script) used to archive imageboard threads.\nIt uses the `4chan API `_\nwith the py4chan wrapper. Developers are free to use the\nBASC-Archiver library for some interesting third-party applications,\nas it is licensed under the LGPLv3.\n\nIt comes with a CLI interface for archiving threads, the\n**thread-archiver**, with a GUI interface under development.\n\nThe **thread-archiver** is designed to archive all content from a 4chan\nthread:\n\n- Download all images and/or thumbnails in given threads.\n- Download all child threads (threads referred to in a post).\n- Download a JSON dump of thread comments using the 4chan API.\n- Download the HTML page.\n- Convert links in HTML to use the downloaded images.\n- Download CSS/JS and convert HTML to use them.\n- Keep downloading until 404 (with a user-set delay).\n- Can be restarted at any time.\n- Threaded downloading to download multiple files at the same time.\n\nThe **thread-archiver** replaces the typical \u201cRight-click Save As, Web\nPage Complete\u201d action, which does not save full-sized images or JSON. It\nworks as a guerilla, static HTML alternative to Fuuka.\n\n\nUsage\n=====\n\n::\n\n Usage:\n thread-archiver ... [options]\n thread-archiver -h | --help\n thread-archiver -v | --version\n\n Options:\n --path= Path to folder where archives will be saved [default: ./archive]\n --runonce Downloads the thread as it is presently, then exits\n --thread-check-delay= Delay between checks of the same thread [default: 90]\n --delay= Delay between file downloads [default: 0]\n --poll-delay= Delay between thread checks [default: 20]\n --dl-threads-per-site= Download threads to use per site [default: 5]\n --dl-thread-wait= Seconds to wait between downloads on each thread [default: 0.1]\n --nothumbs Don't download thumbnails\n --thumbsonly Download thumbnails, no images\n --nojs Don't download javascript\n --nocss Don't download css\n --ssl Download using HTTPS\n --follow-children Follow threads linked in downloaded threads\n --follow-to-other-boards Follow linked threads, even if from other boards\n --silent Suppresses mundane printouts, prints what's important\n -v --verbose Printout more information than normal\n -h --help Show help\n -V --version Show version\n\n\nExample\n=======\n\n::\n\n thread-archiver http://boards.4chan.org/b/res/423861837 --delay 5 --thumbsonly\n\n\nInstallation\n============\nThe BASC-Archiver is designed for Python 3.x, and can be installed on Windows, Linux, or Mac OS X.\n\n(Python2 has intractable ascii->unicode conversion errors, whereas Python 3.x stores all strings in unicode, so we strongly recommend using 3.x.)\n\nNew stable releases can be found on our `Releases page `_,\nor installed with the PyPi package `BASC-Archiver `_.\n\nLinux and OSX\n-------------\n\n1. Make sure you have Python3 and pip3 installed. On Debian/Ubuntu, Fedora/Red Hat/CentOS, install the packages `python3` and `python3-pip` . Here's a `Mac OS X Installation Guide. `_ \n2. Run ``pip3 install basc-archiver``\n\n - Linux users must run this command as root, or prefix the command with `sudo`.\n3. Run ``thread-archiver http://boards.4chan.org/etc/thread/12345``\n\nThreads will be saved in ``./archive``, but you can change that by supplying a directory with the ``--path=`` argument.\n\nWindows\n-------\n\n1. Download the latest release from `our page `_.\n2. Open up a command prompt window (``cmd.exe``), and move to the directory with ``thread-archiver.exe``\n3. Run ``thread-archiver.exe http://boards.4chan.org/etc/thread/12345``\n\nUsing the Windows version will become simpler once we finish writing the GUI.\n\nAndroid (CLI)\n-------------\n\n **Note:** This is a temporary solution until we put together some\n kind of Android GUI app.\n\nThanks to the QPython interpreter, you can effortlessly run the\nBASC-Archiver on your Android phone.\n\n1. Install the `QPython app `_ from Google Play.\n2. Open the QPython app, and swipe left to reach the menu.\n3. Tap **Package Index**. Then scroll down and tap **Pip Console**.\n4. Run the following commands (after starting the pip\\_install.py\n script):\n\n ::\n\n pip install requests\n pip install basc-archiver\n\nNow you can just open QPython, tap **My QPython**, tap **pip\\_console**,\nand run the following command with your own thread URL:\n\n::\n\n thread-archiver --path=/sdcard/ http://boards.4chan.org/qa/thread/23839\n\nTo run the script in the background, press the back button, and tap\n**OK** at the **Run in Background** prompt. You can stop the script\nanytime using ``Vol Down`` + ``C``.\n\n- **Note**: On Android (CLI), it is important to set the path to\n ``/sdcard/``, so the thread dump can be accessed from the\n ``/sdcard/archives/4chan/`` folder.\n- **Note**: To update the BASC-Archiver on Android (CLI), you must open\n QPython, press the **3-dot menu** button, scroll down and tap **Reset\n Private Space**. Then just reinstall the BASC-Archiver.\n\nLicense\n=======\n\nBibliotheca Anonoma Imageboard Thread Archiver (BASC Archiver)\n\nCopyright (C) 2014 Antonizoon Overtwater, Daniel Oaks. Licensed under the GNU Lesser General Public License v3.\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/bibanon/BASC-Archiver", "keywords": "4chan downloader images json dump", "license": "", "maintainer": "", "maintainer_email": "", "name": "BASC-Archiver", "package_url": "https://pypi.org/project/BASC-Archiver/", "platform": "", "project_url": "https://pypi.org/project/BASC-Archiver/", "project_urls": { "Homepage": "https://github.com/bibanon/BASC-Archiver" }, "release_url": "https://pypi.org/project/BASC-Archiver/0.9.9/", "requires_dist": null, "requires_python": "", "summary": "Makes a complete archive of imageboard threads including images, HTML, and JSON.", "version": "0.9.9" }, "last_serial": 4526938, "releases": { "0.8.0": [ { "comment_text": "", "digests": { "md5": "5cb369776fd88435c530a5a42a642794", "sha256": "a76f7fd3835a12a709260b68499313cc6ce0f70745a130d5e6929470906d5f83" }, "downloads": -1, "filename": "BASC-Archiver-0.8.0.tar.gz", "has_sig": false, "md5_digest": "5cb369776fd88435c530a5a42a642794", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9012, "upload_time": "2014-11-17T04:35:03", "url": "https://files.pythonhosted.org/packages/f0/d8/9c8b370024472e5533d672a9f13a428b3021cdf02b1b7b6dbfcf1fd98778/BASC-Archiver-0.8.0.tar.gz" } ], "0.8.1": [ { "comment_text": "", "digests": { "md5": "87620367c053973682e13d6f375601e6", "sha256": "f979c647081f6659e2fa73da818e93b03296a2dced824bca1d2139be4cd62959" }, "downloads": -1, "filename": "BASC-Archiver-0.8.1.tar.gz", "has_sig": false, "md5_digest": "87620367c053973682e13d6f375601e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9838, "upload_time": "2014-11-17T23:02:33", "url": "https://files.pythonhosted.org/packages/ef/bb/de6f7875a87a10de9c78f37b8f35620426e03fce7bef89cc1e3bd15cb6fe/BASC-Archiver-0.8.1.tar.gz" } ], "0.8.2": [ { "comment_text": "", "digests": { "md5": "94b05d804b9c939ee09ab8ecb57285f5", "sha256": "68ad013ec2ef4b09cb10943ce3caa4feb9b0942a5135fa7a8a009e9ddbbd03b7" }, "downloads": -1, "filename": "BASC-Archiver-0.8.2.tar.gz", "has_sig": false, "md5_digest": "94b05d804b9c939ee09ab8ecb57285f5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9805, "upload_time": "2014-11-18T02:02:04", "url": "https://files.pythonhosted.org/packages/84/a0/b3a8a95da39ba4cc44e18b3275af5d17691dca016b6c1d523c5253b36e4f/BASC-Archiver-0.8.2.tar.gz" } ], "0.8.3": [ { "comment_text": "", "digests": { "md5": "7f2edc2bf0e4392e45e44175ca9f684d", "sha256": "204730294971ab150f2a6d984702bde4dd5e70a49bd8000d15288af13cfd6347" }, "downloads": -1, "filename": "BASC-Archiver-0.8.3.tar.gz", "has_sig": false, "md5_digest": "7f2edc2bf0e4392e45e44175ca9f684d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8702, "upload_time": "2015-01-26T22:23:03", "url": "https://files.pythonhosted.org/packages/70/50/f6daa22d6aaecb575a1a57f83c6349b2aa7e33021003abc2113a1544b128/BASC-Archiver-0.8.3.tar.gz" } ], "0.8.4": [ { "comment_text": "", "digests": { "md5": "cb30ed29932814adc6c594d6efaf3041", "sha256": "55ee41e0da2391d5e15ca425669d7fb22091c7f4d5de5c0a6475c8b4bacf9e0c" }, "downloads": -1, "filename": "BASC-Archiver-0.8.4.tar.gz", "has_sig": false, "md5_digest": "cb30ed29932814adc6c594d6efaf3041", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8495, "upload_time": "2015-01-27T06:10:47", "url": "https://files.pythonhosted.org/packages/e6/c2/140395b4076e8a4414285ac11308c16d383192be759a5b45adc6a6dbecb1/BASC-Archiver-0.8.4.tar.gz" } ], "0.8.5": [ { "comment_text": "", "digests": { "md5": "2ef1a65088a45cb59afbbc0eb9e5da26", "sha256": "b28544c5beba810d222d464147bb19eaca69d790b824bc61893c3014ed08d647" }, "downloads": -1, "filename": "BASC-Archiver-0.8.5.tar.gz", "has_sig": false, "md5_digest": "2ef1a65088a45cb59afbbc0eb9e5da26", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8493, "upload_time": "2015-01-27T06:22:46", "url": "https://files.pythonhosted.org/packages/bc/cf/8f7d133651a038ac13765e12ab38a78657a9053766137dc45428d0c4a790/BASC-Archiver-0.8.5.tar.gz" } ], "0.8.6": [ { "comment_text": "", "digests": { "md5": "a84772e3e777a0ea29c14079e6cb40a1", "sha256": "7cc61720b9f82c41cdb759a2a7d491a49c627a6859d5d8621fe50ed3916cf5e4" }, "downloads": -1, "filename": "BASC-Archiver-0.8.6.tar.gz", "has_sig": false, "md5_digest": "a84772e3e777a0ea29c14079e6cb40a1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8603, "upload_time": "2015-02-21T18:47:22", "url": "https://files.pythonhosted.org/packages/44/dd/6adc736e8df5323ae036fcbc5308a1d8d55c633f00f8a5dca09d751bf56b/BASC-Archiver-0.8.6.tar.gz" } ], "0.8.7": [ { "comment_text": "", "digests": { "md5": "228e30b8fe8492d1d98d07076cdd476f", "sha256": "216f7ce9e820865471ae011971474300771133911dc387212fe283c8d376ace5" }, "downloads": -1, "filename": "BASC-Archiver-0.8.7.tar.gz", "has_sig": false, "md5_digest": "228e30b8fe8492d1d98d07076cdd476f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8656, "upload_time": "2015-06-16T08:48:38", "url": "https://files.pythonhosted.org/packages/eb/f9/3658000fee42519e9aae915f30799c81bdd7b8b54bed0513d69dea92424a/BASC-Archiver-0.8.7.tar.gz" } ], "0.9.0": [ { "comment_text": "", "digests": { "md5": "652d535e09634d483bda540eafc98b15", "sha256": "75fe9fea4443a1c172d7dd21c61574455b501d57f1f4c2f12c77779f4efcaa26" }, "downloads": -1, "filename": "BASC-Archiver-0.9.0.tar.gz", "has_sig": false, "md5_digest": "652d535e09634d483bda540eafc98b15", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11145, "upload_time": "2015-10-04T05:52:00", "url": "https://files.pythonhosted.org/packages/16/5b/62207444a21c02203dace9bbdb252935e154bf119d483c663ba5b22f5ef2/BASC-Archiver-0.9.0.tar.gz" } ], "0.9.1": [ { "comment_text": "", "digests": { "md5": "65d825825988c535f720e4cc15b061e6", "sha256": "7eb0b0b36a7c2a1520459751b22db7f5d7d5cffc44b4c60c336769258478e262" }, "downloads": -1, "filename": "BASC-Archiver-0.9.1.tar.gz", "has_sig": false, "md5_digest": "65d825825988c535f720e4cc15b061e6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13952, "upload_time": "2015-10-08T05:24:20", "url": "https://files.pythonhosted.org/packages/0c/6b/a160f25f2955c5ad550230d42ff7673456a53f660c8e442fe53a591b82a1/BASC-Archiver-0.9.1.tar.gz" } ], "0.9.2": [ { "comment_text": "", "digests": { "md5": "fd123df5d082b471ac958b80ca8fd41e", "sha256": "36e5962cbc541f7eff8f65c4c53f23964102683cedc4299328e6cdb8c4e0a818" }, "downloads": -1, "filename": "BASC-Archiver-0.9.2.tar.gz", "has_sig": false, "md5_digest": "fd123df5d082b471ac958b80ca8fd41e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13596, "upload_time": "2016-01-24T00:32:20", "url": "https://files.pythonhosted.org/packages/ab/bc/46c43d5242f844e73a4a34a057caae2caf6c7e09308952c35a0b1c6c2aff/BASC-Archiver-0.9.2.tar.gz" } ], "0.9.3": [ { "comment_text": "", "digests": { "md5": "c52367e809bd031ae1a7255a294f9ee3", "sha256": "4ecef73d7be4aa503c79d5203606edaea7bbb1ff7421af0e5acc0dbe51e7604d" }, "downloads": -1, "filename": "BASC-Archiver-0.9.3.tar.gz", "has_sig": false, "md5_digest": "c52367e809bd031ae1a7255a294f9ee3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13652, "upload_time": "2016-01-24T00:52:46", "url": "https://files.pythonhosted.org/packages/32/08/f16c5ab3d4a01b1c6f33efbd978776113dbd634b491b738ecc179f2cbecb/BASC-Archiver-0.9.3.tar.gz" } ], "0.9.4": [ { "comment_text": "", "digests": { "md5": "2c1545ff004d67ae7d992c1aff89995c", "sha256": "dda9bcbd32b479afa6767176986eaa6beb2e974e666ac59df120736b568c2677" }, "downloads": -1, "filename": "BASC-Archiver-0.9.4.tar.gz", "has_sig": false, "md5_digest": "2c1545ff004d67ae7d992c1aff89995c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12161, "upload_time": "2016-07-22T05:29:43", "url": "https://files.pythonhosted.org/packages/11/83/9d10ee120b0901d2aea4dc9888d6cc16df34a4c5d9145b668ff51848aac1/BASC-Archiver-0.9.4.tar.gz" } ], "0.9.5": [ { "comment_text": "", "digests": { "md5": "969d4d09b7231e57ad778a15c7c77394", "sha256": "485a8bc9adbb91cd7dde29e6c0e07c7dada424f2508ee250cfa86c9f8134e66f" }, "downloads": -1, "filename": "BASC-Archiver-0.9.5.tar.gz", "has_sig": false, "md5_digest": "969d4d09b7231e57ad778a15c7c77394", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13112, "upload_time": "2016-11-10T22:57:50", "url": "https://files.pythonhosted.org/packages/84/bf/69344e659ef4887bf140364e06a28fb350fb14547d384f908c9361e3e4dc/BASC-Archiver-0.9.5.tar.gz" } ], "0.9.6": [ { "comment_text": "", "digests": { "md5": "940311e4083cce557aa17c6609e63c4a", "sha256": "9b320f5c8325a9110daa65636033f6de623f82646e2ee7dd64346ea419114f2e" }, "downloads": -1, "filename": "BASC-Archiver-0.9.6.tar.gz", "has_sig": false, "md5_digest": "940311e4083cce557aa17c6609e63c4a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12416, "upload_time": "2017-01-01T08:58:09", "url": "https://files.pythonhosted.org/packages/3e/bb/967277fd7156df6c1e9c2315d46d5af4839e69d0a06efc898cd566a406cc/BASC-Archiver-0.9.6.tar.gz" } ], "0.9.7": [ { "comment_text": "", "digests": { "md5": "b8cbb0e6b80f7d8b362178a87ffc2cb6", "sha256": "f1a535155cd3a42f05efbe67791c2c1a589fceb28508e4fd6093bd6391a3bb6a" }, "downloads": -1, "filename": "BASC-Archiver-0.9.7.tar.gz", "has_sig": false, "md5_digest": "b8cbb0e6b80f7d8b362178a87ffc2cb6", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13152, "upload_time": "2017-05-11T07:42:48", "url": "https://files.pythonhosted.org/packages/ee/2c/c3bdfc7f89495c72eb64c5fa4d363879b87023af4324978de62889aec632/BASC-Archiver-0.9.7.tar.gz" } ], "0.9.8": [ { "comment_text": "", "digests": { "md5": "13cba738a6e3f99e5d538e9ec571e082", "sha256": "f3caa60d2426d6a204905ac83381d289aacee5dea9d87f3f87eab8dcb6661895" }, "downloads": -1, "filename": "BASC-Archiver-0.9.8.tar.gz", "has_sig": false, "md5_digest": "13cba738a6e3f99e5d538e9ec571e082", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12149, "upload_time": "2018-06-15T23:25:31", "url": "https://files.pythonhosted.org/packages/8d/9c/944abd439cfdd8a64fce0e13524cd22ebd9d0a2a417782238ac42afafbc6/BASC-Archiver-0.9.8.tar.gz" } ], "0.9.9": [ { "comment_text": "", "digests": { "md5": "4e930c6228193b66ba1bde8293ec5fbc", "sha256": "a09d6001d5e58d92fd90245b7ba9056b7836cfd57d95f10e4aa36b45e40fa9e6" }, "downloads": -1, "filename": "BASC-Archiver-0.9.9.tar.gz", "has_sig": false, "md5_digest": "4e930c6228193b66ba1bde8293ec5fbc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12165, "upload_time": "2018-11-25T20:00:58", "url": "https://files.pythonhosted.org/packages/dc/98/19653779cd991010c4b4052d7388fae5b965ece9acd7f5e80fed2c0a2c25/BASC-Archiver-0.9.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "4e930c6228193b66ba1bde8293ec5fbc", "sha256": "a09d6001d5e58d92fd90245b7ba9056b7836cfd57d95f10e4aa36b45e40fa9e6" }, "downloads": -1, "filename": "BASC-Archiver-0.9.9.tar.gz", "has_sig": false, "md5_digest": "4e930c6228193b66ba1bde8293ec5fbc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12165, "upload_time": "2018-11-25T20:00:58", "url": "https://files.pythonhosted.org/packages/dc/98/19653779cd991010c4b4052d7388fae5b965ece9acd7f5e80fed2c0a2c25/BASC-Archiver-0.9.9.tar.gz" } ] }