{ "info": { "author": "George Brighton", "author_email": "oss@gebn.co.uk", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Intended Audience :: Developers", "Intended Audience :: End Users/Desktop", "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Topic :: Internet :: WWW/HTTP", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "chandl\n======\n\n.. image:: https://img.shields.io/pypi/status/chandl.svg\n :target: https://pypi.python.org/pypi/chandl\n.. image:: https://img.shields.io/pypi/v/chandl.svg\n :target: https://pypi.python.org/pypi/chandl\n.. image:: https://img.shields.io/pypi/pyversions/chandl.svg\n :target: https://pypi.python.org/pypi/chandl\n.. image:: https://travis-ci.org/gebn/chandl.svg?branch=master\n :target: https://travis-ci.org/gebn/chandl\n.. image:: https://scan.coverity.com/projects/11734/badge.svg\n :target: https://scan.coverity.com/projects/gebn-chandl\n.. image:: https://coveralls.io/repos/github/gebn/chandl/badge.svg?branch=master\n :target: https://coveralls.io/github/gebn/chandl?branch=master\n\nA lightweight tool for parsing and downloading 4chan threads.\n\nFeatures\n--------\n\n- A comprehensive API for programmatically analysing 4chan content.\n- Concurrent downloading, with parallelism linked to the number of available cores.\n- Override the file naming scheme and specify exclusions for thread downloads.\n- Filter files by extension or category (e.g. images, videos).\n\nInstallation\n------------\n\nTo install ``chandl``, simply run:\n\n::\n\n $ pip install chandl\n\nExamples\n--------\n\nDownload all files in ````, to a new directory named after the thread if possible, otherwise its raw id:\n\n::\n\n $ chandl \n\nDownload all images and ``.webm`` files in ```` to ``/dev/shm``, using 3 download threads per core:\n\n::\n\n $ chandl -f images,webm -o /dev/shm -p 3 \n\nDownload all files in ````, except ``abc.jpg`` and ``def.jpg`` to the present working directory, using a custom name format:\n\n::\n\n $ chandl -e abc.jpg,def.jpg -t . -n \"{board} - {file.name}.{file.extension}\" \n\nUsage\n-----\n\n::\n\n $ chandl -h\n usage: chandl [-h] [-V] [-v] [-f [FILTER]] [-e [EXCLUDE]] [-o [OUTPUT_DIR]]\n [-t [THREAD_DIR]] [-n [NAME]] [-p PARALLELISM]\n url\n\n A lightweight tool for parsing and downloading 4chan threads.\n\n positional arguments:\n url the URL of the thread to download\n\n optional arguments:\n -h, --help show this help message and exit\n -V, --version show program's version number and exit\n -v, --verbosity increase output verbosity\n -f [FILTER], --filter [FILTER]\n file types or extensions to download, value either\n comma-separated or option passed multiple times\n -e [EXCLUDE], --exclude [EXCLUDE]\n file names to exclude, value either comma-separated or\n option passed multiple times\n -o [OUTPUT_DIR], --output-dir [OUTPUT_DIR]\n the directory to create the `thread-dir` within\n -t [THREAD_DIR], --thread-dir [THREAD_DIR]\n relative to the `output-dir`, this will contain\n downloaded files\n -n [NAME], --name [NAME]\n the format to use for downloaded file names\n -p PARALLELISM, --parallelism PARALLELISM\n the maximum number of download threads to use per core\n\nRoadmap\n-------\n\n- Implement tracking of threads until they are deleted\n- Improve test coverage\n- Pylint or flake8 integration", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/gebn/chandl", "keywords": "", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "chandl", "package_url": "https://pypi.org/project/chandl/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/chandl/", "project_urls": { "Homepage": "https://github.com/gebn/chandl" }, "release_url": "https://pypi.org/project/chandl/0.3.0/", "requires_dist": null, "requires_python": "", "summary": "A lightweight tool for parsing and downloading 4chan threads.", "version": "0.3.0" }, "last_serial": 2636695, "releases": { "0.0.2": [ { "comment_text": "", "digests": { "md5": "879fd4697ee4dccd413c2fdb2964fd1f", "sha256": "f30676700b916eeef5da3a244cbd1f8aac01e8e5fd298c0241ff339cdab4062f" }, "downloads": -1, "filename": "chandl-0.0.2.tar.gz", "has_sig": false, "md5_digest": "879fd4697ee4dccd413c2fdb2964fd1f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7989, "upload_time": "2016-11-25T20:17:04", "url": "https://files.pythonhosted.org/packages/78/4b/0cb1836e3cdf3ef53c6e4aff3f56697688fd65e09e3ea2e02545f9367dda/chandl-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "6b298a9c7a5ae12aa405b714f10d3be2", "sha256": "6c60dc7806423c8897f6e2fbb17065523329beedf9f435db1a884ea6e0be4091" }, "downloads": -1, "filename": "chandl-0.0.3.tar.gz", "has_sig": false, "md5_digest": "6b298a9c7a5ae12aa405b714f10d3be2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8150, "upload_time": "2016-11-25T20:42:45", "url": "https://files.pythonhosted.org/packages/09/aa/79e0d1e66f39551d22ea8d1c1d72b71314b48fd54290e4f8c1fc484fbe3f/chandl-0.0.3.tar.gz" } ], "0.1.0": [ { "comment_text": "", "digests": { "md5": "7dfb29aebe65251bb11ec79b8f41b7a7", "sha256": "42e001cdb5d3db41c038048556096ea44d1f9095abe2b9d4b8721d3e704cd74f" }, "downloads": -1, "filename": "chandl-0.1.0.tar.gz", "has_sig": false, "md5_digest": "7dfb29aebe65251bb11ec79b8f41b7a7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9501, "upload_time": "2016-11-26T15:46:45", "url": "https://files.pythonhosted.org/packages/51/2e/6a3173e93da17084655116a698b5a014ecc6abc4b181f8ac3d59a03b7ac0/chandl-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "4574b7cbde1ce4e2d224c9b191d9f313", "sha256": "5c81eae37d4fa6cfefdce66da5d7e79c067fe469852c26b63174a343807801dd" }, "downloads": -1, "filename": "chandl-0.1.1.tar.gz", "has_sig": false, "md5_digest": "4574b7cbde1ce4e2d224c9b191d9f313", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10976, "upload_time": "2016-11-26T18:14:35", "url": "https://files.pythonhosted.org/packages/5f/74/201e7e12a981ec7cb2971979f381bd7e7806a5a38c0f4e550d6c0cd5b709/chandl-0.1.1.tar.gz" } ], "0.2.0": [ { "comment_text": "", "digests": { "md5": "f86ef4680f590ae5d97e96e0f85d2d17", "sha256": "48f7824877f8a41bad4068d221fc7ad1d01b329a6f4647cd3c865963b0fdecb2" }, "downloads": -1, "filename": "chandl-0.2.0.tar.gz", "has_sig": false, "md5_digest": "f86ef4680f590ae5d97e96e0f85d2d17", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 13432, "upload_time": "2016-11-27T04:35:08", "url": "https://files.pythonhosted.org/packages/42/74/bded8a33ff5c534f9ea348fadc95663de7e2c9bbc8e05ab84aed39dd8d9c/chandl-0.2.0.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "5fa5974b7fff3575d748e10a41cc3644", "sha256": "7fcfb2edb525e8e456bce9b5f86432e692ce9ec277e7d8d505f7653a27d257bd" }, "downloads": -1, "filename": "chandl-0.3.0.tar.gz", "has_sig": false, "md5_digest": "5fa5974b7fff3575d748e10a41cc3644", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16848, "upload_time": "2017-02-12T14:45:04", "url": "https://files.pythonhosted.org/packages/6b/90/2e4f095de1b90d448a1dd89dd4ef4b9abd766e460adbcd80e0344b671ba0/chandl-0.3.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "5fa5974b7fff3575d748e10a41cc3644", "sha256": "7fcfb2edb525e8e456bce9b5f86432e692ce9ec277e7d8d505f7653a27d257bd" }, "downloads": -1, "filename": "chandl-0.3.0.tar.gz", "has_sig": false, "md5_digest": "5fa5974b7fff3575d748e10a41cc3644", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 16848, "upload_time": "2017-02-12T14:45:04", "url": "https://files.pythonhosted.org/packages/6b/90/2e4f095de1b90d448a1dd89dd4ef4b9abd766e460adbcd80e0344b671ba0/chandl-0.3.0.tar.gz" } ] }