{
    "info": {
        "author": "Jacob M. Johnson",
        "author_email": "jake@archive.org",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 1 - Planning",
            "Environment :: Console",
            "Intended Audience :: Developers",
            "License :: OSI Approved :: GNU Affero General Public License v3",
            "Natural Language :: English",
            "Programming Language :: Python :: 3"
        ],
        "description": "=========\n IA Mine\n=========\n\nInternet Archive data mining tools.\n\n\nWhat Is IA Mine?\n================\n\nIA Mine is a command line tool and Python 3 library for data mining\nthe Internet Archive.\n\n\nHow Do I Get Started?\n=====================\n\n\nCommand Line Interface\n----------------------\n\nThe IA Mine command line tool should work on any Unix-like operating\nsystem that has Python 3 installed on it. To start using ``ia-mine``,\nsimply download one of the latest binaries from\n`https://archive.org/details/iamine-pex\n<https://archive.org/details/iamine-pex>`_.\n\n.. code:: bash\n\n    # Download ia-mine and make it executable.\n    $ curl -LO https://archive.org/download/iamine-pex/ia-mine\n    $ chmod +x ia-mine\n    $ ./ia-mine --help\n    ...\n\nUsage:\n\n.. code::\n\n    $ ia-mine --help\n    Concurrently retrieve metadata from Archive.org items.\n\n    usage: ia-mine (<itemlist> | -) [--debug] [--workers WORKERS] [--cache]\n                   [--retries RETRIES] [--secure] [--hosts HOSTS]\n           ia-mine [--all | --search QUERY] [[--info | --info --field FIELD...]\n                   |--num-found | --mine-ids | --field FIELD... | --itemlist]\n                   [--debug] [--rows ROWS] [--workers WORKERS] [--cache]\n                   [--retries RETRIES] [--secure] [--hosts HOSTS]\n           ia-mine [-h | --version | --configure]\n\n    positional arguments:\n      itemlist              A file containing Archive.org identifiers, one per\n                            line, for which to retrieve metadata from. If no\n                            itemlist is provided, identifiers will be read from\n                            stdin.\n\n    optional arguments:\n      -h, --help            Show this help message and exit.\n      -v, --version         Show program's version number and exit.\n      --configure           Configure ia-mine to use your Archive.org credentials.\n      -d, --debug           Turn on verbose logging [default: False]\n      -a, --all             Mine all indexed items.\n      -s, --search QUERY    Mine search results. For help formatting your query,\n                            see: https://archive.org/advancedsearch.php\n      -m, --mine-ids        Mine items returned from search results.\n                            [default: False]\n      -i, --info            Print search result response header to stdout and exit.\n      -f, --field FIELD     Fields to include in search results.\n      -i, --itemlist        Print identifiers only to stdout. [default: False]\n      -n, --num-found       Print the number of items found for the given search\n                            query.\n      --rows ROWS           The number of rows to return for each request made to\n                            the Archive.org Advancedsearch API. On slower networks,\n                            it may be useful to use a lower value, and on faster\n                            networks, a higher value. [default: 50]\n      -w, --workers WORKERS\n                            The maximum number of tasks to run at once.\n                            [default: 100]\n      -c, --cache           Cache item metadata on Archive.org. Items are not\n                            cached are not cached by default.\n      -r, --retries RETRIES\n                            The maximum number of retries for each item.\n                            [default: 10]\n      --secure              Use HTTPS. HTTP is used by default.\n      -H, --hosts HOSTS     A file containing a list of hosts to shuffle through.\n\n\nPython Library\n--------------\n\nThe IA Mine Python library can be installed with pip:\n\n.. code:: bash\n\n    # Create a Python 3 virtualenv, and install iamine.\n    $ virtualenv --python=python3 venv\n    $ . venv/bin/activate\n    $ pip install iamine\n\nThis will also install the ``ia-mine`` comand line tool into your virtualenv:\n\n.. code:: bash\n\n    $ which ia-mine\n    /home/user/venv/bin/ia-mine\n\n\nData Mining with IA Mine and jq\n===============================\n\n``ia-mine`` simply retrieves metadata and search results concurrently\nfrom Archive.org, and dumps the JSON returned to stdout and any error\nmessages to stderr. Mining the JSON dumped to stdout can be done using a\ntool like `jq <http://stedolan.github.io/jq/>`_, for example. jq\nbinaries can be downloaded at `http://stedolan.github.io/jq/download/\n<http://stedolan.github.io/jq/download/>`_.\n\n``ia-mine`` can mine Archive.org search results, the items returned from\nsearch results, or items provide via an itemlist or stdin.\n\n\nDevelopers\n==========\n\nPlease report any bugs or issues on github:\n`https://github.com/jjjake/iamine <https://github.com/jjjake/iamine>`_\n\n\n.. :changelog:\n\nRelease History\n---------------\n\n0.3.5 (2016-05-24)\n++++++++++++++++++\n\n**Bugfixes**\n\n- All output from ia-mine should be JSONL.\n  Some responses from the Metadata API contain unescaped newlines.\n  This causes a lot of issues when using `jq` are when parsing JSON line-by-line.\n  to address this, JSON responses returned from server are now parsed and dumped back to JSON before printing to stdout.\n\n\n0.3.5 (2016-05-24)\n++++++++++++++++++\n\n**Features and Improvements**\n\n- Fixed ``Exception ignored in:`` errors.\n- Added support for custom config files.\n\n0.3.3 (2015-08-04)\n++++++++++++++++++\n\n**Bugfixes**\n\n-  Added HISTORY.rst to MANIFEST.in to fix `pip install iamine`.\n\n0.3.2 (2015-08-03)\n++++++++++++++++++\n\n**Bugfixes**\n\n-  ``asyncio.JoinableQueue`` was deprecated in Python 3.4.4.\n   ``iamine.core.Miner`` now uses ``asyncio.Queue`` for Python 3.4.4 and\n   newer and ``asyncio.JoinableQueue`` for older versions\n   (``asyncio.Queue`` cannot be used for all versions because\n   ``asyncio.Queue.join()`` was only added in version 3.4.4.).\n-  ``SearchMiner.get_search_info()`` is no longer a coroutine (now uses\n   ``urllib``). Fixed bug in ``iamine.api.search`` where it was still\n   being called as coroutine.",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "UNKNOWN",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/jjjake/iamine",
        "keywords": null,
        "license": "AGPL 3",
        "maintainer": null,
        "maintainer_email": null,
        "name": "iamine",
        "package_url": "https://pypi.org/project/iamine/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/iamine/",
        "project_urls": {
            "Download": "UNKNOWN",
            "Homepage": "https://github.com/jjjake/iamine"
        },
        "release_url": "https://pypi.org/project/iamine/0.3.6/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "Concurrently retrieve metadata from Archive.org items.",
        "version": "0.3.6"
    },
    "last_serial": 2132006,
    "releases": {
        "0.1.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "012f202117d6ae9841ee2487b136c398",
                    "sha256": "1c862e0c36ea67360dc36b3802cd94f1c47763c79c529e5a07c8f4e5f8cbc467"
                },
                "downloads": -1,
                "filename": "iamine-0.1.0.tar.gz",
                "has_sig": false,
                "md5_digest": "012f202117d6ae9841ee2487b136c398",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 5066,
                "upload_time": "2015-03-10T22:19:29",
                "url": "https://files.pythonhosted.org/packages/18/0c/cca67936ab455231a7e791295dd821d14f848e6956b496e1776d8c08243f/iamine-0.1.0.tar.gz"
            }
        ],
        "0.1.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e32da20da97e1a8ef9ba78ef6822b0ee",
                    "sha256": "4352f7de7e30f3a52ae42ada8da62680f1a1607650a85196ea91dcac7d12599d"
                },
                "downloads": -1,
                "filename": "iamine-0.1.1.tar.gz",
                "has_sig": false,
                "md5_digest": "e32da20da97e1a8ef9ba78ef6822b0ee",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 5356,
                "upload_time": "2015-03-10T22:42:19",
                "url": "https://files.pythonhosted.org/packages/0c/50/52154bfdc70816b820ea6190d5168ca61b35d30a4f77923ffd6d68be99dd/iamine-0.1.1.tar.gz"
            }
        ],
        "0.1.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "b097aa5120030fbb3b10690337b87ccf",
                    "sha256": "07a2ca5e2227ae2dc8d399271e0ac2badd7e86074138aeb58ba5b2fb99390ccf"
                },
                "downloads": -1,
                "filename": "iamine-0.1.2.tar.gz",
                "has_sig": false,
                "md5_digest": "b097aa5120030fbb3b10690337b87ccf",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 5360,
                "upload_time": "2015-03-10T23:01:58",
                "url": "https://files.pythonhosted.org/packages/3b/cf/7b9dd573f9238d6256abe3fbd33a5bb7e532330559291db04200a5197314/iamine-0.1.2.tar.gz"
            }
        ],
        "0.1.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "92e84ed7e4dea943a5b32d3f91388d12",
                    "sha256": "f129b168222a52e63b4dfcfd695550e7ba3ab990544bcb976123e84bbbb1c27b"
                },
                "downloads": -1,
                "filename": "iamine-0.1.3.tar.gz",
                "has_sig": false,
                "md5_digest": "92e84ed7e4dea943a5b32d3f91388d12",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 5360,
                "upload_time": "2015-03-10T23:58:15",
                "url": "https://files.pythonhosted.org/packages/67/a5/4afef04a557df1fe5c32ba1b1888aac4659c62b3ecd3a50d539af8e36e68/iamine-0.1.3.tar.gz"
            }
        ],
        "0.1.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "04dbd52ff0a32883138473a1ec20dc9d",
                    "sha256": "e9a7582e92aeb9c0afb883c5b1199bace5c134b44517985a3fe0ce162625134c"
                },
                "downloads": -1,
                "filename": "iamine-0.1.4.tar.gz",
                "has_sig": false,
                "md5_digest": "04dbd52ff0a32883138473a1ec20dc9d",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 8346,
                "upload_time": "2015-03-12T23:49:26",
                "url": "https://files.pythonhosted.org/packages/56/ee/15fe2ee859a2e76ebfb182d313ec6e82d3e965ac753395a9d9399d8f5382/iamine-0.1.4.tar.gz"
            }
        ],
        "0.1.5": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "22d5e100895449f4c4d3220428fbc342",
                    "sha256": "b2f8a36eddb0abee1101d594e58bc80029eba1d06b135c068c624e3c4769af82"
                },
                "downloads": -1,
                "filename": "iamine-0.1.5-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "22d5e100895449f4c4d3220428fbc342",
                "packagetype": "bdist_wheel",
                "python_version": "3.3",
                "requires_python": null,
                "size": 10837,
                "upload_time": "2015-03-13T03:23:47",
                "url": "https://files.pythonhosted.org/packages/ac/52/766783f8eae384a7f700247aacc39b2b9b7669c721021872bcd983098486/iamine-0.1.5-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "bfd0afa67fbe834d23b2a998569b937d",
                    "sha256": "7e7945f994f2d0e31cc64db45dd6ac6ec5577fb43d59e752eb4b38d563b29a1a"
                },
                "downloads": -1,
                "filename": "iamine-0.1.5.tar.gz",
                "has_sig": false,
                "md5_digest": "bfd0afa67fbe834d23b2a998569b937d",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 8386,
                "upload_time": "2015-03-13T00:00:48",
                "url": "https://files.pythonhosted.org/packages/29/9c/d0bc1bbbe71a82fcedd1bf5b7c96065c6808c3db3821da5f8d5c7fc7db9b/iamine-0.1.5.tar.gz"
            }
        ],
        "0.1.6": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e7ca44baf256db8715c788f08fd455b8",
                    "sha256": "9cd69030b92f9cb212f6fa85ca9de30bcb53c70603c83e2a85c075ca7a121754"
                },
                "downloads": -1,
                "filename": "iamine-0.1.6-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "e7ca44baf256db8715c788f08fd455b8",
                "packagetype": "bdist_wheel",
                "python_version": "3.4",
                "requires_python": null,
                "size": 11062,
                "upload_time": "2015-03-13T18:23:18",
                "url": "https://files.pythonhosted.org/packages/ee/5d/0ecac5720cbcc4c94cd1f45e5079a68c32e55724e37f7a4b083b5af465ff/iamine-0.1.6-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "3462eae66a9c061218e95e717f699483",
                    "sha256": "91f3e814bfdc902c82fe09c7fa6cd691aadb5ada25f721db50092b7943b16be0"
                },
                "downloads": -1,
                "filename": "iamine-0.1.6.tar.gz",
                "has_sig": false,
                "md5_digest": "3462eae66a9c061218e95e717f699483",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 8667,
                "upload_time": "2015-03-13T18:22:32",
                "url": "https://files.pythonhosted.org/packages/54/ee/6d7013958ab8d91e94f0b399e0bcce9dda36be17b9faddf204ba4c791f5b/iamine-0.1.6.tar.gz"
            }
        ],
        "0.1.7": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "40ddcfc34b8dfdaedfb44e57d777a853",
                    "sha256": "b3d56500726a44e295ea44dc0d5e2f5dcf6063d5cc216e632f42d439e83ef8a6"
                },
                "downloads": -1,
                "filename": "iamine-0.1.7.tar.gz",
                "has_sig": false,
                "md5_digest": "40ddcfc34b8dfdaedfb44e57d777a853",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 8996,
                "upload_time": "2015-03-16T23:52:11",
                "url": "https://files.pythonhosted.org/packages/91/7a/b8d03f2b46074070ad7b1113d66db28ac630966258ad87ea39cdcfc19e42/iamine-0.1.7.tar.gz"
            }
        ],
        "0.1.9": [],
        "0.2.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "d2dfef260ba32e3c6985be53b1bdf397",
                    "sha256": "c7482c5cfd545663541abd4b471399fdfa317b091d33e09a4aee00b2d5e0a711"
                },
                "downloads": -1,
                "filename": "iamine-0.2.0.tar.gz",
                "has_sig": false,
                "md5_digest": "d2dfef260ba32e3c6985be53b1bdf397",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 9860,
                "upload_time": "2015-03-24T00:10:31",
                "url": "https://files.pythonhosted.org/packages/85/50/17094ab4ded264ce9635e2e170f805c6aaa379b20ebe52428773b071a9dc/iamine-0.2.0.tar.gz"
            }
        ],
        "0.2.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "056ab5ad22992d1fdb21389c17fcb135",
                    "sha256": "5fd60d3f8038f29ef78a054f5558225ee09aea054ec62656c6c35e0b70e41159"
                },
                "downloads": -1,
                "filename": "iamine-0.2.1.tar.gz",
                "has_sig": false,
                "md5_digest": "056ab5ad22992d1fdb21389c17fcb135",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 9700,
                "upload_time": "2015-04-24T22:34:33",
                "url": "https://files.pythonhosted.org/packages/85/49/2791ff8fe6de997a5a55520d38b8292a8369c3ce8f7a2f3775cfafc3a0aa/iamine-0.2.1.tar.gz"
            }
        ],
        "0.2.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "22efcfc4149f221f54b6f8bd0521eb96",
                    "sha256": "9eb362ab02500f0cdf046e25ea56aa38ab7360dabe014e87557c577b10e324d3"
                },
                "downloads": -1,
                "filename": "iamine-0.2.2.tar.gz",
                "has_sig": false,
                "md5_digest": "22efcfc4149f221f54b6f8bd0521eb96",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 9676,
                "upload_time": "2015-04-24T22:40:14",
                "url": "https://files.pythonhosted.org/packages/d3/2a/28824bafab7ff938ebc059a38a947536f3db8008cf7ccae13523c86ed484/iamine-0.2.2.tar.gz"
            }
        ],
        "0.3.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "195e14f29acf8d39058a3ffa7207c6f4",
                    "sha256": "ba5cf0eec3570ce7a8d3117ead5d1e4b612b21b5328beda740384b022eaf24a5"
                },
                "downloads": -1,
                "filename": "iamine-0.3.0.tar.gz",
                "has_sig": false,
                "md5_digest": "195e14f29acf8d39058a3ffa7207c6f4",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 10333,
                "upload_time": "2015-06-30T17:25:58",
                "url": "https://files.pythonhosted.org/packages/95/c7/f05e6040fb5ad5682bde3861dc6904b8fc71528e3a9ba8f120f463fec70f/iamine-0.3.0.tar.gz"
            }
        ],
        "0.3.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "b16e3650c3d0fd9783943c59ed9024d2",
                    "sha256": "13ab5f0ba3fb0cd11b69e565272cf5ad389dc94326925f989a25356e04153777"
                },
                "downloads": -1,
                "filename": "iamine-0.3.1.tar.gz",
                "has_sig": false,
                "md5_digest": "b16e3650c3d0fd9783943c59ed9024d2",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 10545,
                "upload_time": "2015-07-21T22:23:41",
                "url": "https://files.pythonhosted.org/packages/04/2a/417f475622183704ca69ef253b2e703a8e8036384d299dcee0f759aad848/iamine-0.3.1.tar.gz"
            }
        ],
        "0.3.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "3db24ef876cf027d8fd94007a2c2efa8",
                    "sha256": "83abf49f96c707baeac87e874eb537b28197788faa166b8d05a2e39c20a1c00b"
                },
                "downloads": -1,
                "filename": "iamine-0.3.2.tar.gz",
                "has_sig": false,
                "md5_digest": "3db24ef876cf027d8fd94007a2c2efa8",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12055,
                "upload_time": "2015-08-03T21:41:37",
                "url": "https://files.pythonhosted.org/packages/19/a6/49cbb6cac24540b55fba68809bb95ec0e88b5594dfb1d23311f93e3db94f/iamine-0.3.2.tar.gz"
            }
        ],
        "0.3.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "dae5d5ea4d66398597e3572971cdd97d",
                    "sha256": "2c5447bc752ee8ab982efa58eabf220b06fb2e4c3968243c994159043c965a0f"
                },
                "downloads": -1,
                "filename": "iamine-0.3.3.tar.gz",
                "has_sig": false,
                "md5_digest": "dae5d5ea4d66398597e3572971cdd97d",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12523,
                "upload_time": "2015-08-04T19:18:09",
                "url": "https://files.pythonhosted.org/packages/ad/98/b278108273eb3e4d9ae1abc456a24a575c9f988af025a4601277f2cf933e/iamine-0.3.3.tar.gz"
            }
        ],
        "0.3.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "1d4ccd160c7c1bfebbd130b6c7b52cea",
                    "sha256": "86124b5ed48d8e767e9dce205f36f08b84e107477e3895077ce07eca4a83f1a8"
                },
                "downloads": -1,
                "filename": "iamine-0.3.4.tar.gz",
                "has_sig": false,
                "md5_digest": "1d4ccd160c7c1bfebbd130b6c7b52cea",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12528,
                "upload_time": "2016-05-09T23:01:05",
                "url": "https://files.pythonhosted.org/packages/90/59/0a2b050d2f1db394824b60afa2eab7f5dcad4c69773f61239bd16febdba2/iamine-0.3.4.tar.gz"
            }
        ],
        "0.3.5": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "1783ac74539d38662736df7d2f0e1d2b",
                    "sha256": "7b746dc902d2146038a05d8d3cac068f317e0ef84de64a3d175dd28419ffceb0"
                },
                "downloads": -1,
                "filename": "iamine-0.3.5.tar.gz",
                "has_sig": false,
                "md5_digest": "1783ac74539d38662736df7d2f0e1d2b",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12781,
                "upload_time": "2016-05-24T20:48:38",
                "url": "https://files.pythonhosted.org/packages/73/b5/01372d91393718017fc698ea82f27b92ec2c4837b2ed3cb0922d63fec7b1/iamine-0.3.5.tar.gz"
            }
        ],
        "0.3.6": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "8d8731a501348ecdc0aa5410d57d5731",
                    "sha256": "e36158df8e0980cbbd34fe47a5df1f486539be483b4c562898b03330e71b6120"
                },
                "downloads": -1,
                "filename": "iamine-0.3.6.tar.gz",
                "has_sig": false,
                "md5_digest": "8d8731a501348ecdc0aa5410d57d5731",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 13092,
                "upload_time": "2016-05-24T22:32:35",
                "url": "https://files.pythonhosted.org/packages/2d/5f/8bd3d94eb097e2c17c6c5d1245691e33bdba98c945c3cfeee546250a5b67/iamine-0.3.6.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "8d8731a501348ecdc0aa5410d57d5731",
                "sha256": "e36158df8e0980cbbd34fe47a5df1f486539be483b4c562898b03330e71b6120"
            },
            "downloads": -1,
            "filename": "iamine-0.3.6.tar.gz",
            "has_sig": false,
            "md5_digest": "8d8731a501348ecdc0aa5410d57d5731",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 13092,
            "upload_time": "2016-05-24T22:32:35",
            "url": "https://files.pythonhosted.org/packages/2d/5f/8bd3d94eb097e2c17c6c5d1245691e33bdba98c945c3cfeee546250a5b67/iamine-0.3.6.tar.gz"
        }
    ]
}