{ "info": { "author": "Mark Baggett", "author_email": "mbagget1@utk.edu", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: GNU General Public License v3 (GPLv3)", "Operating System :: OS Independent", "Programming Language :: Python :: 3.7" ], "description": "======================\nDLTN Check and Harvest\n======================\n\n.. image:: https://travis-ci.org/DigitalLibraryofTennessee/check_and_harvest.png\n :alt: TravisCI badge\n\n.. image:: https://badge.fury.io/py/dltn-checker.svg\n :target: https://badge.fury.io/py/dltn-checker\n :alt: PyPI badge\n\n\n-----\nAbout\n-----\n\nTests whether records from an OAI-PMH feed pass minimum requirements of DLTN and optionally harvests only the good\nrecords from a request to disk so that they can be added to Repox and included in the DPLA.\n\n-------\nInstall\n-------\n\nRunning with Builtin Argument Parsing from a CLI\n================================================\n\nIf you want to do it this way, you're going to need to clone this. It's also suggested to build this with pipenv.\n\n.. code-block:: console\n\n $ git clone https://github.com/DigitalLibraryofTennessee/check_and_harvest\n $ cd check_and_harvest\n $ pipenv install\n $ pipenv shell\n\nUsing OAIChecker from the dltnchecker module\n============================================\n\nIf you're cool :sunglasses: :\n\n.. code-block:: console\n\n $ pipenv install dltn_checker\n\nOtherwise:\n\n.. code-block:: console\n\n $ pip install dltn_checker\n\n\n------------------------------------------\nExamples with the Built In Argument Parser\n------------------------------------------\n\n1. Check for bad DC records in an entire OAI-PMH feed.\n\n.. code-block:: console\n\n $ python run -e http://my-oai-endpoint:8080/OAIHandler -m oai_dc\n\n2. Check and harvest good DC records from an entire OAI-PMH feed.\n\n.. code-block:: console\n\n $ python run -e http://my-oai-endpoint:8080/OAIHandler -m oai_dc -H True\n\n3. Check and harvest good xoai records from a specifc set.\n\n.. code-block:: console\n\n $ python run -e http://my-oai-endpoint:8080/OAIHandler -m xoai -s my_awesome_xoai_set -H True\n\n4. Check and harvest good MODS records from an entire provider in Repox.\n\n.. code-block:: console\n\n $ python run -e http://my-oai-endpoint:8080/OAIHandler -m MODS -p CrossroadstoFreedomr0 -H True\n\n----------------------------------------------------\nExamples using the OAIChecker Class from dltnchecker\n----------------------------------------------------\n\nCheck a set to see if there are any bad files in a set.\n\n.. code-block:: python\n\n from dltnchecker.harvest import OAIChecker\n request = OAIChecker(\"https://dpla.lib.utk.edu/repox/OAIHandler\", \"crossroads_sanitation\", \"MODS\")\n request.list_records()\n print(request.bad_records)\n\nBy default, this will try to download the good files to a directory called output. If you don't want to download, you\nneed to pass an additional parameter called harvest and set to False.\n\n.. code-block:: python\n\n from dltnchecker.harvest import OAIChecker\n request = OAIChecker(\"https://dpla.lib.utk.edu/repox/OAIHandler\", \"crossroads_sanitation\", \"MODS\", harvest=False)\n request.list_records()\n print(request.bad_records)\n\n\n", "description_content_type": "text/x-rst", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/DigitalLibraryofTennessee/check_and_harvest", "keywords": "libraries,dpla,dltn,oaipmh,aggregators", "license": "", "maintainer": "", "maintainer_email": "mbagget1@utk.edu", "name": "dltn-checker", "package_url": "https://pypi.org/project/dltn-checker/", "platform": "", "project_url": "https://pypi.org/project/dltn-checker/", "project_urls": { "Homepage": "https://github.com/DigitalLibraryofTennessee/check_and_harvest" }, "release_url": "https://pypi.org/project/dltn-checker/0.0.2/", "requires_dist": [ "requests (>=2.21.0)", "xmltodict (>=0.12.0)", "lxml (>=4.3.1)", "repox (>=0.0.2)", "pyyaml (>=4.2b1)" ], "requires_python": "", "summary": "a simple utility to check and harvest metadata records from an OAI request when they meet theDLTN requirements", "version": "0.0.2" }, "last_serial": 4869855, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "b96f2d15fa09a6f152c98d9f0462db05", "sha256": "d6c1d212f80db6d95e0c7d7019c7b82604ece4fe93889ac147515fcbf32e7145" }, "downloads": -1, "filename": "dltn_checker-0.0.1-py3-none-any.whl", "has_sig": false, "md5_digest": "b96f2d15fa09a6f152c98d9f0462db05", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 5446, "upload_time": "2019-02-25T16:33:57", "url": "https://files.pythonhosted.org/packages/95/f0/3b94c988b2002979104d0b2a008ceeee1a68d452cf9cd13d1617114f6608/dltn_checker-0.0.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "4d831b4264a186197546dfa24593ef6f", "sha256": "6c4179495ac3f69d758067a24d5c193fa7b461e3fe5f27520a1364603d5f3747" }, "downloads": -1, "filename": "dltn_checker-0.0.1.tar.gz", "has_sig": false, "md5_digest": "4d831b4264a186197546dfa24593ef6f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4785, "upload_time": "2019-02-25T16:33:59", "url": "https://files.pythonhosted.org/packages/91/31/614bc60153582f983edc7ab337b737519c1ef650e3cb1664c386bc3aff76/dltn_checker-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "b908383ec7683c3160c391d38802ad2f", "sha256": "bab11e305c1333dd4d665caf80c6dfae80fae8b15075325209c83f7c30ab9610" }, "downloads": -1, "filename": "dltn_checker-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "b908383ec7683c3160c391d38802ad2f", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9149, "upload_time": "2019-02-26T14:23:32", "url": "https://files.pythonhosted.org/packages/4c/7c/67ce41a8040f6f3de221c35b8763f6d196fc8f050f19405e58e79e9b1c3e/dltn_checker-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "329b31e3271898ac134f28cf315c4722", "sha256": "2151796d8aca7dd9ad5ad5f6f5de40d537e0652e62611c104ca6c90599e5dcea" }, "downloads": -1, "filename": "dltn_checker-0.0.2.tar.gz", "has_sig": false, "md5_digest": "329b31e3271898ac134f28cf315c4722", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5438, "upload_time": "2019-02-26T14:23:33", "url": "https://files.pythonhosted.org/packages/7a/7c/252f4142acc4b4c21ca60f8cf30fe2a3c94759d4fea8e3a6149f5e9402b7/dltn_checker-0.0.2.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "b908383ec7683c3160c391d38802ad2f", "sha256": "bab11e305c1333dd4d665caf80c6dfae80fae8b15075325209c83f7c30ab9610" }, "downloads": -1, "filename": "dltn_checker-0.0.2-py3-none-any.whl", "has_sig": false, "md5_digest": "b908383ec7683c3160c391d38802ad2f", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 9149, "upload_time": "2019-02-26T14:23:32", "url": "https://files.pythonhosted.org/packages/4c/7c/67ce41a8040f6f3de221c35b8763f6d196fc8f050f19405e58e79e9b1c3e/dltn_checker-0.0.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "329b31e3271898ac134f28cf315c4722", "sha256": "2151796d8aca7dd9ad5ad5f6f5de40d537e0652e62611c104ca6c90599e5dcea" }, "downloads": -1, "filename": "dltn_checker-0.0.2.tar.gz", "has_sig": false, "md5_digest": "329b31e3271898ac134f28cf315c4722", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5438, "upload_time": "2019-02-26T14:23:33", "url": "https://files.pythonhosted.org/packages/7a/7c/252f4142acc4b4c21ca60f8cf30fe2a3c94759d4fea8e3a6149f5e9402b7/dltn_checker-0.0.2.tar.gz" } ] }