{ "info": { "author": "Jeremy Bowers", "author_email": "jeremy.bowers@nytimes.com", "bugtrack_url": null, "classifiers": [], "description": "NYT PRB Scraper\n===============\n\n>From `their website `__: \"The Periodic Review\nSecretariat (PRS) develops and administers the periodic review process\nfor eligible Guantanamo Bay detainees, including provision of personal\nrepresentatives to detainees.\"\n\nUsage\n-----\n\nThe PRB engages in three different forms of review for a Guantanamo\ndetainee\"s documents: An initial review, a file review and a full\nreview. Technically, a fourth type, the subsequent full review, is\navailable. To date, no subsequent full reviews have been posted.\n\nInitial review\n~~~~~~~~~~~~~~\n\n.. code:: bash\n\n initial_review --csv > initial_review.csv\n initial_review --json > initial_review.json\n initial_review --tsv > initial_review.tsv\n\nFile review\n~~~~~~~~~~~\n\n.. code:: bash\n\n file_review --csv > file_review.csv\n file_review --json > file_review.json\n file_review --tsv > file_review.tsv\n\nFull review\n~~~~~~~~~~~\n\n.. code:: bash\n\n full_review --csv > full_review.csv\n full_review --json > full_review.json\n full_review --tsv > full_review.tsv\n\nSchema\n------\n\nReturns a row or an object for every document. Each document contains\nthe document-specific fields like ``type_name``, ``type_id``, and\n``url`` as well as the detainee-specific fields like ``name`` and\n``isn``. Builds a unique id for each document from\n``isn-type_id-hearing_or_review_date``.\n\n.. code:: json\n\n [\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"1\",\n \"url\":\"http:\\/\\/www.prs.mil\\/Portals\\/60\\/Documents\\/ISN037\\/141105_U_ISN037_GOVERNMENT'S_UNCLASSIFIED_SUMMARY_PUBLIC.pdf\",\n \"type_name\":\"Government's Unclassified Summary\",\n \"id\":\"037-initial-review-1-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n },\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"2\",\n \"url\":\"http:\\/\\/www.prs.mil\\/Portals\\/60\\/Documents\\/ISN037\\/141105_U_ISN037_PR_STATEMENT_PRB.pdf\",\n \"type_name\":\"Opening Statements of Detainee's Representatives\",\n \"id\":\"037-initial-review-2-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n },\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"3\",\n \"url\":\"http:\\/\\/www.prs.mil\\/Portals\\/60\\/Documents\\/ISN037\\/141216_U_ISN037_DETAINEE_WRITTEN_SUBMISSION_PUBLIC.pdf\",\n \"type_name\":\"Detainee's Written Submission\",\n \"id\":\"037-initial-review-3-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n },\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"4\",\n \"url\":\"http:\\/\\/www.prs.mil\\/LinkClick.aspx?fileticket=RFOMdQD69k4%3d&tabid=8447&portalid=60&mid=20067\",\n \"type_name\":\"Transcript of Public Session\",\n \"id\":\"037-initial-review-4-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n },\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"5\",\n \"url\":\"http:\\/\\/www.prs.mil\\/Portals\\/60\\/Documents\\/ISN037\\/141105_U_ISN037_TRANSCRIPT_OF_DETAINEE_SESSION_PUBLIC.pdf\",\n \"type_name\":\"Transcript of Detainee Session\",\n \"id\":\"037-initial-review-5-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n },\n {\n \"review_type\": \"full-review\",\n \"review_url\": \"http://www.prs.mil/Review-Information/Initial-Review/\",\n \"hearing_or_review_date\":\"2014-11-05\",\n \"denial\":null,\n \"name\":\"Abdel Malik Ahmed Abdel Wahab Al Rahabi\",\n \"type_id\":\"6\",\n \"url\":\"http:\\/\\/www.prs.mil\\/LinkClick.aspx?fileticket=s0XT-7qYc94%3d&tabid=8447&portalid=60&mid=20067\",\n \"type_name\":\"Unclassified Summary of Final Determination\",\n \"id\":\"037-initial-review-6-2014-11-05\",\n \"isn\":\"037\",\n \"denied\":false,\n \"notification_date\":\"2014-08-26\",\n \"final_determination_date\":\"2014-12-05\"\n }\n ]\n\nOutput\n------\n\nThe scrapers can return CSV, JSON or TSV. The default if no options are\npassed is CSV.\n\n\n", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/newsdev/nyt-prb-scraper", "keywords": "national security guantanamo bay criminal justice department of defense", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "nyt-prb-scraper", "package_url": "https://pypi.org/project/nyt-prb-scraper/", "platform": "", "project_url": "https://pypi.org/project/nyt-prb-scraper/", "project_urls": { "Homepage": "https://github.com/newsdev/nyt-prb-scraper" }, "release_url": "https://pypi.org/project/nyt-prb-scraper/0.0.10/", "requires_dist": [ "beautifulsoup4", "lxml", "python-dateutil", "requests", "ujson" ], "requires_python": "", "summary": "A client for scraping and parsing the Periodic Review Secretariat's web page for Guananamo detainees.", "version": "0.0.10" }, "last_serial": 3684201, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "faff07f493bbe0fe194830ef46672f57", "sha256": "0f4e56d2af1b6fb7ed470e08dde40fe718c7333d9d30becf2267337edf3c4a12" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.1.tar.gz", "has_sig": false, "md5_digest": "faff07f493bbe0fe194830ef46672f57", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2841, "upload_time": "2016-09-16T01:46:28", "url": "https://files.pythonhosted.org/packages/16/d0/b8c8d1035aa60c849f5542da9de501e4bcfa9236e851b5129816e8283e16/nyt-prb-scraper-0.0.1.tar.gz" } ], "0.0.10": [ { "comment_text": "", "digests": { "md5": "40a3cff8691a78f4dac4e22b491be51b", "sha256": "6dd198d58affd2f198dcc1c7ac472aec4842c8e2462f72b6f4e9b835f455e10f" }, "downloads": -1, "filename": "nyt_prb_scraper-0.0.10-py3-none-any.whl", "has_sig": false, "md5_digest": "40a3cff8691a78f4dac4e22b491be51b", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 6555, "upload_time": "2017-01-20T15:03:05", "url": "https://files.pythonhosted.org/packages/51/dd/61050859fd34ad70f1aaa97bb63c65f8438456839fe1b329d2f49ed496a8/nyt_prb_scraper-0.0.10-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "20dcca0da7e8130872fe7f691581bfcd", "sha256": "94f9dcb065a2b48533bf4846750329e7d08bc4895cb3f4a9856d7c51956c4145" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.10.tar.gz", "has_sig": false, "md5_digest": "20dcca0da7e8130872fe7f691581bfcd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4139, "upload_time": "2017-01-20T15:03:06", "url": "https://files.pythonhosted.org/packages/13/86/de45ddda8e209a1a0924d6b5ab52817df421cae5371620899d4c01e41b4a/nyt-prb-scraper-0.0.10.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "311b00bfc62ecaf292fbb1122d4aa386", "sha256": "9203eba7995b2845c6f00473529ccb00d616f9d977019a7f776b6e6636cbcc72" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.2.tar.gz", "has_sig": false, "md5_digest": "311b00bfc62ecaf292fbb1122d4aa386", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3032, "upload_time": "2016-09-16T01:47:42", "url": "https://files.pythonhosted.org/packages/80/1d/97e2fd2b603d31a2f62ba994c558910f036acdf5836fd140c064c842e73a/nyt-prb-scraper-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "4d38fdb079ecc8fe3a8f8900dd162ad4", "sha256": "0b14f265a14ae4a7130dd426d7e8afcc5e099733a08215498828f3e9dbdbe503" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.3.tar.gz", "has_sig": false, "md5_digest": "4d38fdb079ecc8fe3a8f8900dd162ad4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3056, "upload_time": "2016-09-16T01:49:20", "url": "https://files.pythonhosted.org/packages/33/c8/7add31a29a7ae2491ac1f53128396e3e1db853402b10919914c4e92096d4/nyt-prb-scraper-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "f4ffa360a76461cfbeeefec14029809c", "sha256": "fbdc85f6c6fe5f0c87a85e23181e8a49db51db56bebca56cf1a2e5e90d553df3" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.4.tar.gz", "has_sig": false, "md5_digest": "f4ffa360a76461cfbeeefec14029809c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3054, "upload_time": "2016-09-16T01:50:40", "url": "https://files.pythonhosted.org/packages/13/80/9d7bb67d199a85118aa78ff0c0f769966380b2b8a1e64254d90898ce0d37/nyt-prb-scraper-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "afc643d9fb71373ec4f29b05dbbb4e8a", "sha256": "bbf53c549fda2c40581e299cac3026e9f88cb5ad2c5259b822601ee27f355eec" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.5.tar.gz", "has_sig": false, "md5_digest": "afc643d9fb71373ec4f29b05dbbb4e8a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3055, "upload_time": "2016-09-16T01:52:47", "url": "https://files.pythonhosted.org/packages/e6/ac/08918dce7104ddab6c0b392cfcf0043950ec111ce975c1a0c4c20e197994/nyt-prb-scraper-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "a45d496df19e616eb25a784b6495bfbf", "sha256": "8baf20b4675f38b62f3ca2524ead35098f0da9889de7a9167c6bb20a2be2a4b8" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.6.tar.gz", "has_sig": false, "md5_digest": "a45d496df19e616eb25a784b6495bfbf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3985, "upload_time": "2016-09-19T14:45:10", "url": "https://files.pythonhosted.org/packages/6a/41/1ac88106093ac04df95aa635d57fc1ab8c13835b224ff33559cada0f84f4/nyt-prb-scraper-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "c3cb8a3c68dcf5950731bffefc6ad906", "sha256": "4342b26ca1b0dc09c5bda46edb254fab46b80c857b5d3bba6edbb8bbf3ed487f" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.7.tar.gz", "has_sig": false, "md5_digest": "c3cb8a3c68dcf5950731bffefc6ad906", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4038, "upload_time": "2016-09-19T16:55:47", "url": "https://files.pythonhosted.org/packages/42/9d/1cab0ff1049b0fc54c77ac1a91e1540a3042b6d0e69b822618c1ea6b6eef/nyt-prb-scraper-0.0.7.tar.gz" } ], "0.0.8": [ { "comment_text": "", "digests": { "md5": "4ef573a56657de1b85ec671e06b3b916", "sha256": "d55718737b9d631dcdabd6536485cc1713d7520fcde0fca463a8112618e238ec" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.8.tar.gz", "has_sig": false, "md5_digest": "4ef573a56657de1b85ec671e06b3b916", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4136, "upload_time": "2016-09-22T15:14:59", "url": "https://files.pythonhosted.org/packages/5f/8a/c1d21b38727a4032ac24eb02d08a493b3fff75f25e7d0b34ab5cb7fde87a/nyt-prb-scraper-0.0.8.tar.gz" } ], "0.0.9": [ { "comment_text": "", "digests": { "md5": "dbda771d43d3cc4a4437721a8b8023da", "sha256": "80a90d3fd4bc6725f9a935b3b095b3c8f65c04f14305c172ae916d51bd1f3fb4" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.9.tar.gz", "has_sig": false, "md5_digest": "dbda771d43d3cc4a4437721a8b8023da", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4149, "upload_time": "2016-09-22T15:39:49", "url": "https://files.pythonhosted.org/packages/ae/6f/468867b3840b2546a02dc8c79738599c5060c53a4eb65b08dad115340015/nyt-prb-scraper-0.0.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "40a3cff8691a78f4dac4e22b491be51b", "sha256": "6dd198d58affd2f198dcc1c7ac472aec4842c8e2462f72b6f4e9b835f455e10f" }, "downloads": -1, "filename": "nyt_prb_scraper-0.0.10-py3-none-any.whl", "has_sig": false, "md5_digest": "40a3cff8691a78f4dac4e22b491be51b", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 6555, "upload_time": "2017-01-20T15:03:05", "url": "https://files.pythonhosted.org/packages/51/dd/61050859fd34ad70f1aaa97bb63c65f8438456839fe1b329d2f49ed496a8/nyt_prb_scraper-0.0.10-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "20dcca0da7e8130872fe7f691581bfcd", "sha256": "94f9dcb065a2b48533bf4846750329e7d08bc4895cb3f4a9856d7c51956c4145" }, "downloads": -1, "filename": "nyt-prb-scraper-0.0.10.tar.gz", "has_sig": false, "md5_digest": "20dcca0da7e8130872fe7f691581bfcd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4139, "upload_time": "2017-01-20T15:03:06", "url": "https://files.pythonhosted.org/packages/13/86/de45ddda8e209a1a0924d6b5ab52817df421cae5371620899d4c01e41b4a/nyt-prb-scraper-0.0.10.tar.gz" } ] }