{ "info": { "author": "Jason Trigg", "author_email": "jasontrigg0@gmail.com", "bugtrack_url": null, "classifiers": [], "description": "webgrep is a simple tool for scraping websites from the command line\n\nSetup:\n> sudo easy_install webgrep \n\n\n\nExample:\nFinding number of ratings for a book on goodreads\n\nFind the location of the 'Ratings' in the html by using the -g option:\n> webgrep.py -g 'Ratings' -u \"http://www.goodreads.com/book/show/4588.Extremely_Loud_and_Incredibly_Close\"\nmatch,location\n\"267,896 Ratings\",\" 1,3,1,3,5,3,7,1,3,5,14,1,0\"\n\nNow use that location value (\" 1,3,1,3,5,3,7,1,3,5,14,1,0\") as the -l argument to look in the same location on a different page\n> webgrep.py -l \" 1,3,1,3,5,3,7,1,3,5,14,1,0\" -u \"http://www.goodreads.com/book/show/1618.The_Curious_Incident_of_the_Dog_in_the_Night_Time\"\n\"778,683 Ratings\"\n\n\n\n\n\nExample:\nUsing \"-\" in a location value as a wildcard. Want to find all imdb titles on a page\n\n> webgrep.py -g Shawshank -u \"http://www.imdb.com/search/title?num_votes=50000,&release_date=1990,&sort=user_rating,desc&title_type=feature\"\nmatch,location\nThe Shawshank Redemption,\" 1,3,3,1,14,12,3,5,3,5,3,0\"\n\n\n> webgrep.py -g \"The Dark Knight\" -u \"http://www.imdb.com/search/title?num_votes=50000,&release_date=1990,&sort=user_rating,desc&title_type=feature\"\nmatch,location\nThe Dark Knight,\" 1,3,3,1,14,12,3,5,5,5,3,0\"\nThe Dark Knight Rises,\" 1,3,3,1,14,12,3,5,69,5,3,0\"\n\n\n> webgrep.py -l \" 1,3,3,1,14,12,3,5,-,5,3,0\" -u \"http://www.imdb.com/search/title?num_votes=50000,&release_date=1990,&sort=user_rating,desc&title_type=feature\"\nThe Shawshank Redemption\nThe Dark Knight\nSchindler's List\nPulp Fiction\nThe Lord of the Rings: The Return of the King\n...\n\n\n\n\n\n\nCommon errors:\nQuote the -u argument in bash or else '&' may be read as running the process in the background instead of part of the url", "description_content_type": null, "docs_url": null, "download_url": "https://github.com/jasontrigg0/webgrep/tarball/0.0.8", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/jasontrigg0/webgrep", "keywords": null, "license": "UNKNOWN", "maintainer": null, "maintainer_email": null, "name": "webgrep", "package_url": "https://pypi.org/project/webgrep/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/webgrep/", "project_urls": { "Download": "https://github.com/jasontrigg0/webgrep/tarball/0.0.8", "Homepage": "https://github.com/jasontrigg0/webgrep" }, "release_url": "https://pypi.org/project/webgrep/0.0.8/", "requires_dist": null, "requires_python": null, "summary": "Command line website scraper", "version": "0.0.8" }, "last_serial": 2078667, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "466ebe6ab00e7d561ef4454c5738f57a", "sha256": "47d58764c8492df13d0ed0c8cc3378be3f0d5fd6e8f654405a264dc59207e0cb" }, "downloads": -1, "filename": "webgrep-0.0.1.tar.gz", "has_sig": false, "md5_digest": "466ebe6ab00e7d561ef4454c5738f57a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3558, "upload_time": "2015-12-21T04:40:34", "url": "https://files.pythonhosted.org/packages/bd/7b/bd83ce565132d3f98306b8360bc356d444a875f45ccee6acb90654e64990/webgrep-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "d6e15aa80389ceb62323f80a160c55e2", "sha256": "b092b7b7b900f503580fcaf95eca4844dec88044a6c83c09397369f558ff0663" }, "downloads": -1, "filename": "webgrep-0.0.2.tar.gz", "has_sig": false, "md5_digest": "d6e15aa80389ceb62323f80a160c55e2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4006, "upload_time": "2015-12-21T06:08:13", "url": "https://files.pythonhosted.org/packages/55/d0/bd892d42fa4228d38ebec20aab5f503b2d4dd216a82206c1ec2ee2f24b9a/webgrep-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "fa9f76165944dc9cf6b045f23052d6c9", "sha256": "58cf7d62f6608e15e8aaa53a28666bbc1868f3dbbbc82f156ba6158ec9f221ff" }, "downloads": -1, "filename": "webgrep-0.0.3.tar.gz", "has_sig": false, "md5_digest": "fa9f76165944dc9cf6b045f23052d6c9", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4009, "upload_time": "2015-12-21T06:17:26", "url": "https://files.pythonhosted.org/packages/e3/59/d6e9a75c5c638e1ef6f8ee3f4d17a995a20a1f65c7b2fcbc616d3d76cc53/webgrep-0.0.3.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "dbc7dd2c2638f6999655476cfb6433c7", "sha256": "6dcd15ddf3c000cd9630a2e6c82193f0200223a0436187722dab87b2a601b69d" }, "downloads": -1, "filename": "webgrep-0.0.4.tar.gz", "has_sig": false, "md5_digest": "dbc7dd2c2638f6999655476cfb6433c7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4020, "upload_time": "2015-12-21T06:28:58", "url": "https://files.pythonhosted.org/packages/06/06/039621f9075e4e9272208d0e6a8b6113f2cce5c060e873ef02979e610124/webgrep-0.0.4.tar.gz" } ], "0.0.5": [ { "comment_text": "", "digests": { "md5": "9332d7e2e20482ffcce5cd7812928936", "sha256": "70c9563f9841df579e8867fb34b8f822f8eb81270c6b54cab002a1a52c4231d2" }, "downloads": -1, "filename": "webgrep-0.0.5.tar.gz", "has_sig": false, "md5_digest": "9332d7e2e20482ffcce5cd7812928936", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4024, "upload_time": "2015-12-21T06:37:07", "url": "https://files.pythonhosted.org/packages/5d/6b/0ca26d47d74ffcb07b4173b423245346342df12975de1c703719408478c9/webgrep-0.0.5.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "88c0ac0a8c2e6cb53a2c5e831574a260", "sha256": "b9f10b64e6bdaa50ec56c9d26a96c6bff77e63b957f01484abb192cdb2459cdb" }, "downloads": -1, "filename": "webgrep-0.0.6.tar.gz", "has_sig": false, "md5_digest": "88c0ac0a8c2e6cb53a2c5e831574a260", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4049, "upload_time": "2015-12-21T14:29:35", "url": "https://files.pythonhosted.org/packages/ff/49/aacaa2248729b10acd8b58fd1986dc73d567d35a7cee135074c9e130c778/webgrep-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "b110bcaf1d81bb0437f75b32a05a56b3", "sha256": "9250b5905238a005665306cf1ef01a3f9d2b0af818e2add89db25c35dc2ea9a7" }, "downloads": -1, "filename": "webgrep-0.0.7.tar.gz", "has_sig": false, "md5_digest": "b110bcaf1d81bb0437f75b32a05a56b3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4940, "upload_time": "2016-02-13T18:33:13", "url": "https://files.pythonhosted.org/packages/f2/d3/dfbbf2956fb722a4f05051c1cdc4cc2c483a3dc9e89edffcfe1e5cd906b5/webgrep-0.0.7.tar.gz" } ], "0.0.8": [ { "comment_text": "", "digests": { "md5": "19eacc128696f60fda0e667fa50ed208", "sha256": "bbc44bd65fbad28bae75e169850c56a9d508f14f53b7100532ba603f0cb5d691" }, "downloads": -1, "filename": "webgrep-0.0.8.tar.gz", "has_sig": false, "md5_digest": "19eacc128696f60fda0e667fa50ed208", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7627, "upload_time": "2016-04-22T16:58:46", "url": "https://files.pythonhosted.org/packages/69/f3/65832aeb8d64d18a9d4bb7e62c05a9d3a9639fbd9b1307f52b732223573e/webgrep-0.0.8.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "19eacc128696f60fda0e667fa50ed208", "sha256": "bbc44bd65fbad28bae75e169850c56a9d508f14f53b7100532ba603f0cb5d691" }, "downloads": -1, "filename": "webgrep-0.0.8.tar.gz", "has_sig": false, "md5_digest": "19eacc128696f60fda0e667fa50ed208", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7627, "upload_time": "2016-04-22T16:58:46", "url": "https://files.pythonhosted.org/packages/69/f3/65832aeb8d64d18a9d4bb7e62c05a9d3a9639fbd9b1307f52b732223573e/webgrep-0.0.8.tar.gz" } ] }