{ "info": { "author": "Khalid Alharbi", "author_email": "kalharbi@users.noreply.github.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Topic :: Scientific/Engineering :: Information Analysis" ], "description": "# Play Listing Scraper\nScrape and extract apps' listing details information from the Google Play Store.\n\n[![Build Status](https://travis-ci.org/sikuli/sieveable-tools.svg?branch=master)](http://travis-ci.org/sikuli/sieveable-tools) [![PyPI](https://img.shields.io/pypi/v/playlistingscraper.svg)](https://github.com/sikuli/sieveable-tools/tree/master/Play-Listing-Scraper) [![GitHub license](https://img.shields.io/github/license/mashape/apistatus.svg)](https://github.com/sikuli/sieveable-tools)\n\n\n## Installation\n\n### Installing from PyPI\n```\npip install playlistingscraper\n```\n\n### Installing from source\n```\n$ git clone https://github.com/sikuli/sieveable-tools.git\n$ cd Play-Listing-Scraper\n$ sudo python setup.py install\n```\n\n## Usage\n\n```\n$ playlistingscraper --help\nplaylistingscraper [options] packageName-versionCode | google_play_html_page_file\n\nA tool for Scraping an app's listing details data from the Google Play Store\nstore and saving it in a file in JSON format.\n\nOptions:\n --version show program's version number and exit\n -h, --help show this help message and exit\n -o DIR, --out-dir=DIR\n write out file to a target directory. Default is\n current directory\n -l FILE, --log=FILE write logs to FILE.\n -v, --verbose Increase verbosity.\n```\n\n## Example\n```\n$ playlistingscraper com.evernote-4535\n$ ls\ncom.evernote-4534.listing.json\n$ cat com.evernote-4534.listing.json\n{\n \"n\": \"com.evernote\",\n \"verc\": \"4535\",\n \"t\": \"Evernote\",\n \"cadd\": \"305 Walnut Street\\nRedwood City, CA 94063\",\n \"cat\": \"Productivity\",\n \"crat\": \"Everyone\",\n \"crt\": \"Evernote Corporation\",\n \"curl\": \"/store/apps/developer?id=Evernote+Corporation\",\n \"dct\": 100000000,\n \"desc\": \"Evernote is the modern workspace that syncs between all of your devices.\",\n \"dtp\": \"August 30, 2015\",\n \"dtxt\": \"100,000,000 - 500,000,000\",\n \"new\": \"Bug fixes and miscellaneous improvements\",\n \"os\": \"Varies with device\",\n \"pri\": \"Free\",\n \"purl\": \"https://www.google.com/url?q=http://evernote.com/privacy/&sa=D&usg=AFQjCNHTyefT6GQ6A6mnOKPeqKUA_qjesg\",\n \"rate\": 4.6,\n \"rct\": 1305159,\n \"sz\": \"Varies with device\"\n}\n\n```\n\n###Field names symbol table:\nSieveable uses the output of this tool as the listing details data and stores it in a MongoDB collection. \n\nMongoDB stores all field names in every document which consumes disk space; therefore, we should use shorter field names. \nThe following table shows the short field names used in the output JSON file.\n\n|short name | meaning |\n|-----------|---------------------------|\n| n | apk name |\n| t | app title |\n| desc | description |\n| url | play store URL |\n| cat | category |\n| pri | price |\n| dtp | date published |\n| verc | version code |\n| os | operating systems |\n| rct | ratings count |\n| rate | rating |\n| crat | content rating |\n| crt | creator |\n| curl | creator URL |\n| cadd | creator address |\n| sz | install size |\n| sztxt | install size text |\n| dct | downloads count |\n| dtxt | downloads count text |\n| purl | privacy statement url |\n| new | what's new in this version|\n\n\n\n## Disclaimer\n\nThis tool is developed and released here for academic purposes only, and we are not responsible for any damage that could be done with it.\nUse it at your own risk.\n\n## License\nThis tool is licensed under the MIT license.", "description_content_type": null, "docs_url": null, "download_url": null, "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/sikuli/sieveable-tools/tree/master/Play-Listing-Scraper", "keywords": "google,play,scraper,listing,details,apps", "license": null, "maintainer": null, "maintainer_email": null, "name": "playlistingscraper", "package_url": "https://pypi.org/project/playlistingscraper/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/playlistingscraper/", "project_urls": { "Homepage": "https://github.com/sikuli/sieveable-tools/tree/master/Play-Listing-Scraper" }, "release_url": "https://pypi.org/project/playlistingscraper/0.4.6/", "requires_dist": [ "lxml (>=3.4.4)", "requests (>=2.7.0)" ], "requires_python": null, "summary": "A command line tool that scrpaes the listing details of an app in the Google Play Store and saves it in a JSON file.", "version": "0.4.6" }, "last_serial": 1729915, "releases": { "0.4": [ { "comment_text": "", "digests": { "md5": "79e56abc20143d186d83b1805a47576e", "sha256": "8c239a51d5a48371c1e4ce69cf3549a5881c611fcfe0fa7e78daac8d83837523" }, "downloads": -1, "filename": "playlistingscraper-0.4-py2.7.egg", "has_sig": false, "md5_digest": "79e56abc20143d186d83b1805a47576e", "packagetype": "bdist_egg", "python_version": "2.7", "requires_python": null, "size": 10560, "upload_time": "2015-09-08T21:51:08", "url": "https://files.pythonhosted.org/packages/2c/c8/bc0df9d151f9129e961898a0542f7d108c986dc319a7606b3d4f2e81836d/playlistingscraper-0.4-py2.7.egg" }, { "comment_text": "", "digests": { "md5": "20706af741127a82e505313ccd7c7e8a", "sha256": "c0d4d53ceda8eed23a8000374cd63959dbb007bd4214053387cd6bf80ec70202" }, "downloads": -1, "filename": "playlistingscraper-0.4-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "20706af741127a82e505313ccd7c7e8a", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 7565, "upload_time": "2015-09-08T21:51:17", "url": "https://files.pythonhosted.org/packages/3d/42/e5b3dfe60b80a66f402cc5fe24ddd6f0996fe02bb66115f6991369bea7ee/playlistingscraper-0.4-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "b34434becd4a44a8e24d2932ee206a39", "sha256": "f21697674f6dd2b2554c70d6e7d674baefb9c29e846b08b1bf9ec533de1c4d57" }, "downloads": -1, "filename": "playlistingscraper-0.4.tar.gz", "has_sig": false, "md5_digest": "b34434becd4a44a8e24d2932ee206a39", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4757, "upload_time": "2015-09-08T21:51:22", "url": "https://files.pythonhosted.org/packages/31/ac/6d98cd5d7d6790709f7d8c2c07eeca2ce2a0ccd9c75901bedf470d9b4877/playlistingscraper-0.4.tar.gz" } ], "0.4.2": [ { "comment_text": "", "digests": { "md5": "9742ad4d7acacd6e2f3464b82e00ed44", "sha256": "b374278d22037e98c3e0d7adec4bde2aae89c1497763bf00b8eeef786649afe0" }, "downloads": -1, "filename": "playlistingscraper-0.4.2-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "9742ad4d7acacd6e2f3464b82e00ed44", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 7580, "upload_time": "2015-09-09T17:22:37", "url": "https://files.pythonhosted.org/packages/7c/91/ae85ce99119e26288a52540292076a327b27dd019eb7ef01e856ce760eed/playlistingscraper-0.4.2-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "d3ac87eb16b748b456bdf7a940218fb7", "sha256": "a0062d433c54f195578ab64419c871daad6a82a4a83ad2fd4b4084b0468ec36d" }, "downloads": -1, "filename": "playlistingscraper-0.4.2.tar.gz", "has_sig": false, "md5_digest": "d3ac87eb16b748b456bdf7a940218fb7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4745, "upload_time": "2015-09-09T17:22:41", "url": "https://files.pythonhosted.org/packages/c9/79/d55a648ab31461dc1b2e4a8ca0dd224eac29eec2d57ee4265e0719c356ee/playlistingscraper-0.4.2.tar.gz" } ], "0.4.3": [ { "comment_text": "", "digests": { "md5": "46f7c6c8cd7178be82819a10f047a946", "sha256": "957f8ff930164df2c5d231036627b9a92ce292d065213cf8cdaf72a1521aad7e" }, "downloads": -1, "filename": "playlistingscraper-0.4.3-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "46f7c6c8cd7178be82819a10f047a946", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 7597, "upload_time": "2015-09-09T17:51:19", "url": "https://files.pythonhosted.org/packages/f9/58/b04bb0dd53c3b8d7a44125e07bfac04cd2f58b5940337d60f3d87c2fec1d/playlistingscraper-0.4.3-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "8f62aa29d311d990303ae4d09d3fab5d", "sha256": "b11214933cd9ff5ff8426e6c03a56a023cd3ac73b5655889897e3897c528c216" }, "downloads": -1, "filename": "playlistingscraper-0.4.3.tar.gz", "has_sig": false, "md5_digest": "8f62aa29d311d990303ae4d09d3fab5d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4743, "upload_time": "2015-09-09T17:51:25", "url": "https://files.pythonhosted.org/packages/25/d2/4f9e392a0df939de3bd5462c05fec14d4efabe44bbf7a439ba72883014e9/playlistingscraper-0.4.3.tar.gz" } ], "0.4.4": [ { "comment_text": "", "digests": { "md5": "ac7c8595bd2085897b2123b5be4a0dea", "sha256": "e9fb8063259e08c2d323ef5816c283b633d1984b25b3dedd0ca474abc101cace" }, "downloads": -1, "filename": "playlistingscraper-0.4.4-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "ac7c8595bd2085897b2123b5be4a0dea", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 7918, "upload_time": "2015-09-09T19:20:04", "url": "https://files.pythonhosted.org/packages/cc/b4/dea9c71fd992b24a9be458bb24121635df8a8418660cd3d00419b0a71940/playlistingscraper-0.4.4-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "50926c612d2ac6e6ded74a81d36ec41d", "sha256": "c814d87fea59aaf9ade1c1f8c64011ae210ade3934b0b3a9474c5f683d7c0c9f" }, "downloads": -1, "filename": "playlistingscraper-0.4.4.tar.gz", "has_sig": false, "md5_digest": "50926c612d2ac6e6ded74a81d36ec41d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4857, "upload_time": "2015-09-09T19:20:17", "url": "https://files.pythonhosted.org/packages/a3/cd/ac3198c9d641a8b7a177deb6ff299a4ec9a2e156bc0ed7e79e0104ee06ce/playlistingscraper-0.4.4.tar.gz" } ], "0.4.5": [ { "comment_text": "", "digests": { "md5": "3a2ca3b19dfc517683d1f51094119c07", "sha256": "ef4b7b09ac7a9163e8c20c83db2ac6e6e4fbaace1718e911a00954025b8c45b1" }, "downloads": -1, "filename": "playlistingscraper-0.4.5-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "3a2ca3b19dfc517683d1f51094119c07", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 9532, "upload_time": "2015-09-10T03:06:40", "url": "https://files.pythonhosted.org/packages/f8/b4/276072bbcc362b2217ad803b33aa197e96c99f6fb446a3353a074157c8cd/playlistingscraper-0.4.5-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1f37f17e468c959e966ef9635e7d0056", "sha256": "5eaaac8522ad791b13560ed8f6407d6ab5c384c1736ec9770dac706e3e86d2b7" }, "downloads": -1, "filename": "playlistingscraper-0.4.5.tar.gz", "has_sig": false, "md5_digest": "1f37f17e468c959e966ef9635e7d0056", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5710, "upload_time": "2015-09-10T03:06:45", "url": "https://files.pythonhosted.org/packages/b9/ca/5b1aed722b3064c8e6f5dd12bed0e20329dacf15163d5c50223793e7ac8a/playlistingscraper-0.4.5.tar.gz" } ], "0.4.6": [ { "comment_text": "", "digests": { "md5": "e57bab298d7bc9b78dfbbdeb13222fa1", "sha256": "386032562127daad653a0bb7d27997859c151aeb228efa4560b89fe25a40aba3" }, "downloads": -1, "filename": "playlistingscraper-0.4.6-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "e57bab298d7bc9b78dfbbdeb13222fa1", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 9765, "upload_time": "2015-09-20T00:01:14", "url": "https://files.pythonhosted.org/packages/3a/3c/ab1c08b8fa39427398495c4cdb8ba2694e074fb711d451b30db6a7ebc266/playlistingscraper-0.4.6-py2.py3-none-any.whl" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "e57bab298d7bc9b78dfbbdeb13222fa1", "sha256": "386032562127daad653a0bb7d27997859c151aeb228efa4560b89fe25a40aba3" }, "downloads": -1, "filename": "playlistingscraper-0.4.6-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "e57bab298d7bc9b78dfbbdeb13222fa1", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 9765, "upload_time": "2015-09-20T00:01:14", "url": "https://files.pythonhosted.org/packages/3a/3c/ab1c08b8fa39427398495c4cdb8ba2694e074fb711d451b30db6a7ebc266/playlistingscraper-0.4.6-py2.py3-none-any.whl" } ] }