{ "info": { "author": "Caleb Kinney", "author_email": "cakinney@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Operating System :: Microsoft :: Windows", "Operating System :: POSIX", "Operating System :: Unix", "Programming Language :: Python :: 3.7", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy", "Topic :: Utilities" ], "description": "# foot\n\nWeb Crawling Project\n\nFoot is a library that fetches a list of URLs and silly walks through each site to gather information.\n\n## Usage\n### Install \n\n`pip install foot` \n\n#### foot (cli)\n\n- `-u` URL(s) (encapsulated in quotes, separated by commas) \n- `-f` filename (list of urls on new lines)\n\n##### Options (not required)\n\n- `-c` : Specify chunk size (default=10)\n- `--recursive` : Enable one level of recursion \n\n##### Examples:\n\nArray of URLS: \n`foot -u 'http://example.com, http://example1.com'` \n\nArray of URLS with Options: \n`foot 'http://example.com, http://example1.com' -c 5 --recursive` \n\nFile: \n`foot -f 'example.txt`\n\nFile with Options: \n`foot -f 'example.txt' -c 5 --recursive` \n\n## Module\n\nImport: \n`import foot` \n\n\n### Functions\n\nThe `get` function takes an array of URLS and options. \n\n```javascript\nfoot.get([\"http://www.example`.com\", \"http://www.example2.com\"], options);\n => Data output in ./foot/url.json and foot-date.txt\n```\n\nThe `file` function takes a filename and options. \n\n```python\nfoot.file(\"./test.txt\", recursive=True)\n => Data output in ./foot/url.json and foot-date.txt\n```\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/cakinney/foot", "keywords": "crawler,scraping", "license": "MIT license", "maintainer": "", "maintainer_email": "", "name": "foot", "package_url": "https://pypi.org/project/foot/", "platform": "", "project_url": "https://pypi.org/project/foot/", "project_urls": { "Homepage": "https://github.com/cakinney/foot" }, "release_url": "https://pypi.org/project/foot/0.1.0/", "requires_dist": [ "beautifulsoup4 (==4.6.3)", "aiohttp (==3.4.4)" ], "requires_python": "", "summary": "Fetches a list of URLs and silly walks through each site to gather information.", "version": "0.1.0" }, "last_serial": 4516341, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "1d154e5b3b695145304a37fb1a2c69c4", "sha256": "36fc882089f97aab770d87472ae6814ffb30b3092625db20f595fb94db6ad1bf" }, "downloads": -1, "filename": "foot-0.1.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "1d154e5b3b695145304a37fb1a2c69c4", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 4555, "upload_time": "2018-11-22T10:27:16", "url": "https://files.pythonhosted.org/packages/de/bc/f7b849b6113f4fd2b8847c377bd1d6db494be33d61317205f8e7732a39b3/foot-0.1.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "3c4601701578f33f3a4f8ea63a9bcfe8", "sha256": "14a854c995c4895545940646d23e8320824fff0a60f54cd9b48e17b353f5ef20" }, "downloads": -1, "filename": "foot-0.1.0.tar.gz", "has_sig": false, "md5_digest": "3c4601701578f33f3a4f8ea63a9bcfe8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10346, "upload_time": "2018-11-22T10:27:18", "url": "https://files.pythonhosted.org/packages/bb/d8/80a24bc1542f308d77e448578b38954d11e03ec3af8f994fbc924b28503f/foot-0.1.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "1d154e5b3b695145304a37fb1a2c69c4", "sha256": "36fc882089f97aab770d87472ae6814ffb30b3092625db20f595fb94db6ad1bf" }, "downloads": -1, "filename": "foot-0.1.0-py2.py3-none-any.whl", "has_sig": false, "md5_digest": "1d154e5b3b695145304a37fb1a2c69c4", "packagetype": "bdist_wheel", "python_version": "py2.py3", "requires_python": null, "size": 4555, "upload_time": "2018-11-22T10:27:16", "url": "https://files.pythonhosted.org/packages/de/bc/f7b849b6113f4fd2b8847c377bd1d6db494be33d61317205f8e7732a39b3/foot-0.1.0-py2.py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "3c4601701578f33f3a4f8ea63a9bcfe8", "sha256": "14a854c995c4895545940646d23e8320824fff0a60f54cd9b48e17b353f5ef20" }, "downloads": -1, "filename": "foot-0.1.0.tar.gz", "has_sig": false, "md5_digest": "3c4601701578f33f3a4f8ea63a9bcfe8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10346, "upload_time": "2018-11-22T10:27:18", "url": "https://files.pythonhosted.org/packages/bb/d8/80a24bc1542f308d77e448578b38954d11e03ec3af8f994fbc924b28503f/foot-0.1.0.tar.gz" } ] }