{ "info": { "author": "Jeremy Storer", "author_email": "storerjeremy@gmail.com", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3" ], "description": "# Python Proxy Utils\n\nA set of python 3 utils to help with web scraping. Currently only a free\nproxy utility is implemented. It can be used as a proxy rotator or however\nyou like.\n\n## Install\n\n```bash\npip install python-proxy-utils\n```\n\n## ProxyHelper Example Usage\n\nWhen the class is initialised it scrapes a list of free proxies from a\nnumber of free proxy list websites concurrently using aiohttp.\n\n\n```python\n>>> from proxy_utils import ProxyHelper\n>>> p = ProxyHelper()\n>>> p.get_count()\n13224\n>>> p.get_random()\n'http://103.9.188.143:56368'\n>>>\n>>> import requests\n>>> random_proxy = p.get_random()\n>>> proxies = {'http': random_proxy, 'https': random_proxy}\n>>> r = requests.get('http://example.com', proxies=proxies)\n```\n\n### Free Proxy Lists Used\n\nThis class currently uses the below free lists. At the time of writing\nthis these lists usually produced around 13,000 proxies.\n\n- proxy-list.download\n- free-proxy-list.net\n\n## Todo\n- Testing\n- Add ProxyHelper method that returns the proxies in the format requests wants it in\n- Add more free proxy lists\n- Add a clean method to the proxy helper to remove bad proxies\n- Add a UserAgentHelper\n\n## Author\nJeremy Storer ", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/storerjeremy/python-proxy-utils", "keywords": "", "license": "", "maintainer": "", "maintainer_email": "", "name": "python-proxy-utils", "package_url": "https://pypi.org/project/python-proxy-utils/", "platform": "", "project_url": "https://pypi.org/project/python-proxy-utils/", "project_urls": { "Homepage": "https://github.com/storerjeremy/python-proxy-utils" }, "release_url": "https://pypi.org/project/python-proxy-utils/0.1.0/", "requires_dist": null, "requires_python": "", "summary": "Python Proxy Utils", "version": "0.1.0" }, "last_serial": 4848242, "releases": { "0.1.0": [ { "comment_text": "", "digests": { "md5": "f429e50f0acdb944eecec8bed14ab9ab", "sha256": "9f77587be6edd6873a77990409dd6f1365fa1be29b5db377f167a6797c65b04d" }, "downloads": -1, "filename": "python-proxy-utils-0.1.0.tar.gz", "has_sig": false, "md5_digest": "f429e50f0acdb944eecec8bed14ab9ab", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3542, "upload_time": "2019-02-21T02:49:53", "url": "https://files.pythonhosted.org/packages/68/97/1a25a4bf108bb0d25a4e07aed6bcf424b087371577158ac7945f7beb7561/python-proxy-utils-0.1.0.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "f429e50f0acdb944eecec8bed14ab9ab", "sha256": "9f77587be6edd6873a77990409dd6f1365fa1be29b5db377f167a6797c65b04d" }, "downloads": -1, "filename": "python-proxy-utils-0.1.0.tar.gz", "has_sig": false, "md5_digest": "f429e50f0acdb944eecec8bed14ab9ab", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3542, "upload_time": "2019-02-21T02:49:53", "url": "https://files.pythonhosted.org/packages/68/97/1a25a4bf108bb0d25a4e07aed6bcf424b087371577158ac7945f7beb7561/python-proxy-utils-0.1.0.tar.gz" } ] }