{
    "info": {
        "author": "Rafael Cheng",
        "author_email": "rafaelcheng13@gmail.com",
        "bugtrack_url": null,
        "classifiers": [
            "Intended Audience :: Developers",
            "License :: OSI Approved :: GNU General Public License (GPL)",
            "Operating System :: OS Independent",
            "Programming Language :: Python"
        ],
        "description": "===============\nProxyYourSpider\n===============\n\n.. image:: https://img.shields.io/aur/license/yaourt.svg\n        :target: https://github.com/Rafael-Cheng/ProxyYourSpider/blob/master/LICENSE\n.. image:: https://img.shields.io/badge/python-2.7-green.svg\n        :target: https://github.com/scrapy/scrapy\n.. image:: https://img.shields.io/maintenance/yes/2017.svg\n        :target: https://github.com/Rafael-Cheng/ProxyYourSpider\n\nIntroduction\n------------\n   \nGetting banned by websites can be really annoying. Given that the free proxy ips available on the Interent are generally hard to use. This project aims to provide a library with which spider programmers can easily fake the ip of their spider.\n\nFeatures\n--------\n   \nProxyYourSpider collets proxies from http://proxydb.net/?protocol=http&protocol=https&anonlvl=4. The number of proxies colleted will be determined by the argument user input when launching run.py. All the proxies which are non-anonymous or have a timeout more than 2 seconds will be kicked out.\n\nrun.py keeps alive and updates the proxy pool when the available proxies are less than the given threshold which dramatically enhances the stability of proxy pool.\n\nTo get a proxy, just call method fetchProxy and provide a proxy type and you will get a decent proxy which has been verified before sending to you:)\n\nUsage\n-----\n\nGenerally, you only need to call fetchProxy method to fet a proxy you desire.\n\n.. image:: https://github.com/Rafael-Cheng/ProxyYourSpider/blob/master/usage.gif\n\nHowever, you should bear in mind that run.py should be executed first and keep alive while using ProxyYourSpider.\n\nJust execute run.py like:\n\n.. code-block:: bash \n\n  $ python run.py 20\n\nhere 20 is the number of proxies you need.\n   \n.. image:: https://github.com/Rafael-Cheng/ProxyYourSpider/blob/master/run_launch.png\n\nAnother thing worth mention is that run.py should be KEEP ALIVE while using ProxyYourSpide. It will continuously check whether the available proxies in your proxies pool is sufficient.\n   \n.. image:: https://github.com/Rafael-Cheng/ProxyYourSpider/blob/master/run_update.png\n\nNotice: You also need to keep Redis alive since it is our database on which we store our proxies.\n    \n.. image:: https://github.com/Rafael-Cheng/ProxyYourSpider/blob/master/redis.png\n\nRequirements\n------------\n\n* Python 2.7\n* Redis\n* Requests\n* BeautifulSoup\n* Works on Linux, Mac OSX, Windows, BSD\n\nInstallation\n------------   \n   \n.. code-block:: bash\n  \n  $ git clone https://github.com/Rafael-Cheng/ProxyYourSpider.git\n\nor just download zip.\n\n.. code-block:: bash\n  \n  $ pip install ProxyYourSpider\n\nLicense\n-------\n\nThe license of this project is GPL license.",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "UNKNOWN",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/Rafael-Cheng/ProxyYourSpider",
        "keywords": "python",
        "license": "GPL",
        "maintainer": null,
        "maintainer_email": null,
        "name": "ProxyYourSpider",
        "package_url": "https://pypi.org/project/ProxyYourSpider/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/ProxyYourSpider/",
        "project_urls": {
            "Download": "UNKNOWN",
            "Homepage": "https://github.com/Rafael-Cheng/ProxyYourSpider"
        },
        "release_url": "https://pypi.org/project/ProxyYourSpider/1.0.2/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "Proxy your spider and crawl the galaxy.",
        "version": "1.0.2"
    },
    "last_serial": 2826098,
    "releases": {
        "1.0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "0cd0579b5b1c5bd526e3c6891aef2086",
                    "sha256": "ff5c1429ed6a6f20943c7bf65f19d8be0f9cc507a653a320fc557f2dd82b4437"
                },
                "downloads": -1,
                "filename": "ProxyYourSpider-1.0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "0cd0579b5b1c5bd526e3c6891aef2086",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3709,
                "upload_time": "2017-04-19T12:29:09",
                "url": "https://files.pythonhosted.org/packages/72/d1/879d6124538931001b0815423b1479efccebcd17865b36e618c532557ba5/ProxyYourSpider-1.0.1.tar.gz"
            }
        ],
        "1.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "822a98c5e7de804be7310302936572ab",
                    "sha256": "b7ec92733f746c643499d0ad51195a255396fe4c3be4445babe773ac560881a5"
                },
                "downloads": -1,
                "filename": "ProxyYourSpider-1.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "822a98c5e7de804be7310302936572ab",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3873,
                "upload_time": "2017-04-24T14:22:32",
                "url": "https://files.pythonhosted.org/packages/a2/1b/3e9fb12420bdaecb9c51e7caac727e7ddeed62fe272f5af3daac02a7c83d/ProxyYourSpider-1.0.2.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "822a98c5e7de804be7310302936572ab",
                "sha256": "b7ec92733f746c643499d0ad51195a255396fe4c3be4445babe773ac560881a5"
            },
            "downloads": -1,
            "filename": "ProxyYourSpider-1.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "822a98c5e7de804be7310302936572ab",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 3873,
            "upload_time": "2017-04-24T14:22:32",
            "url": "https://files.pythonhosted.org/packages/a2/1b/3e9fb12420bdaecb9c51e7caac727e7ddeed62fe272f5af3daac02a7c83d/ProxyYourSpider-1.0.2.tar.gz"
        }
    ]
}