{
    "info": {
        "author": "Sergio Arroutbi",
        "author_email": "sarroutbi@yahoo.es",
        "bugtrack_url": null,
        "classifiers": [],
        "description": "1 - INTRODUCTION\n----------------\n  The program \"arsespyder\" is a Web Crawler that enables crawling a URL and inspect the links contained in that web recursively, so that for a provided URL, the crawler downloads the links of type <a href=\"http://whatever\">whatever</a> contained on it. \n  For each of them the operations is repeated, until the level of search provided by parameter is achieved. If not provided, the crawling depth levels is, by default, 3.\n\n2 - APPLICATION USAGE\n---------------------\n  Usage of the application is as follows:\n\n$ ./arsespyder.py --help\nusage: arsespyder.py [-h] [-v] [-n NUMBER_OF_LEVELS] url\n\nInternet Crawler\n\npositional arguments:\n  url                   URL to crawl\n\noptional arguments:\n  -h, --help            show this help message and exit\n  -v, --version         show program's version number and exit\n  -n NUMBER_OF_LEVELS, --number-of-levels NUMBER_OF_LEVELS\n                        Crawling depth\n\nNOTE 1 - The only mandatory parameter is the URL to crawl.\nNOTE 2 - If number of levels is not provided, by default, the NUMBER_OF_LEVELS is 3.\n\n3 - OUTPUT FORMAT\n-----------------\n  arsespyder Web crawler will dump those links up to the depth crawling level specified, in the next format:\n\n$ ./arsespyder.py -n3 http://arsespyder.dyndns.org/index.html\n* http://arsespyder.dyndns.org/test/l1_p1.html\n* http://arsespyder.dyndns.org/test/l1_p2.html\n* http://arsespyder.dyndns.org/test/l1_p3.html\n** http://arsespyder.dyndns.org/test/l2_p1_p1.html\n** http://arsespyder.dyndns.org/test/l2_p1_p2.html\n** http://arsespyder.dyndns.org/test/l2_p2_p1.html\n** http://arsespyder.dyndns.org/test/l2_p2_p2.html\n*** http://arsespyder.dyndns.org/l3_p1_p1_p1.html\n*** http://arsespyder.dyndns.org/l3_p1_p1_p2.html\n*** http://arsespyder.dyndns.org/l3_p1_p1_p3.html\n*** http://arsespyder.dyndns.org/l3_p1_p2_p1.html\n*** http://arsespyder.dyndns.org/l3_p1_p2_p2.html\n*** http://arsespyder.dyndns.org/l3_p1_p2_p3.html\n\nWhere:\n*   http://... are level 1 links (existing in HTML code URL specified parameter)\n**  http://... are level 2 links (existing in HTML code of level 1 links)\n*** http://... are level 3 links (existing in HTML code of level 2 links)\n\n4 - CODE DOCUMENTATION\n----------------------\nCode documentation is contained under \"doc\" folder. Main .html file is pyarsespyder.html:\n\n$ tree doc/\ndoc/\n\u251c\u2500\u2500 pyarsespyder.geturl.html\n\u251c\u2500\u2500 pyarsespyder.html\n\u2514\u2500\u2500 pyarsespyder.validateurl.html\n\n5 - INSTALATION\n---------------\nCheck INSTALL file\n\n",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "http://sarroutbi.dyndns.org/DEVELOPMENT_TOOLS/arsespyder-0.0.3.tar.gz",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/sarroutbi/MSWL_SUBJECTS/tree/master/DEVELOPMENT_TOOLS/arsespyder",
        "keywords": "Web,crawler,links",
        "license": "ISC (Internet Systems Consortium)",
        "maintainer": null,
        "maintainer_email": null,
        "name": "arsespyder",
        "package_url": "https://pypi.org/project/arsespyder/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/arsespyder/",
        "project_urls": {
            "Download": "http://sarroutbi.dyndns.org/DEVELOPMENT_TOOLS/arsespyder-0.0.3.tar.gz",
            "Homepage": "https://github.com/sarroutbi/MSWL_SUBJECTS/tree/master/DEVELOPMENT_TOOLS/arsespyder"
        },
        "release_url": "https://pypi.org/project/arsespyder/0.0.3/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "Web Spider to retrieve links",
        "version": "0.0.3"
    },
    "last_serial": 871278,
    "releases": {
        "0.0.1": [
            {
                "comment_text": "built for Linux-3.2.0-30-generic-pae-i686-with-glibc2.7",
                "digests": {
                    "md5": "3b6ea355f984a194805a9b9302d843ed",
                    "sha256": "139dbda73775a702d36ea7c2c529e18fa0d7d28fe62fdc617aad375a3dfb3d62"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.1.linux-i686.tar.gz",
                "has_sig": false,
                "md5_digest": "3b6ea355f984a194805a9b9302d843ed",
                "packagetype": "bdist_dumb",
                "python_version": "any",
                "requires_python": null,
                "size": 4479,
                "upload_time": "2013-09-22T18:44:32",
                "url": "https://files.pythonhosted.org/packages/39/6b/5f889574a390a68164944bd3d56ac3131e9bf07d23b442b53643e498501c/arsespyder-0.0.1.linux-i686.tar.gz"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "fadaf1cb51baa36dc26ad37961f07f29",
                    "sha256": "ea8732a3c26fd2cf1eddc0078bcda15a0d7179665d698b0c9e9a27eda6f664f2"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "fadaf1cb51baa36dc26ad37961f07f29",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3884,
                "upload_time": "2013-09-22T18:40:45",
                "url": "https://files.pythonhosted.org/packages/3f/69/25ebd3013afefbce930f8b8b02a9f51e0e59b8c160a4dd32af75302dc5cb/arsespyder-0.0.1.tar.gz"
            }
        ],
        "0.0.2": [
            {
                "comment_text": "built for Linux-3.2.0-30-generic-pae-i686-with-glibc2.7",
                "digests": {
                    "md5": "19181707d1f1b88daa70dbd3d4d01c12",
                    "sha256": "fbd7c10c7fcc82b2ebccb84d31a515648286af30af85991249e51e55eba19d7e"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.2.linux-i686.tar.gz",
                "has_sig": false,
                "md5_digest": "19181707d1f1b88daa70dbd3d4d01c12",
                "packagetype": "bdist_dumb",
                "python_version": "any",
                "requires_python": null,
                "size": 4479,
                "upload_time": "2013-09-22T19:03:15",
                "url": "https://files.pythonhosted.org/packages/71/af/14920c341f4ee5e1e04a438ee413401df7e458afb4a9668b94c0e222f62a/arsespyder-0.0.2.linux-i686.tar.gz"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "70cfca695173c9e16b213275dfbe62b4",
                    "sha256": "39ee7dc7da8442e3c167539df90c3a650fff930546c37bf9d5d950fb483e52c3"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "70cfca695173c9e16b213275dfbe62b4",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3879,
                "upload_time": "2013-09-22T19:03:12",
                "url": "https://files.pythonhosted.org/packages/87/16/126bf79d00b2ca079b164af4d35d0e92ef0de29fc84a6bf0c4cb9ee416e3/arsespyder-0.0.2.tar.gz"
            }
        ],
        "0.0.3": [
            {
                "comment_text": "built for Linux-3.2.0-30-generic-pae-i686-with-glibc2.7",
                "digests": {
                    "md5": "f078c8570d418d9ba7062d3df3e5663e",
                    "sha256": "ea199dbfcf29bf4a8cb47cdc9d978ecbd2d2b3c25884ff8a2e4279d4d3e11ed8"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.3.linux-i686.tar.gz",
                "has_sig": false,
                "md5_digest": "f078c8570d418d9ba7062d3df3e5663e",
                "packagetype": "bdist_dumb",
                "python_version": "any",
                "requires_python": null,
                "size": 4483,
                "upload_time": "2013-09-22T19:29:16",
                "url": "https://files.pythonhosted.org/packages/db/37/531bff83dc44607da52963b2aaebeec79116653b6167d94e4320871b81e0/arsespyder-0.0.3.linux-i686.tar.gz"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "7bfbd2e3babd2f727756a60db0c73cf0",
                    "sha256": "0eb350cdfb269ae2fa8194dc670af1c9861c3728e002ad60f4a9ad2925125e47"
                },
                "downloads": -1,
                "filename": "arsespyder-0.0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "7bfbd2e3babd2f727756a60db0c73cf0",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3913,
                "upload_time": "2013-09-22T19:29:13",
                "url": "https://files.pythonhosted.org/packages/dd/b7/886449d124d143ea74ef0a17ac0d2e769f2148aa78add72d5254d9c5fc02/arsespyder-0.0.3.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "built for Linux-3.2.0-30-generic-pae-i686-with-glibc2.7",
            "digests": {
                "md5": "f078c8570d418d9ba7062d3df3e5663e",
                "sha256": "ea199dbfcf29bf4a8cb47cdc9d978ecbd2d2b3c25884ff8a2e4279d4d3e11ed8"
            },
            "downloads": -1,
            "filename": "arsespyder-0.0.3.linux-i686.tar.gz",
            "has_sig": false,
            "md5_digest": "f078c8570d418d9ba7062d3df3e5663e",
            "packagetype": "bdist_dumb",
            "python_version": "any",
            "requires_python": null,
            "size": 4483,
            "upload_time": "2013-09-22T19:29:16",
            "url": "https://files.pythonhosted.org/packages/db/37/531bff83dc44607da52963b2aaebeec79116653b6167d94e4320871b81e0/arsespyder-0.0.3.linux-i686.tar.gz"
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "7bfbd2e3babd2f727756a60db0c73cf0",
                "sha256": "0eb350cdfb269ae2fa8194dc670af1c9861c3728e002ad60f4a9ad2925125e47"
            },
            "downloads": -1,
            "filename": "arsespyder-0.0.3.tar.gz",
            "has_sig": false,
            "md5_digest": "7bfbd2e3babd2f727756a60db0c73cf0",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 3913,
            "upload_time": "2013-09-22T19:29:13",
            "url": "https://files.pythonhosted.org/packages/dd/b7/886449d124d143ea74ef0a17ac0d2e769f2148aa78add72d5254d9c5fc02/arsespyder-0.0.3.tar.gz"
        }
    ]
}