{
    "info": {
        "author": "tylderen",
        "author_email": "tylderen@gmail.com",
        "bugtrack_url": null,
        "classifiers": [],
        "description": ".. fulmar documentation master file, created by\n   sphinx-quickstart on Tue Aug  2 14:19:45 2016.\n   You can adapt this file completely to your liking, but it should at least\n   contain the root `toctree` directive.\n\nfulmar\n=======\n\nFulmar is a distributed crawler system. By using non-blocking network I/O,\nFulmar can handle hundreds of open connections at the same time. You can\nextractthe data you need from websites. In a fast, simple, yet extensible way.\n\n\nQuick links\n^^^^^^^^^^^\n\n* `Source (github) <https://github.com/tylderen/fulmar>`_\n* `Wiki <https://github.com/tylderen/fulmar/wiki/Links>`_\n\nCode example\n^^^^^^^^^^^^\n\nHere is a simple example::\n\n   import logging\n\n   from fulmar.base_spider import BaseSpider\n\n   logger = logging.getLogger(__name__)\n\n   class Handler(BaseSpider):\n      def on_start(self):\n         self.crawl('http://www.baidu.com/', callback=self.detail_page)\n\n      def detail_page(self, response):\n         try:\n            page_lxml = response.page_lxml\n         except Exception as e:\n            logger.error(str(e))\n\n         return {\n            \"url\": response.url,\n            \"title\": page_lxml.xpath('//title/text()')[0]}\n\n\n\nYou can save above code in a new file called `baidu_spider.py` and run in console::\n\n                  fulmar start_project baidu_spider.py\n\nIf you have installed `redis`, you will get::\n\n                  Successfully start the project, project name: \"baidu_spider\".\n\nFinally, start Fulmar::\n\n                  fulmar all\n\nInstallation\n------------\n\n**Automatic installation**::\n\n    pip install fulmar\n\nFulmar is listed in `PyPI <http://pypi.python.org/pypi/fulmar>`_ and\ncan be installed with ``pip`` or ``easy_install``.  Note that the\nsource distribution includes demo applications that are not present\nwhen Tornado is installed in this way, so you may wish to download a\ncopy of the source tarball as well.\n\n**Manual installation**: Download tarball, then:\n\n.. parsed-literal::\n\n    tar xvzf fulmar-|version|.tar.gz\n    cd fulmar-|version|\n    python setup.py build\n    sudo python setup.py install\n\nThe Fulmar source code is `hosted on GitHub\n<https://github.com/tylderen/fulmar>`_.\n\n**Prerequisites**: Fulmar runs on Python 2.7, and 3.3+\nFor Python 2, version 2.7.9 or newer is *strongly*\nrecommended for the improved SSL support.\n\nDocumentation\n-------------\n\nThis documentation is also available in `PDF and Epub formats\n<https://readthedocs.org/projects/fulmar/downloads/>`_.\n\n.. toctree::\n   :maxdepth: 2\n\n   quick\n\n\n\n* :ref:`genindex`\n* :ref:`modindex`\n* :ref:`search`",
        "description_content_type": null,
        "docs_url": null,
        "download_url": null,
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/tylderen/fulmar",
        "keywords": "crawler,framework",
        "license": "UNKNOWN",
        "maintainer": null,
        "maintainer_email": null,
        "name": "fulmar",
        "package_url": "https://pypi.org/project/fulmar/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/fulmar/",
        "project_urls": {
            "Homepage": "https://github.com/tylderen/fulmar"
        },
        "release_url": "https://pypi.org/project/fulmar/0.0.2/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "A Distributed Web Crawler System in Python",
        "version": "0.0.2"
    },
    "last_serial": 2300369,
    "releases": {
        "0.0.1": [],
        "0.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "107e4001c57be32bfbc5731f98e32745",
                    "sha256": "80dace62bad7288902c787e115fe9e95d907aa10342d92a778c4fe4c71059ad8"
                },
                "downloads": -1,
                "filename": "fulmar-0.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "107e4001c57be32bfbc5731f98e32745",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 27048,
                "upload_time": "2016-08-24T06:09:19",
                "url": "https://files.pythonhosted.org/packages/7a/94/28ea0d94f26c28113bcd87815a4c1f707ce4cacc3fd725856812ed1a35bf/fulmar-0.0.2.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "107e4001c57be32bfbc5731f98e32745",
                "sha256": "80dace62bad7288902c787e115fe9e95d907aa10342d92a778c4fe4c71059ad8"
            },
            "downloads": -1,
            "filename": "fulmar-0.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "107e4001c57be32bfbc5731f98e32745",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 27048,
            "upload_time": "2016-08-24T06:09:19",
            "url": "https://files.pythonhosted.org/packages/7a/94/28ea0d94f26c28113bcd87815a4c1f707ce4cacc3fd725856812ed1a35bf/fulmar-0.0.2.tar.gz"
        }
    ]
}