{
    "info": {
        "author": "Scrapy developers",
        "author_email": "opensource@scrapinghub.com",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 5 - Production/Stable",
            "License :: OSI Approved :: BSD License",
            "Operating System :: OS Independent",
            "Programming Language :: Python",
            "Programming Language :: Python :: 2",
            "Programming Language :: Python :: 2.7",
            "Programming Language :: Python :: 3",
            "Programming Language :: Python :: 3.4",
            "Programming Language :: Python :: 3.6",
            "Programming Language :: Python :: 3.7"
        ],
        "description": "==================\nscrapy-pagestorage\n==================\n\n.. image:: https://img.shields.io/pypi/v/scrapy-pagestorage.svg\n   :target: https://pypi.python.org/pypi/scrapy-pagestorage\n   :alt: PyPI Version\n\n.. image:: https://travis-ci.org/scrapy-plugins/scrapy-pagestorage.svg?branch=master\n   :target: http://travis-ci.org/scrapy-plugins/scrapy-pagestorage\n   :alt: Build Status\n\nA scrapy extension to store requests and responses information in storage service.\n\nInstallation\n============\n\nYou can install scrapy-pagestorage using pip::\n\n    pip install scrapy-pagestorage\n\nYou can then enable the middleware in your `settings.py`::\n\n    SPIDER_MIDDLEWARES = {\n        ...\n        'scrapy_pagestorage.PageStorageMiddleware': 900\n    }\n\nHow to use it\n=============\n\nEnable extension through `settings.py`::\n\n    PAGE_STORAGE_ENABLED = True\n    PAGE_STORAGE_ON_ERROR_ENABLED = True\n\nConfigure the exension through `settings.py`::\n\n    PAGE_STORAGE_MODE = \"VERSIONED_CACHE\"\n    PAGE_STORAGE_LIMIT = 100\n    PAGE_STORAGE_ON_ERROR_LIMIT = 100\n    PAGE_STORAGE_TRIM_HTML = True\n\nThe extension is auto-enabled for Portia spiders (``SHUB_SPIDER_TYPE=portia``).\n\nSettings\n========\n\nPAGE_STORAGE_MODE\n-----------------\nDefault: ``None``\n\nA string which specifies if the extension will store information using cache store or\nversioned cache store (set `PAGE_STORAGE_MODE=\"VERSIONED_CACHE\"` to use versioned one).\n\nPAGE_STORAGE_LIMIT\n------------------\nAn integer to set a limit of visited pages amount to store.\n\nPAGE_STORAGE_ON_ERROR_LIMIT\n---------------------------\nAn integer to set a limit for page errors amount to store.\n\nPAGE_STORAGE_TRIM_HTML\n----------------------\nDefault: ``False``\n\nRemove whitespace from the start and end of the HTML to reduce file size.\n\n\n",
        "description_content_type": "",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/scrapy-plugins/scrapy-pagestorage",
        "keywords": "",
        "license": "BSD",
        "maintainer": "",
        "maintainer_email": "",
        "name": "scrapy-pagestorage",
        "package_url": "https://pypi.org/project/scrapy-pagestorage/",
        "platform": "Any",
        "project_url": "https://pypi.org/project/scrapy-pagestorage/",
        "project_urls": {
            "Homepage": "https://github.com/scrapy-plugins/scrapy-pagestorage"
        },
        "release_url": "https://pypi.org/project/scrapy-pagestorage/0.3.1/",
        "requires_dist": [
            "Scrapy (>=1.0.3)",
            "scrapinghub (>=1.9.0)",
            "scrapinghub-entrypoint-scrapy (>=0.4)"
        ],
        "requires_python": "",
        "summary": "Scrapy extension to store info in storage service",
        "version": "0.3.1"
    },
    "last_serial": 5982690,
    "releases": {
        "0.0.1": [],
        "0.1.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "9d6cd52aa3c907d516c44522e17f9455",
                    "sha256": "96e2d22272a9eac091787df75e4467f33ff9c1173e1d8feb9444d357edad6919"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.1.0-py2-none-any.whl",
                "has_sig": false,
                "md5_digest": "9d6cd52aa3c907d516c44522e17f9455",
                "packagetype": "bdist_wheel",
                "python_version": "py2",
                "requires_python": null,
                "size": 5240,
                "upload_time": "2016-04-27T05:11:32",
                "url": "https://files.pythonhosted.org/packages/32/fe/7d6eb3ceb7d5637ae363642c534ac2d7669737af24d49b5422ec2063ec6b/scrapy_pagestorage-0.1.0-py2-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "556318b2b231a2e971fdea88ccdc528a",
                    "sha256": "61c7198c4b8218c29c7b1c25ebf20f72f1e34481c964224bf9efcee4b39d1320"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.1.0.tar.gz",
                "has_sig": false,
                "md5_digest": "556318b2b231a2e971fdea88ccdc528a",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3276,
                "upload_time": "2016-04-27T05:11:40",
                "url": "https://files.pythonhosted.org/packages/47/46/fac842975c83473db3f7a7713cedd100f462b95be8efd1f968fec811a20b/scrapy-pagestorage-0.1.0.tar.gz"
            }
        ],
        "0.2.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "8b71ff41252b9583c11ae00bbefb137b",
                    "sha256": "da2bf15b92a70a9f3f9b0a59eabb2a76761e3e85d99d858d6b02bc4d4aa5080b"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.2.0-py2-none-any.whl",
                "has_sig": false,
                "md5_digest": "8b71ff41252b9583c11ae00bbefb137b",
                "packagetype": "bdist_wheel",
                "python_version": "py2",
                "requires_python": null,
                "size": 5236,
                "upload_time": "2017-02-07T13:58:00",
                "url": "https://files.pythonhosted.org/packages/22/79/d5dd5f9764bcd0340531bed900414456fdf63a6239749b84c4e8d3a5aeaa/scrapy_pagestorage-0.2.0-py2-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "0f4eca6b9c47f4a12602fe88be720a56",
                    "sha256": "30c3b2e5e6427c8b08c0feca5795c837167d5d53451027c7ab476bbc6970b3b0"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.2.0.tar.gz",
                "has_sig": false,
                "md5_digest": "0f4eca6b9c47f4a12602fe88be720a56",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3250,
                "upload_time": "2017-02-07T13:58:02",
                "url": "https://files.pythonhosted.org/packages/5e/1d/51e4d111939295f3e2291c7db9982f3395b8a248d8cddb890d6d701bc3f3/scrapy-pagestorage-0.2.0.tar.gz"
            }
        ],
        "0.2.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "d4ebec447e54b34951f605e37ee6cd47",
                    "sha256": "02263dfa54f1a78287c05534f3c5593675d92e54f34403b49573be708ef0e18d"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.2.1-py2-none-any.whl",
                "has_sig": false,
                "md5_digest": "d4ebec447e54b34951f605e37ee6cd47",
                "packagetype": "bdist_wheel",
                "python_version": "py2",
                "requires_python": null,
                "size": 5490,
                "upload_time": "2017-08-16T17:15:40",
                "url": "https://files.pythonhosted.org/packages/ad/d3/71d9d694f97c12175a10a7990b836dba9d42258c5e55226abb414531df58/scrapy_pagestorage-0.2.1-py2-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "709194565ac79d198ff62e6f641f878f",
                    "sha256": "b6958d4831623a2aa8822f3b3b27274a42a158cde6b477608c3687ac4fa75eba"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.2.1.tar.gz",
                "has_sig": false,
                "md5_digest": "709194565ac79d198ff62e6f641f878f",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3451,
                "upload_time": "2017-08-16T17:15:41",
                "url": "https://files.pythonhosted.org/packages/63/8d/8757617b10190b1dc3b7858a08dabe7836f0a403c749112c66e615813fa9/scrapy-pagestorage-0.2.1.tar.gz"
            }
        ],
        "0.2.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "2e8b3a08bcc3cf6b23475e8c05e87403",
                    "sha256": "7011d3fafb9ea4e3bec05113eb07c5ec742d749c001fe396d5ddf359a97c14e7"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.2.2-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "2e8b3a08bcc3cf6b23475e8c05e87403",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": null,
                "size": 4994,
                "upload_time": "2018-10-03T12:09:43",
                "url": "https://files.pythonhosted.org/packages/b8/15/28a19212c68e8d97301a4e49ccf111f20fb163228613b9100a910e54039c/scrapy_pagestorage-0.2.2-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "f9f9fc0597ee4ea3339a73b9a10d3f19",
                    "sha256": "dd307f245f6719c54a496b9b33771a3614e9f9c4473b83b0611df341ee7fe75d"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.2.2.tar.gz",
                "has_sig": false,
                "md5_digest": "f9f9fc0597ee4ea3339a73b9a10d3f19",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3494,
                "upload_time": "2018-10-03T12:09:45",
                "url": "https://files.pythonhosted.org/packages/fc/75/f9d9ae74e785a0adb8286db4f2ef551e351ce9e5d9227904e319cdfba05c/scrapy-pagestorage-0.2.2.tar.gz"
            }
        ],
        "0.3.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a7f0e4523af5823b45c072dd3f96a4f6",
                    "sha256": "68fe66c2153aa9b2c85d0d26a160a91fc491b8bde19fc9568691e1d94e710e70"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.3.0-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "a7f0e4523af5823b45c072dd3f96a4f6",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 5098,
                "upload_time": "2019-08-06T08:19:33",
                "url": "https://files.pythonhosted.org/packages/b1/08/03e35ae0a8fb011cea49a01c9a7ddadf0ac7be45796ece5ba511532d7d1d/scrapy_pagestorage-0.3.0-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "f90a64c0010c7f5c6a51e2c467bf7ba4",
                    "sha256": "b0d2bea7aa056a14b45e5abd450f57ba600864426e145b928776a7a6db10b1cd"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.3.0.tar.gz",
                "has_sig": false,
                "md5_digest": "f90a64c0010c7f5c6a51e2c467bf7ba4",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3648,
                "upload_time": "2019-08-06T08:19:34",
                "url": "https://files.pythonhosted.org/packages/58/ef/5101f39d2e36adbed599960bc1a520691d46c1e4ea470f9185f99b99107d/scrapy-pagestorage-0.3.0.tar.gz"
            }
        ],
        "0.3.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "4eb1386ad448846926e7dda4bcbee474",
                    "sha256": "0b480f9bd77a93eabad25e019070c8202c75e9ecef55ef1c3da2f2897b38e636"
                },
                "downloads": -1,
                "filename": "scrapy_pagestorage-0.3.1-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "4eb1386ad448846926e7dda4bcbee474",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 5111,
                "upload_time": "2019-10-16T11:33:35",
                "url": "https://files.pythonhosted.org/packages/25/35/c3eee9dbf9ae2ee5c856557e9a87cd5437143bef27ec4467802d9f3f1b84/scrapy_pagestorage-0.3.1-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "2412871b09fa528a5ca847d19ccb7cf0",
                    "sha256": "94ea74805dd8121154f72f1cb061983a8f5e74c01f1e24a2d6ee1e4cf9447fc6"
                },
                "downloads": -1,
                "filename": "scrapy-pagestorage-0.3.1.tar.gz",
                "has_sig": false,
                "md5_digest": "2412871b09fa528a5ca847d19ccb7cf0",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3667,
                "upload_time": "2019-10-16T11:33:36",
                "url": "https://files.pythonhosted.org/packages/17/5c/0caccff011ec61ba5ffcf4579acfb8aba2efd9b1b00f10c662b0445984a7/scrapy-pagestorage-0.3.1.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "4eb1386ad448846926e7dda4bcbee474",
                "sha256": "0b480f9bd77a93eabad25e019070c8202c75e9ecef55ef1c3da2f2897b38e636"
            },
            "downloads": -1,
            "filename": "scrapy_pagestorage-0.3.1-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "4eb1386ad448846926e7dda4bcbee474",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": null,
            "size": 5111,
            "upload_time": "2019-10-16T11:33:35",
            "url": "https://files.pythonhosted.org/packages/25/35/c3eee9dbf9ae2ee5c856557e9a87cd5437143bef27ec4467802d9f3f1b84/scrapy_pagestorage-0.3.1-py2.py3-none-any.whl"
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "2412871b09fa528a5ca847d19ccb7cf0",
                "sha256": "94ea74805dd8121154f72f1cb061983a8f5e74c01f1e24a2d6ee1e4cf9447fc6"
            },
            "downloads": -1,
            "filename": "scrapy-pagestorage-0.3.1.tar.gz",
            "has_sig": false,
            "md5_digest": "2412871b09fa528a5ca847d19ccb7cf0",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 3667,
            "upload_time": "2019-10-16T11:33:36",
            "url": "https://files.pythonhosted.org/packages/17/5c/0caccff011ec61ba5ffcf4579acfb8aba2efd9b1b00f10c662b0445984a7/scrapy-pagestorage-0.3.1.tar.gz"
        }
    ]
}