{
    "info": {
        "author": "Ernesto Miguez",
        "author_email": "ernesto.miguez@asquera.de",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 4 - Beta",
            "Environment :: No Input/Output (Daemon)",
            "License :: OSI Approved :: BSD License",
            "Operating System :: OS Independent",
            "Programming Language :: Python"
        ],
        "description": "###scrapy-elasticsearch-extension\n\nA Scrapy Extension with the following functionaltity: \n\n-  to bulk export data to elasticsearch\n-  delete outdated documents\n\n###required modules\n\n[pyes](http://pyes.readthedocs.org/en/latest/)\n\n\n###installation\n\ngeneraly information to be found in the [Scrapy Extensions installation guide](http://doc.scrapy.org/en/latest/topics/extensions.html)\n\nadd the following line to the **EXTENSIONS** setting in your Scrapy settings:\n\n```\n  'scrapyes.Sender' : 1000\n```\n\n###configuration\n\nthe module can be configured per project in your Scrapy settings using the following options:\n\n```\n  ELASTICSEARCH_SERVER = \"localhost\"\n  ELASTICSEARCH_PORT = 9200\n  ELASTICSEARCH_INDEX = \"sixx\"\n  ELASTICSEARCH_TYPE = \"text\"\n  ELASTICSEARCH_BULK_SIZE = 10\n  SCRAPYES_ENABLED = True\n```\n\n### index configuration\n\nthe index used in Elastic Search insertion can be configured per spider [by initializing an attribute on the spider](http://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments), named index, and passing the desired value when the spider\njob is scheduled.\nexample:\n```\n  curl http://192.168.33.10:6800/schedule.json -d project=psd_search_crawler  \\\n  -d spider=sixx_spider \\\n  -d index=my_index\n\n```\nif the index is not configured on the running spider, the crawler settings value for variable **ELASTICSEARCH_INDEX** will be used.\n\nif the item declares an id field, it will be used to update ES\n\n\n### deleting outdated documents\n\nIf the document has been indexed with fiels 'spider_name' and 'last_indexed'\ndocuments indexed before the latest run of the spider \nwill be removed when the spider closes,in case the spider has\nfinished its task\n",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "UNKNOWN",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/Asquera/scrapy-elasticsearch-extension",
        "keywords": "scrapy elastic search",
        "license": "Apache License, Version 2.0",
        "maintainer": null,
        "maintainer_email": null,
        "name": "ScrapyEs",
        "package_url": "https://pypi.org/project/ScrapyEs/",
        "platform": "Any",
        "project_url": "https://pypi.org/project/ScrapyEs/",
        "project_urls": {
            "Download": "UNKNOWN",
            "Homepage": "https://github.com/Asquera/scrapy-elasticsearch-extension"
        },
        "release_url": "https://pypi.org/project/ScrapyEs/0.23/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "An extension module to send data to elasticsearch in bulk format.",
        "version": "0.23"
    },
    "last_serial": 963343,
    "releases": {
        "0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e10611812bc03cd03abef308f2f83a57",
                    "sha256": "4e906f1ad8061db112cc093751457e245e03bc6018d6ccaf237666c0dca32b4b"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "e10611812bc03cd03abef308f2f83a57",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1149,
                "upload_time": "2013-09-09T13:11:12",
                "url": "https://files.pythonhosted.org/packages/f3/ef/2fe5cdc7d6dc8a22c4def70a48ed261826a66433156f1a1f664cac95123f/ScrapyEs-0.1.tar.gz"
            }
        ],
        "0.10": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "ccfe95b9fa72ed12f29647428ce29fe5",
                    "sha256": "a6997627afc165ae7965d632d8a683b4800f2297a6eb2dcd0aa6041dcd3144ec"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.10.tar.gz",
                "has_sig": false,
                "md5_digest": "ccfe95b9fa72ed12f29647428ce29fe5",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1878,
                "upload_time": "2013-10-02T10:16:40",
                "url": "https://files.pythonhosted.org/packages/53/b2/31943873d600c0dfe023cc72d25dd65d6c41d8ee1a883dccb12107127d95/ScrapyEs-0.10.tar.gz"
            }
        ],
        "0.11": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "7675dbb6e83064a25a286c1a720b48f5",
                    "sha256": "ea8416369334d39c67b872a27b3c29940e46fd137a6da8ab9ea8b0b5f72c57c6"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.11.tar.gz",
                "has_sig": false,
                "md5_digest": "7675dbb6e83064a25a286c1a720b48f5",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1878,
                "upload_time": "2013-10-02T10:18:12",
                "url": "https://files.pythonhosted.org/packages/c8/23/285f863ade3e4d7e4997f3f1c9f25871f371e9c1e027f1d0f3388300505b/ScrapyEs-0.11.tar.gz"
            }
        ],
        "0.12": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "42627160c326bd9f784c998755fd37f1",
                    "sha256": "a7abe7eb06dfe7de7c36a9db91e8abb40af7755680dfa8ff3293b830e289c846"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.12.tar.gz",
                "has_sig": false,
                "md5_digest": "42627160c326bd9f784c998755fd37f1",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1935,
                "upload_time": "2013-10-02T12:21:05",
                "url": "https://files.pythonhosted.org/packages/1a/36/d178664c2b3fbf4a632c0e6d3fc2334f05089520daed8f88577510517a2d/ScrapyEs-0.12.tar.gz"
            }
        ],
        "0.13": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f48b8af40d93c43e679de160ffd14f8a",
                    "sha256": "d8892bf1653ba883b94cb52bd3513148d15048455c916eb71943df74f2b5498d"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.13.tar.gz",
                "has_sig": false,
                "md5_digest": "f48b8af40d93c43e679de160ffd14f8a",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1935,
                "upload_time": "2013-10-02T12:28:44",
                "url": "https://files.pythonhosted.org/packages/a7/b3/6eff78cc021795de7fbedb6f7fcd9e80ed14ad13decb6e1d6301c9e07c2b/ScrapyEs-0.13.tar.gz"
            }
        ],
        "0.14": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "cc82f1376587f2e7993a00db51737bbe",
                    "sha256": "6b55f1fa9354fde56505ee2d80f15a20676179c26072cb08a312e27205b667f2"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.14.tar.gz",
                "has_sig": false,
                "md5_digest": "cc82f1376587f2e7993a00db51737bbe",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1945,
                "upload_time": "2013-10-02T13:01:37",
                "url": "https://files.pythonhosted.org/packages/e6/61/bfac0b5e8e26352289fc3f1a7a0bc6ffa0b827605499687542302a629ad1/ScrapyEs-0.14.tar.gz"
            }
        ],
        "0.15": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "7ce0022542a95539654ba55c21cdf675",
                    "sha256": "18d08309daee290ac7df3f29eda2bbba65df75525ed95421a3a9fc5ba67e3a3a"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.15.tar.gz",
                "has_sig": false,
                "md5_digest": "7ce0022542a95539654ba55c21cdf675",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1903,
                "upload_time": "2013-10-02T13:34:09",
                "url": "https://files.pythonhosted.org/packages/b0/bb/a3b960e9107f2bbb672adc369b487e79daf869ebef026b6057267ec945c3/ScrapyEs-0.15.tar.gz"
            }
        ],
        "0.16": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "d4f326480fee0b4f3ea98849199a4550",
                    "sha256": "d301f2fe2f82e2708ee42cc87a20141abaafcb815a90cca12e6a9867bb983d05"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.16.tar.gz",
                "has_sig": false,
                "md5_digest": "d4f326480fee0b4f3ea98849199a4550",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1894,
                "upload_time": "2013-10-02T13:38:04",
                "url": "https://files.pythonhosted.org/packages/66/20/025e0861d0578ca4e9e43be7f61453795eeedd74f33301444d6449340f01/ScrapyEs-0.16.tar.gz"
            }
        ],
        "0.17": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a7a0c443358b476ef1be1fcb8d0e8143",
                    "sha256": "dc8647489e893802e970c99d242dc57cc2d30c84291ae6da85c4ebf34a6acf73"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.17.tar.gz",
                "has_sig": false,
                "md5_digest": "a7a0c443358b476ef1be1fcb8d0e8143",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1851,
                "upload_time": "2013-10-02T13:46:50",
                "url": "https://files.pythonhosted.org/packages/c0/40/8ca96dd5a3c2fed3cf6cf6939c9d66cc7b8e9ca650f7c7057dee4d181a82/ScrapyEs-0.17.tar.gz"
            }
        ],
        "0.18": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f67a418bbcc032ba5add10ce756804f0",
                    "sha256": "517953656e37c1e5bc34737cbfb7044fd94d4879be682911d2beb3ef573d1d50"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.18.tar.gz",
                "has_sig": false,
                "md5_digest": "f67a418bbcc032ba5add10ce756804f0",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2038,
                "upload_time": "2013-10-16T14:34:37",
                "url": "https://files.pythonhosted.org/packages/2e/a6/a1e46b159e3b14ea34a3b736d8551f6834cb5b9839ccb1aeea1f70cfe460/ScrapyEs-0.18.tar.gz"
            }
        ],
        "0.19": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a82c74fece247641c1066fb35efe6fc4",
                    "sha256": "05a0bbd108e29466bdee29a00110ace007720736f4695f159a177c478f59f654"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.19.tar.gz",
                "has_sig": false,
                "md5_digest": "a82c74fece247641c1066fb35efe6fc4",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2028,
                "upload_time": "2013-10-16T15:12:32",
                "url": "https://files.pythonhosted.org/packages/9c/f4/f2916d059a4237029d834a07417ccef64ce183de033d403c17a833c1d92b/ScrapyEs-0.19.tar.gz"
            }
        ],
        "0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "ab38c6f9da9288cb9b740376c22ff65b",
                    "sha256": "899b341a2d2c3899e7490905b0b8dcdcf711917d411128126dfd1ac9c4165c6f"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "ab38c6f9da9288cb9b740376c22ff65b",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1156,
                "upload_time": "2013-09-09T14:30:15",
                "url": "https://files.pythonhosted.org/packages/05/65/4c7c0c44ae8acb5cc0eb58832e9a845223838aaff3c1797c7febc0080ab3/ScrapyEs-0.2.tar.gz"
            }
        ],
        "0.20": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "8000dfb934b4c19eea5c9f4c59d876fa",
                    "sha256": "e00c8b92c5cba52ee9f2ac3d543681b7e83ca7d42929c36cd26ed8ef496a348d"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.20.tar.gz",
                "has_sig": false,
                "md5_digest": "8000dfb934b4c19eea5c9f4c59d876fa",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2080,
                "upload_time": "2013-10-16T15:58:49",
                "url": "https://files.pythonhosted.org/packages/07/d8/285ec856b0001fbfd81fce3989f07a58f7d4fa450d15d0f47636dba468f7/ScrapyEs-0.20.tar.gz"
            }
        ],
        "0.21": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "765ac4ba7109a8a13e41a03af8475711",
                    "sha256": "d6c814059033bba284e0c187b5234581d5a5aa25417d49f5b63ce6363cb77060"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.21.tar.gz",
                "has_sig": false,
                "md5_digest": "765ac4ba7109a8a13e41a03af8475711",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2176,
                "upload_time": "2013-10-17T13:40:27",
                "url": "https://files.pythonhosted.org/packages/e9/3b/36e512e5b868c593a46372b8da4424fafdfaa9a0159a82cfc20fae1d5fda/ScrapyEs-0.21.tar.gz"
            }
        ],
        "0.22": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "7de33fe495dc0a8849634454b485387c",
                    "sha256": "4509ba2d637183df13ec6a3be41194348929888eeae95ec035a61feb312b9b5a"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.22.tar.gz",
                "has_sig": false,
                "md5_digest": "7de33fe495dc0a8849634454b485387c",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2252,
                "upload_time": "2013-10-18T12:44:56",
                "url": "https://files.pythonhosted.org/packages/c6/b5/07ed656dee3f18ebd4e8a41d24caeff50fcb14ead8c3f7b594f9c9696326/ScrapyEs-0.22.tar.gz"
            }
        ],
        "0.23": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "74c60db49fec6ef964f8b962ce672709",
                    "sha256": "38e066ecbe9e498080656c9cc2c1783a5a80b281f28f118645def386fb206f0d"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.23.tar.gz",
                "has_sig": false,
                "md5_digest": "74c60db49fec6ef964f8b962ce672709",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 2433,
                "upload_time": "2013-10-18T13:43:21",
                "url": "https://files.pythonhosted.org/packages/7f/7a/435244f37d42f3b73bcade185292057a1d2c1b220171ebaa8164e41ab2c7/ScrapyEs-0.23.tar.gz"
            }
        ],
        "0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "08dc8c17dfce7828ca8c4d111ef48426",
                    "sha256": "b708d44e4d393b58abe6e902e4cf26a1b31de9bcaacf9cc233217fdcfdc2e055"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "08dc8c17dfce7828ca8c4d111ef48426",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1152,
                "upload_time": "2013-09-09T15:56:08",
                "url": "https://files.pythonhosted.org/packages/79/41/a70ddfc6692b34ff3d518a3c93cceff8c6ae493a8ee4299e8ff178d5443b/ScrapyEs-0.3.tar.gz"
            }
        ],
        "0.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f8d4ff28b09573023df9939913306e25",
                    "sha256": "a48a13e16ae782450838da978e31eb6cf1bbd42d0901f28565142dae85a52eec"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.4.tar.gz",
                "has_sig": false,
                "md5_digest": "f8d4ff28b09573023df9939913306e25",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1162,
                "upload_time": "2013-09-11T14:04:35",
                "url": "https://files.pythonhosted.org/packages/a7/29/64719d443d4e61c2761f55318f07ae1b2d8651b5c6e881db61475d5f1d4b/ScrapyEs-0.4.tar.gz"
            }
        ],
        "0.5": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "d6ae08c6e6b2acfed164c2878c9277f6",
                    "sha256": "6dc0697b7f2f532be4bdd729ebfa6a25c5ac8ae21be2935664a55ce24e657dea"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.5.tar.gz",
                "has_sig": false,
                "md5_digest": "d6ae08c6e6b2acfed164c2878c9277f6",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1195,
                "upload_time": "2013-09-18T10:44:18",
                "url": "https://files.pythonhosted.org/packages/5a/60/594fe52a9192ec33abacad45976612e257b3f2af33e2cb51885f556cc861/ScrapyEs-0.5.tar.gz"
            }
        ],
        "0.6": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "2851236847fc79633e19d64b9f8912a1",
                    "sha256": "c01cb82a09a71d6119394fc63415256bcfdf2f5da2588a18f1464c609a7d1c97"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.6.tar.gz",
                "has_sig": false,
                "md5_digest": "2851236847fc79633e19d64b9f8912a1",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1777,
                "upload_time": "2013-09-18T11:01:34",
                "url": "https://files.pythonhosted.org/packages/9a/ff/ddad7a2fee0bcfb40eebfcac02936b71d1da3fa33e650f3bb026ea0e014a/ScrapyEs-0.6.tar.gz"
            }
        ],
        "0.7": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "0db4a4a9ebb2cb895d349a39fe992f1b",
                    "sha256": "1dc62d31e76eebfdcc588f2b68a09e0a4a7d3fdeb46bf0c2bf5ce2cb280d7dc2"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.7.tar.gz",
                "has_sig": false,
                "md5_digest": "0db4a4a9ebb2cb895d349a39fe992f1b",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1844,
                "upload_time": "2013-09-26T16:31:15",
                "url": "https://files.pythonhosted.org/packages/da/d8/2e323a6dceb8eaa7d9e160254c9a23f7ff1d549883e2a5fa7c8367657afe/ScrapyEs-0.7.tar.gz"
            }
        ],
        "0.8": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "10c1f64458f6200a2319f76da3fdc678",
                    "sha256": "2fe99171bb1b669654c7df02b0b41504aab49c318afb15a51778f7ca554adcfe"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.8.tar.gz",
                "has_sig": false,
                "md5_digest": "10c1f64458f6200a2319f76da3fdc678",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1841,
                "upload_time": "2013-09-26T16:34:21",
                "url": "https://files.pythonhosted.org/packages/1b/38/2491e216b61fcf711517b2e7b06654c020ea9fad3e227072c23c33fb6b15/ScrapyEs-0.8.tar.gz"
            }
        ],
        "0.9": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "e22b3e4a08937ed403bcd3a6d8a67f15",
                    "sha256": "eb3b405e7e212a838bd25da52f432d025d0b2e6b2e2ff06dc389f1f35ea5393a"
                },
                "downloads": -1,
                "filename": "ScrapyEs-0.9.tar.gz",
                "has_sig": false,
                "md5_digest": "e22b3e4a08937ed403bcd3a6d8a67f15",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 1846,
                "upload_time": "2013-09-27T08:13:04",
                "url": "https://files.pythonhosted.org/packages/74/19/c55b5259c42e7d9621fa32c3966eea63afd0d4314224476f2d2e05493d07/ScrapyEs-0.9.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "74c60db49fec6ef964f8b962ce672709",
                "sha256": "38e066ecbe9e498080656c9cc2c1783a5a80b281f28f118645def386fb206f0d"
            },
            "downloads": -1,
            "filename": "ScrapyEs-0.23.tar.gz",
            "has_sig": false,
            "md5_digest": "74c60db49fec6ef964f8b962ce672709",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 2433,
            "upload_time": "2013-10-18T13:43:21",
            "url": "https://files.pythonhosted.org/packages/7f/7a/435244f37d42f3b73bcade185292057a1d2c1b220171ebaa8164e41ab2c7/ScrapyEs-0.23.tar.gz"
        }
    ]
}