{
    "info": {
        "author": "Windfarer",
        "author_email": "windfarer@gmail.com",
        "bugtrack_url": null,
        "classifiers": [],
        "description": "# py-mysql-elasticsearch-sync\nSimple and fast MySQL to Elasticsearch sync tool, written in Python.\n\n[\u4e2d\u6587\u6587\u6863](https://github.com/zhongbiaodev/py-mysql-elasticsearch-sync/blob/master/README_CN.md)\n\n## Introduction\nThis tool helps you to initialize MySQL dump table to Elasticsearch by parsing mysqldump, then incremental sync MySQL table to Elasticsearch by processing MySQL Binlog.\nAlso, during the binlog syncing, this tool will save the binlog sync position, so that it is easy to recover after this tool being shutdown for any reason.\n\n## Installation\nBy following these steps.\n\n##### 1. ibxml2 and libxslt\nThis tool depends on python lxml package, so that you should install  the lxml's dependecies correctly, the libxml2 and libxslt are required.\n\nFor example, in CentOS:\n\n```\nsudo yum install libxml2 libxml2-devel libxslt libxslt-devel\n```\n\nOr in Debian/Ubuntu:\n\n```\nsudo apt-get install libxml2-dev libxslt-dev python-dev\n```\n\nSee [lxml Installation](http://lxml.de/installation.html) for more infomation.\n##### 2. mysqldump\nAnd then, mysqldump is required in the machine where this tool will be run on it.(and the mysql server must enable binlog)\n\n\n##### 3. this tool\nThen install this tool\n\n```\npip install py-mysql-elasticsearch-sync\n```\n\n## Configuration\nThere is a [sample config](https://github.com/zhongbiaodev/py-mysql-elasticsearch-sync/blob/master/es_sync/sample.yaml) file in repo, you can start by editing it.\n\n## Running\nSimply run command\n\n```\nes-sync path/to/your/config.yaml\n```\nand the tool will dump your data as stream to sync, when dump is over, it will start to sync binlog.\n\nThe latest synced binlog file and position are recorded in your info file which is configured in your config file. You can restart dump step by remove it, or you can change sync position by edit it.\n\nOr if you  but want to load it from your own dumpfile. You should dump your table first as xml format(by adding ```-X```option to your mysqldump command) \n\nthen\n\n```\nes-sync path/to/your/config.yaml --fromfile\n```\nto start sync, when xml sync is over, it will also start binlog sync.\n\n## Deployment\nWe provide an [upstart script]((https://github.com/zhongbiaodev/py-mysql-elasticsearch-sync/blob/master/upstart.conf)) to help you deploy this tool, you can edit it for your own condition, besides, you can deploy it in your own way.\n\n## MultiTable Supporting\nNow Multi-table is supported through setting tables in config file, the first table is master as default and the others are slave.\n\nMaster table and slave tables must use the same primary key, which is defined via _id.\n\nTable has higher priority than tables.\n\n## TODO\n- [ ] MultiIndex Supporting\n",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "UNKNOWN",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/zhongbiaodev/py-mysql-elasticsearch-sync",
        "keywords": null,
        "license": "MIT",
        "maintainer": null,
        "maintainer_email": null,
        "name": "py-mysql-elasticsearch-sync",
        "package_url": "https://pypi.org/project/py-mysql-elasticsearch-sync/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/py-mysql-elasticsearch-sync/",
        "project_urls": {
            "Download": "UNKNOWN",
            "Homepage": "https://github.com/zhongbiaodev/py-mysql-elasticsearch-sync"
        },
        "release_url": "https://pypi.org/project/py-mysql-elasticsearch-sync/0.4.2/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "MySQL to Elasticsearch sync tool",
        "version": "0.4.2"
    },
    "last_serial": 2678086,
    "releases": {
        "0.2.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "ebe524a047e5437892f8506e1815e9b3",
                    "sha256": "0d0f42a5efb9b16fee4828b01d0dac40a5e7dbeabeb2e46535c48ccaa8d90412"
                },
                "downloads": -1,
                "filename": "py_mysql_elasticsearch_sync-0.2.1-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "ebe524a047e5437892f8506e1815e9b3",
                "packagetype": "bdist_wheel",
                "python_version": "3.5",
                "requires_python": null,
                "size": 7310,
                "upload_time": "2016-01-04T05:53:02",
                "url": "https://files.pythonhosted.org/packages/27/1c/c184b166ad0354686470e1cd3c379667a497d91f0d2cf38969b9b777b963/py_mysql_elasticsearch_sync-0.2.1-py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "58d4f4b7905ba6b6a8cd6f25a5dbb1d6",
                    "sha256": "c886c3c8ed2cd47f8846153a0b2e25eb72a900093d2d39dde058a3fba146f723"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.2.1.tar.gz",
                "has_sig": false,
                "md5_digest": "58d4f4b7905ba6b6a8cd6f25a5dbb1d6",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 7213,
                "upload_time": "2016-01-04T03:57:09",
                "url": "https://files.pythonhosted.org/packages/b3/9a/ceeb0f2f99647c670ab26225de13492fa4f6bee315220819aa4a274e038a/py-mysql-elasticsearch-sync-0.2.1.tar.gz"
            }
        ],
        "0.3.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "4c77aa1fcdcd6d4a570e58d65b6ed0b1",
                    "sha256": "83fc1965bd02e55ddbbc8e2b33f8f2aff1f6c034bfa34f08e9eaee33b5d1f211"
                },
                "downloads": -1,
                "filename": "py_mysql_elasticsearch_sync-0.3.0-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "4c77aa1fcdcd6d4a570e58d65b6ed0b1",
                "packagetype": "bdist_wheel",
                "python_version": "2.7",
                "requires_python": null,
                "size": 7550,
                "upload_time": "2016-01-05T04:54:47",
                "url": "https://files.pythonhosted.org/packages/1b/b4/14cf7b7330e960b28c89a8619e43c2ac60f8dbd415f132b889face4e53b4/py_mysql_elasticsearch_sync-0.3.0-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "2ac412df604fdfa7a7904e31636afe5b",
                    "sha256": "ebd8dfc7377f8fb3c96a5027c66e3358f9d8c5f310b5629fba76c55f6c3cf9a7"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.3.0.tar.gz",
                "has_sig": false,
                "md5_digest": "2ac412df604fdfa7a7904e31636afe5b",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 7400,
                "upload_time": "2016-01-05T04:54:26",
                "url": "https://files.pythonhosted.org/packages/ed/c1/1a533b659548f9c8133b2b8358acfefdc6b8ae7b976ec69d72e1c08ee51d/py-mysql-elasticsearch-sync-0.3.0.tar.gz"
            }
        ],
        "0.3.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "faf144d93d3f82c8bd087386a2dfea85",
                    "sha256": "59736a4ff7bd44dc50d4f78bd61fdc672c0eb953809be7d9f0b9ae9977c18042"
                },
                "downloads": -1,
                "filename": "py_mysql_elasticsearch_sync-0.3.2-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "faf144d93d3f82c8bd087386a2dfea85",
                "packagetype": "bdist_wheel",
                "python_version": "2.7",
                "requires_python": null,
                "size": 7564,
                "upload_time": "2016-01-05T09:22:55",
                "url": "https://files.pythonhosted.org/packages/9c/04/5d191c2423265a22e691144bdd5d8bdd7f2485b73855ff7d1d292efd833f/py_mysql_elasticsearch_sync-0.3.2-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "8e0d6126adadad61b5a0618533971a56",
                    "sha256": "75e30f637b5b77ea24ae9759a03610dff9557ebafb1e569b5a40340f398cd162"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.3.2.tar.gz",
                "has_sig": false,
                "md5_digest": "8e0d6126adadad61b5a0618533971a56",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 7331,
                "upload_time": "2016-01-05T09:22:16",
                "url": "https://files.pythonhosted.org/packages/ba/6a/c5bbdec5d90273bfde4c6d15453e83876e30b11dd4ec3511934ba564c291/py-mysql-elasticsearch-sync-0.3.2.tar.gz"
            }
        ],
        "0.3.3": [],
        "0.3.3.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "0b88f54799e02ec0875b7708ef816455",
                    "sha256": "e603da15a0f05db64f549ac20e0599138857b5f852538583f12cc63b0445fd7d"
                },
                "downloads": -1,
                "filename": "py_mysql_elasticsearch_sync-0.3.3.1-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "0b88f54799e02ec0875b7708ef816455",
                "packagetype": "bdist_wheel",
                "python_version": "2.7",
                "requires_python": null,
                "size": 7814,
                "upload_time": "2016-01-12T08:18:27",
                "url": "https://files.pythonhosted.org/packages/e0/ca/d4d58828b698eb1bbf65352c05a2ff07a5af9ccaa7e1973aa9bc083b78b6/py_mysql_elasticsearch_sync-0.3.3.1-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "91ac5d579ec7c9c56e7a49b310529bde",
                    "sha256": "8a23474f728bf20a83a6516f1522a3b861b7e14400d15ab90ce6c888c07ba9b4"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.3.3.1.tar.gz",
                "has_sig": false,
                "md5_digest": "91ac5d579ec7c9c56e7a49b310529bde",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 7548,
                "upload_time": "2016-01-12T08:17:48",
                "url": "https://files.pythonhosted.org/packages/c5/f4/6ec932aac0ab71839389bf0d5c66a68bc35d0d82ffe1aed3804a589d8492/py-mysql-elasticsearch-sync-0.3.3.1.tar.gz"
            }
        ],
        "0.3.3.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "a8b4f98c128a20f427764b33dd35bfb2",
                    "sha256": "d5e65118b2ba0822412e8357477bb47327a028a607d880e7a2db913b23fb4841"
                },
                "downloads": -1,
                "filename": "py_mysql_elasticsearch_sync-0.3.3.2-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "a8b4f98c128a20f427764b33dd35bfb2",
                "packagetype": "bdist_wheel",
                "python_version": "2.7",
                "requires_python": null,
                "size": 12274,
                "upload_time": "2016-01-20T07:38:53",
                "url": "https://files.pythonhosted.org/packages/a4/ab/2e511e4568fcf6eb2cf566c4e1463ecb2601348cf354480e20191683a818/py_mysql_elasticsearch_sync-0.3.3.2-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "a3e12f3d88167db51e8eed30ef9af485",
                    "sha256": "01aa36bf8983b3e6ab6636fd9ed436b353bcedca46b94393219a6f92af543672"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.3.3.2.tar.gz",
                "has_sig": false,
                "md5_digest": "a3e12f3d88167db51e8eed30ef9af485",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 11369,
                "upload_time": "2016-01-20T07:38:46",
                "url": "https://files.pythonhosted.org/packages/19/0f/c3f268dc42904199b1da1e4622273f61d3fc52a37f7a712b59a758400951/py-mysql-elasticsearch-sync-0.3.3.2.tar.gz"
            }
        ],
        "0.3.4.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "3c3d78a4d5f1826114031ec5deab74b7",
                    "sha256": "fa12ff4a1730968b0d64d81bf53a8ba86c064f0e4d0d26c288f7964a368d81da"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.3.4.1.tar.gz",
                "has_sig": false,
                "md5_digest": "3c3d78a4d5f1826114031ec5deab74b7",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 11443,
                "upload_time": "2016-03-15T07:17:31",
                "url": "https://files.pythonhosted.org/packages/6c/af/16c159f2511ddc30bc990db9b8ce7e11b61ba2c787bc0053369e1448a79a/py-mysql-elasticsearch-sync-0.3.4.1.tar.gz"
            }
        ],
        "0.4.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "861f7c05a4723253841fa679ba4411c6",
                    "sha256": "d91b6c5dafb41988b2f09d4b348093a0b6b876b3a55bd138837e72cf869c3575"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.4.0.tar.gz",
                "has_sig": false,
                "md5_digest": "861f7c05a4723253841fa679ba4411c6",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 11995,
                "upload_time": "2016-07-15T08:02:50",
                "url": "https://files.pythonhosted.org/packages/71/6f/b6d5ba940ae2b654376ef4f0ff81b71aac4ba6361331331935113f43e772/py-mysql-elasticsearch-sync-0.4.0.tar.gz"
            }
        ],
        "0.4.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "8457d67d216af3e7583d2f78158d0100",
                    "sha256": "7ab29e282ad0929922cad0464729ac0a52183acb7833a07efd77ef806dd69eaa"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.4.1.tar.gz",
                "has_sig": false,
                "md5_digest": "8457d67d216af3e7583d2f78158d0100",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12036,
                "upload_time": "2016-11-15T08:20:36",
                "url": "https://files.pythonhosted.org/packages/a2/12/2b768a41e713944f47b3acf3bcd59bc380589b6e56a557821641925e226a/py-mysql-elasticsearch-sync-0.4.1.tar.gz"
            }
        ],
        "0.4.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "74955118aa0ba2aeea873a9bfc536c96",
                    "sha256": "b4911b350588621158f9c40e22ee557ea93dcf3662f8c1c14bd8eea53bc5bcde"
                },
                "downloads": -1,
                "filename": "py-mysql-elasticsearch-sync-0.4.2.tar.gz",
                "has_sig": false,
                "md5_digest": "74955118aa0ba2aeea873a9bfc536c96",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 12130,
                "upload_time": "2017-03-02T12:49:37",
                "url": "https://files.pythonhosted.org/packages/8d/6b/4807df5e331c61bd75a7dad4277f227957488a8771c5275f6fcbe2c23293/py-mysql-elasticsearch-sync-0.4.2.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "74955118aa0ba2aeea873a9bfc536c96",
                "sha256": "b4911b350588621158f9c40e22ee557ea93dcf3662f8c1c14bd8eea53bc5bcde"
            },
            "downloads": -1,
            "filename": "py-mysql-elasticsearch-sync-0.4.2.tar.gz",
            "has_sig": false,
            "md5_digest": "74955118aa0ba2aeea873a9bfc536c96",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 12130,
            "upload_time": "2017-03-02T12:49:37",
            "url": "https://files.pythonhosted.org/packages/8d/6b/4807df5e331c61bd75a7dad4277f227957488a8771c5275f6fcbe2c23293/py-mysql-elasticsearch-sync-0.4.2.tar.gz"
        }
    ]
}