{
"info": {
"author": "Kyle Lahnakoski",
"author_email": "kyle@lahnakoski.com",
"bugtrack_url": null,
"classifiers": [
"Development Status :: 4 - Beta",
"License :: OSI Approved :: Mozilla Public License 2.0 (MPL 2.0)",
"Topic :: Utilities"
],
"description": "Bugzilla-ETL\r\n============\r\n\r\nPython version of Metric's Bugzilla ETL\r\n(https://github.com/mozilla-metrics/bugzilla\\_etl)\r\n\r\nMotivation and Details\r\n----------------------\r\n\r\nhttps://wiki.mozilla.org/Auto-tools/Projects/PublicES\r\n\r\nRequirements\r\n------------\r\n\r\n- PyPy 2.1.0 using Python 2.7 (cPython is way too slow)\r\n- A MySQL/Maria database with Mozilla's Bugzilla schema (`old public\r\n version can be found\r\n here `__)\r\n- A timezone database\r\n (`instructions <./tests/resources/mySQL/README.md>`__)\r\n- An ElasticSearch (v 0.20.5) cluster to hold the bug version documents\r\n\r\nInstallation\r\n------------\r\n\r\nPyPy and SetupTools are required. If you are installing on Windows\r\nplease `follow instructions to get these\r\ninstalled `__.\r\nWhen done, installation is easy:\r\n\r\n::\r\n\r\n pip install Bugzilla-ETL\r\n\r\nSetup\r\n-----\r\n\r\nYou must prepare a ``settings.json`` file to reference the resources,\r\nand it's filename must be provided as an argument in the command line.\r\nExamples of settings files can be found in\r\n`resources/settings `__\r\n\r\nBugzilla-ETL keeps local run state in the form of two files:\r\n``first_run_time`` and ``last_run_time``. These are both parameters in\r\nthe \\`\\`settings.json\\`\\`\\` file.\r\n\r\n- ``first_run_time`` is written only if it does not exist, and triggers\r\n a full ETL refresh. Delete this file if you want to create a new ES\r\n index and start ETL from the beginning.\r\n- ``last_run_time`` is recorded whenever there has been a successful\r\n ETL. This file will not exist until the initial full ETL has\r\n completed successfully. Deleteing this file should have no net\r\n effect, other than making the program work harder then it should.\r\n\r\nRunning bz\\_etl.py\r\n------------------\r\n\r\nAsuming your ``settings.json`` file is in ``~/Bugzilla_ETL``:\r\n\r\n::\r\n\r\n cd ~/Bugzilla_ETL\r\n bzetl --settings=settings.json\r\n\r\nUse ``--help`` for more options, and see `example command line\r\nscript `__\r\n\r\nGot it working?\r\n---------------\r\n\r\nThe initial ETL will take over two hours. If you want something quicker\r\nto confirm your configuration is correct, use ``--reset --quick``\r\narguments on the command line. This will limit ETL to the first 1000,\r\nand last 1000 bugs.\r\n\r\n::\r\n\r\n bzetl --settings=settings.json --reset --quick\r\n\r\nDeveloper Installation\r\n----------------------\r\n\r\nIf you plan to help improve this software, or if you enjoy working from\r\nsource, you can clone from Github:\r\n\r\n::\r\n\r\n git clone https://github.com/klahnakoski/Bugzilla-ETL.git\r\n\r\nInstall requirements:\r\n\r\n::\r\n\r\n pip install -e\r\n\r\nIt is best you install on Linux, but if you do install on Windows you\r\ncan find further Windows-specific Python installation instructions at\r\none of my other projects:\r\nhttps://github.com/klahnakoski/pyLibrary/blob/master/README.md\r\n\r\nRunning Tests\r\n-------------\r\n\r\nThe Git clone will include test code. You can run those tests, but you\r\nmust...\r\n\r\n- Have MySQL installed (no Bugzilla schema required)\r\n- Have timezone database installed\r\n (`instructions <./tests/resources/mySQL/README.md>`__)\r\n- A complete ``test_settings.json`` file to point to the resources\r\n (`example <./resources/settings/test_settings_example.json>`__)\r\n- Use pypy for 4x the speed:\r\n ``pypy .\\tests\\test_etl.py --settings=test_settings.json``\r\n\r\nMore on ElasticSearch\r\n---------------------\r\n\r\nIf you are new to ElasticSearch, I recommend using `ElasticSearch\r\nHead `__ for getting cluster\r\nstatus, current schema definitions, viewing individual records, and\r\nmore. Clone it off of GitHub, and open the ``index.html`` file from in\r\nyour browser. Here are some alternate\r\n`instructions `__.",
"description_content_type": null,
"docs_url": null,
"download_url": "UNKNOWN",
"downloads": {
"last_day": -1,
"last_month": -1,
"last_week": -1
},
"home_page": "https://github.com/klahnakoski/Bugzilla-ETL",
"keywords": null,
"license": "MPL 2.0",
"maintainer": null,
"maintainer_email": null,
"name": "Bugzilla-ETL",
"package_url": "https://pypi.org/project/Bugzilla-ETL/",
"platform": "UNKNOWN",
"project_url": "https://pypi.org/project/Bugzilla-ETL/",
"project_urls": {
"Download": "UNKNOWN",
"Homepage": "https://github.com/klahnakoski/Bugzilla-ETL"
},
"release_url": "https://pypi.org/project/Bugzilla-ETL/0.3.13353/",
"requires_dist": null,
"requires_python": null,
"summary": "Mozilla Bugzilla Bug Version ETL",
"version": "0.3.13353"
},
"last_serial": 948459,
"releases": {
"0.3.13326": [
{
"comment_text": "",
"digests": {
"md5": "554a7c380b11837122ea32ecfc43d37b",
"sha256": "039486ebe76369a9c39bf6a3c2e95ed99b9019664a8e81aceded28d18214e870"
},
"downloads": -1,
"filename": "Bugzilla_ETL-0.3.13326-py2.7.egg",
"has_sig": false,
"md5_digest": "554a7c380b11837122ea32ecfc43d37b",
"packagetype": "bdist_egg",
"python_version": "2.7",
"requires_python": null,
"size": 166477,
"upload_time": "2013-11-22T21:52:16",
"url": "https://files.pythonhosted.org/packages/6e/c3/81ad7429fa00ce51b177e1b144151c4a1e3e8f73994952ca28e0c1f5c0a2/Bugzilla_ETL-0.3.13326-py2.7.egg"
},
{
"comment_text": "",
"digests": {
"md5": "e2aea0ec669d5867097d655182bcc3e0",
"sha256": "358d81092be66f928588b1fec35894cf2f54decb7963fbd3f36c3901a556b5b6"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13326.win32-py2.7.exe",
"has_sig": false,
"md5_digest": "e2aea0ec669d5867097d655182bcc3e0",
"packagetype": "bdist_wininst",
"python_version": "2.7",
"requires_python": null,
"size": 347913,
"upload_time": "2013-11-22T21:52:26",
"url": "https://files.pythonhosted.org/packages/4f/69/1c769be86939131dd006f0567eb77bfad2e5b7cb67aae2ac5afa54d0155b/Bugzilla-ETL-0.3.13326.win32-py2.7.exe"
},
{
"comment_text": "",
"digests": {
"md5": "ffea19a1f98444ed91f7068d7d0466c9",
"sha256": "12bb00c9c28feb8ec86d67a9ab361a099afcbf02b1468b97327041abd6cb7e9f"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13326.zip",
"has_sig": false,
"md5_digest": "ffea19a1f98444ed91f7068d7d0466c9",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 191701,
"upload_time": "2013-11-22T21:52:32",
"url": "https://files.pythonhosted.org/packages/80/e5/de1e42cdf42d8ac7531f0f02f3be2e192c78c73fbcd4805a1fab9a4de8de/Bugzilla-ETL-0.3.13326.zip"
}
],
"0.3.13353": [
{
"comment_text": "",
"digests": {
"md5": "1995a55d12e67dd85f4ae7e6649a1579",
"sha256": "c4f6b061e28a94c33eb3148482ff2a9d808fa0d08ffa27e7f9669673b728150e"
},
"downloads": -1,
"filename": "Bugzilla_ETL-0.3.13353-py2.7.egg",
"has_sig": false,
"md5_digest": "1995a55d12e67dd85f4ae7e6649a1579",
"packagetype": "bdist_egg",
"python_version": "2.7",
"requires_python": null,
"size": 286205,
"upload_time": "2013-12-19T01:58:55",
"url": "https://files.pythonhosted.org/packages/0e/65/1cd7b31c7c1b55c83fb84fe98740b08ee49112ad672e8dc90fefd0a1d1e1/Bugzilla_ETL-0.3.13353-py2.7.egg"
},
{
"comment_text": "",
"digests": {
"md5": "d09bf3e886b56c1552d70244aa42c69a",
"sha256": "ff26a0a0e063f04d56434741e76dcab80617f8f5c5e5504c4ceada002cd94d71"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13353.win32-py2.7.exe",
"has_sig": false,
"md5_digest": "d09bf3e886b56c1552d70244aa42c69a",
"packagetype": "bdist_wininst",
"python_version": "2.7",
"requires_python": null,
"size": 463020,
"upload_time": "2013-12-19T01:59:09",
"url": "https://files.pythonhosted.org/packages/c9/47/3bf7ba2b4958d42960dc1c521c70639a3cc7d0f85dd37955f9402baec9aa/Bugzilla-ETL-0.3.13353.win32-py2.7.exe"
},
{
"comment_text": "",
"digests": {
"md5": "fb9412db7c39115e884f713d8c7772a7",
"sha256": "b986dd4ac612cee23dcda67e9352df87f19b5f72846f2128d0106a780d8844dd"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13353.zip",
"has_sig": false,
"md5_digest": "fb9412db7c39115e884f713d8c7772a7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 194986,
"upload_time": "2013-12-19T01:59:25",
"url": "https://files.pythonhosted.org/packages/aa/44/8f837b53346a7df52e1d75af7be63a1b8df77f36565028adfb5d948db1b7/Bugzilla-ETL-0.3.13353.zip"
}
]
},
"urls": [
{
"comment_text": "",
"digests": {
"md5": "1995a55d12e67dd85f4ae7e6649a1579",
"sha256": "c4f6b061e28a94c33eb3148482ff2a9d808fa0d08ffa27e7f9669673b728150e"
},
"downloads": -1,
"filename": "Bugzilla_ETL-0.3.13353-py2.7.egg",
"has_sig": false,
"md5_digest": "1995a55d12e67dd85f4ae7e6649a1579",
"packagetype": "bdist_egg",
"python_version": "2.7",
"requires_python": null,
"size": 286205,
"upload_time": "2013-12-19T01:58:55",
"url": "https://files.pythonhosted.org/packages/0e/65/1cd7b31c7c1b55c83fb84fe98740b08ee49112ad672e8dc90fefd0a1d1e1/Bugzilla_ETL-0.3.13353-py2.7.egg"
},
{
"comment_text": "",
"digests": {
"md5": "d09bf3e886b56c1552d70244aa42c69a",
"sha256": "ff26a0a0e063f04d56434741e76dcab80617f8f5c5e5504c4ceada002cd94d71"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13353.win32-py2.7.exe",
"has_sig": false,
"md5_digest": "d09bf3e886b56c1552d70244aa42c69a",
"packagetype": "bdist_wininst",
"python_version": "2.7",
"requires_python": null,
"size": 463020,
"upload_time": "2013-12-19T01:59:09",
"url": "https://files.pythonhosted.org/packages/c9/47/3bf7ba2b4958d42960dc1c521c70639a3cc7d0f85dd37955f9402baec9aa/Bugzilla-ETL-0.3.13353.win32-py2.7.exe"
},
{
"comment_text": "",
"digests": {
"md5": "fb9412db7c39115e884f713d8c7772a7",
"sha256": "b986dd4ac612cee23dcda67e9352df87f19b5f72846f2128d0106a780d8844dd"
},
"downloads": -1,
"filename": "Bugzilla-ETL-0.3.13353.zip",
"has_sig": false,
"md5_digest": "fb9412db7c39115e884f713d8c7772a7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 194986,
"upload_time": "2013-12-19T01:59:25",
"url": "https://files.pythonhosted.org/packages/aa/44/8f837b53346a7df52e1d75af7be63a1b8df77f36565028adfb5d948db1b7/Bugzilla-ETL-0.3.13353.zip"
}
]
}