{ "info": { "author": "Xavier Dupr\u00e9", "author_email": "xavier.dupre@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 5 - Production/Stable", "Intended Audience :: Developers", "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 3", "Topic :: Education", "Topic :: Scientific/Engineering" ], "description": "\n.. _l-README:\n\nREADME\n======\n\n.. only:: html\n\n .. image:: https://travis-ci.org/sdpython/pysqllike.svg?branch=master\n :target: https://travis-ci.org/sdpython/pysqllike\n :alt: Build status\n\n .. image:: https://ci.appveyor.com/api/projects/status/rrpks1pgivea23js?svg=true\n :target: https://ci.appveyor.com/project/sdpython/pysqllike\n :alt: Build Status Windows\n\n .. image:: https://circleci.com/gh/sdpython/pysqllike/tree/master.svg?style=svg\n :target: https://circleci.com/gh/sdpython/pysqllike/tree/master\n\n .. image:: https://badge.fury.io/py/pysqllike.svg\n :target: http://badge.fury.io/py/pysqllike\n\n .. image:: http://img.shields.io/github/issues/sdpython/pysqllike.png\n :alt: GitHub Issues\n :target: https://github.com/sdpython/pysqllike/issues\n\n .. image:: https://img.shields.io/badge/license-MIT-blue.svg\n :alt: MIT License\n :target: http://opensource.org/licenses/MIT\n\n .. image:: https://landscape.io/github/sdpython/pysqllike/master/landscape.svg?style=flat\n :target: https://landscape.io/github/sdpython/pysqllike/master\n :alt: Code Health\n\n .. image:: https://requires.io/github/sdpython/pysqllike/requirements.svg?branch=master\n :target: https://requires.io/github/sdpython/pysqllike/requirements/?branch=master\n :alt: Requirements Status\n\n .. image:: https://codecov.io/github/sdpython/pysqllike/coverage.svg?branch=master\n :target: https://codecov.io/github/sdpython/pysqllike?branch=master\n\n**Links:**\n\n* `GitHub/pysqllike `_\n* `documentation `_\n* `Blog `_\n\nDescription\n-----------\n\nWriting a map/reduce job\n(using `PIG `_ for example),\nusually requires to switch from local files to remote files\n(on `Hadoop `_).\nOn way to work is extract a small sample of the data which will be processed\nby a map/reduce job. The job is then locally developped. And when it works,\nit is run on a parallized environment.\n\nThe goal of this extension is allow the implementation of\nthis job using Python syntax as follows:\n\n::\n\n def myjob(input):\n iter = input.select (input.age, input.nom, age2 = input.age2*input.age2)\n wher = iter.where( (iter.age > 60).Or(iter.age < 25))\n return where\n\n input = IterRow (None, [ {\"nom\": 10}, {\"jean\": 40} ] )\n output = myjob(input)\n\nWhen the job is ready, it can be translated into a `PIG `_\njob::\n\n input = LOAD '...' USING PigStorage('\\t') AS (nom, age);\n iter = FOREACH input GENERATE age, nom, age*age AS age2 ;\n wher = FILTER iter BY age > 60 or age < 25 ;\n STORE wher INTO '...' USING PigStorage();\n\nIt should also be translated into\n`SQL `_.\n\nFunctionalities\n---------------\n\n* not yet ready\n\nDesign\n------\n\nThis project contains various helper about logging functions, unit tests and help generation.\n * a source folder: ``src``\n * a unit test folder: ``_unittests``, go to this folder and run ``run_unittests.py``\n * a _doc folder: ``_doc``, it will contains the documentation\n * a file ``setup.py`` to build and to install the module\n * a file ``make_help.py`` to build the sphinx documentation\n", "description_content_type": null, "docs_url": null, "download_url": "https://github.com/sdpython/pysqllike/", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://www.xavierdupre.fr/app/pysqllike/helpsphinx/index.html", "keywords": "pysqllike", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "pysqllike", "package_url": "https://pypi.org/project/pysqllike/", "platform": "", "project_url": "https://pypi.org/project/pysqllike/", "project_urls": { "Download": "https://github.com/sdpython/pysqllike/", "Homepage": "http://www.xavierdupre.fr/app/pysqllike/helpsphinx/index.html" }, "release_url": "https://pypi.org/project/pysqllike/0.1.168/", "requires_dist": null, "requires_python": "", "summary": "An intent to write SQL like programs and to translate them in Python, SQL, Hive, PIG.", "version": "0.1.168" }, "last_serial": 3577578, "releases": { "0.1.168": [ { "comment_text": "", "digests": { "md5": "82a061aa9b1a396060899e72698d97a7", "sha256": "b62aa8fbc9bb49915746eb681211c61f182a4ab9ec7fb690c20dff5d2152f73e" }, "downloads": -1, "filename": "pysqllike-0.1.168-py3-none-any.whl", "has_sig": false, "md5_digest": "82a061aa9b1a396060899e72698d97a7", "packagetype": "bdist_wheel", "python_version": "3.6", "requires_python": null, "size": 24142, "upload_time": "2017-10-05T20:02:51", "url": "https://files.pythonhosted.org/packages/29/a4/3edef89a90b47378e59f4dc076f9b5d7220d659299f432a88bdb0f249840/pysqllike-0.1.168-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "151c079a484b90b361cba99453f851cc", "sha256": "73b6b0cf818ee7d4f9b8d758756bcc80f205f9c4d9467428d92fa0e323a654fd" }, "downloads": -1, "filename": "pysqllike-0.1.168.tar.gz", "has_sig": false, "md5_digest": "151c079a484b90b361cba99453f851cc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 34264, "upload_time": "2017-10-05T20:02:44", "url": "https://files.pythonhosted.org/packages/6a/84/16b613e6c4d552cfdd4869365790c03a1510c46ad62f0143dd0ea4339bb8/pysqllike-0.1.168.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "82a061aa9b1a396060899e72698d97a7", "sha256": "b62aa8fbc9bb49915746eb681211c61f182a4ab9ec7fb690c20dff5d2152f73e" }, "downloads": -1, "filename": "pysqllike-0.1.168-py3-none-any.whl", "has_sig": false, "md5_digest": "82a061aa9b1a396060899e72698d97a7", "packagetype": "bdist_wheel", "python_version": "3.6", "requires_python": null, "size": 24142, "upload_time": "2017-10-05T20:02:51", "url": "https://files.pythonhosted.org/packages/29/a4/3edef89a90b47378e59f4dc076f9b5d7220d659299f432a88bdb0f249840/pysqllike-0.1.168-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "151c079a484b90b361cba99453f851cc", "sha256": "73b6b0cf818ee7d4f9b8d758756bcc80f205f9c4d9467428d92fa0e323a654fd" }, "downloads": -1, "filename": "pysqllike-0.1.168.tar.gz", "has_sig": false, "md5_digest": "151c079a484b90b361cba99453f851cc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 34264, "upload_time": "2017-10-05T20:02:44", "url": "https://files.pythonhosted.org/packages/6a/84/16b613e6c4d552cfdd4869365790c03a1510c46ad62f0143dd0ea4339bb8/pysqllike-0.1.168.tar.gz" } ] }