{
    "info": {
        "author": "Rares Vernica",
        "author_email": "rvernica@gmail.com",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 4 - Beta",
            "Environment :: Console",
            "Intended Audience :: Science/Research",
            "License :: OSI Approved :: GNU Affero General Public License v3",
            "Natural Language :: English",
            "Programming Language :: Python :: 2.7",
            "Programming Language :: Python :: 3.4",
            "Programming Language :: Python :: 3.5",
            "Programming Language :: Python :: 3.6",
            "Programming Language :: Python :: 3.7",
            "Topic :: Database :: Front-Ends",
            "Topic :: Scientific/Engineering"
        ],
        "description": "SciDB-Strm: Python Library for SciDB Streaming\n==============================================\n\nRequirements\n------------\n\nSciDB ``16.9`` or newer\n\nApache Arrow ``0.6.0`` or newer.\n\nPython ``2.7.x``, ``3.4.x``, ``3.5.x``, ``3.6.x`` or newer.\n\nRequired Python packages::\n\n  dill\n  feather-format\n  pandas\n\nNote\n^^^^\n\nApache Arrow versions older than ``0.8.0`` contain a bug which might\naffect Stream users. The bug manifests on chunks of more than ``128``\nrecords with null-able values. For more details, see the full bug\ndescription `here\n<https://issues.apache.org/jira/browse/ARROW-1676>`_. This bug has\nbeen `fixed <https://github.com/apache/arrow/pull/1204>`_ in Apache\nArrow version ``0.8.0``.\n\n\nInstallation\n------------\n\nInstall latest release::\n\n  pip install scidb-strm\n\nInstall development version from GitHub::\n\n  pip install git+http://github.com/paradigm4/stream.git#subdirectory=py_pkg\n\nThe Python library needs to be installed on the SciDB server. The\nlibrary needs to be installed on the client as well, if Python code is\nto be send from the client to the server.\n\n\nSciDB-Strm Python API and Examples\n----------------------------------\n\nOnce installed the *SciDB-Strm* Python library can be imported with\n``import scidbstrm``. The library provides a high and low-level access\nto the SciDB ``stream`` operator as well as the ability to send Python\ncode to the SciDB server.\n\nHigh-level access is provided by the function ``map``:\n\n``map(map_fun, finalize_fun=None)``\n  Read SciDB chunks. For each chunk, call ``map_fun`` and stream its\n  result back to SciDB. If ``finalize_fun`` is provided, call it after\n  all the chunks have been processed.\n\nSee `0-iquery.txt <examples/0-iquery.txt>`_ for a succinct example\nusing the ``map`` function.\n\nSee `1-map-finalize.py <examples/1-map-finalize.py>`_ for an example\nusing the ``map`` function. The Python script has to be copied onto\nthe SciDB instance.\n\nPython code can be send to the SciDB server for execution using\nthe ``pack_func`` and ``read_func`` functions:\n\n``pack_func(func)``\n  Serialize Python function for use as ``upload_data`` in ``input`` or\n  ``load`` operators.\n\n``read_func()``\n  Read and de-serialize function from SciDB.\n\nSee `2-pack-func.py <examples/2-pack-func.py>`_ for an example of\nusing the ``pack_func`` and ``read_func`` functions.\n\nLow-level access is provided by the ``read`` and ``write`` functions:\n\n``read()``\n  Read a data chunk from SciDB. Returns a Pandas DataFrame or None.\n\n``write(df=None)``\n  Write a data chunk to SciDB.\n\nSee `3-read-write.py <examples/3-read-write.py>`_ for an example using\nthe ``read`` and ``write`` functions. The Python script has to be\ncopied onto the SciDB instance.\n\nA convenience invocation of the Python interpreter is provided in\n``python_map`` variable and it is set to::\n\n  python -uc \"import scidbstrm; scidbstrm.map(scidbstrm.read_func())\"\n\nFinally, see `4-machine-learning.py <examples/4-machine-learning.py>`_\nfor a more complex example of going throught the steps of using\nmachine larning (preprocessing, training, and prediction).\n\n\nDebugging Python Code\n---------------------\n\nWhen debugging Python code executed as part of the ``stream`` operator\n*do not* use the ``print`` function. The ``stream`` operator\ncommunicates with the Python process using ``stdout``. The ``print``\nfunction writes output to ``stdout``. So, using the ``print`` function\nwould interfere with the inter-process communication.\n\nInstead, write debug output to ``stderr`` using the ``write``\nfunction. For example::\n\n  import sys\n\n  x = [1, 2, 3]\n  sys.stderr.write(\"{}\\n\".format(x))\n\nThe output is written in the ``scidb-stderr.log`` files of each\ninstance, for example::\n\n  /opt/scidb/18.1/DB-scidb/0/0/scidb-stderr.log\n  /opt/scidb/18.1/DB-scidb/0/1/scidb-stderr.log\n\nIf using SciDB ``18.1`` installed in the default location and\nconfigured with one server and two instances.\n\n\n",
        "description_content_type": "",
        "docs_url": null,
        "download_url": "http://github.com/Paradigm4/Stream",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "",
        "keywords": "",
        "license": "AGPL-3.0",
        "maintainer": "",
        "maintainer_email": "",
        "name": "scidb-strm",
        "package_url": "https://pypi.org/project/scidb-strm/",
        "platform": "",
        "project_url": "https://pypi.org/project/scidb-strm/",
        "project_urls": {
            "Download": "http://github.com/Paradigm4/Stream"
        },
        "release_url": "https://pypi.org/project/scidb-strm/19.3.0/",
        "requires_dist": [
            "dill",
            "feather-format",
            "pandas",
            "pyarrow (==0.9.0) ; python_version < \"3.5\"",
            "pyarrow (<0.14.0,>=0.9.0) ; python_version >= \"3.5\""
        ],
        "requires_python": "",
        "summary": "Python library for SciDB streaming",
        "version": "19.3.0"
    },
    "last_serial": 5499046,
    "releases": {
        "16.9.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "490636f1d3b6fb4c54103e91bc565a9a",
                    "sha256": "0d8bb4810b6f70a161afa0139513b1ae3a34d14a50a703500f3771d5d54d21b9"
                },
                "downloads": -1,
                "filename": "scidb_strm-16.9.0-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "490636f1d3b6fb4c54103e91bc565a9a",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 5916,
                "upload_time": "2018-02-10T21:38:24",
                "url": "https://files.pythonhosted.org/packages/7e/07/24bcd866a944fe15c5c4d6f5135c6eeb3da93f513c185652231344fce1c1/scidb_strm-16.9.0-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "990676d4394ccd1aa3c4c6d4b0c39596",
                    "sha256": "8adb91fc926ecbb7dd49a7f36d82914d03caaa946bf2084b7695b8449bbcc59a"
                },
                "downloads": -1,
                "filename": "scidb-strm-16.9.0.tar.gz",
                "has_sig": false,
                "md5_digest": "990676d4394ccd1aa3c4c6d4b0c39596",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3659,
                "upload_time": "2018-02-10T21:38:25",
                "url": "https://files.pythonhosted.org/packages/e7/60/1a6d3de31f8734bf30c03f89bfb4283ad0a34be80abd2be5ab065e864051/scidb-strm-16.9.0.tar.gz"
            }
        ],
        "16.9.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "72c11f6791d228672258b1c300f80d93",
                    "sha256": "62f639b7f6950f5442cc3cfca12769ebd5e6427ec49b63a6aa45a69ab984547f"
                },
                "downloads": -1,
                "filename": "scidb_strm-16.9.1-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "72c11f6791d228672258b1c300f80d93",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 5928,
                "upload_time": "2018-02-10T21:43:56",
                "url": "https://files.pythonhosted.org/packages/53/c1/eb32c9b6105b8577471b1a5aa3c91fc6c3a807e420a699858cda1fbf1382/scidb_strm-16.9.1-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "d70748e2684dae5b8189bff641c5e55e",
                    "sha256": "b4fe6333793b2755633718ea615b534c58f5f673bf8eac6b3b6bbb82bca6757f"
                },
                "downloads": -1,
                "filename": "scidb-strm-16.9.1.tar.gz",
                "has_sig": false,
                "md5_digest": "d70748e2684dae5b8189bff641c5e55e",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3656,
                "upload_time": "2018-02-10T21:43:57",
                "url": "https://files.pythonhosted.org/packages/d6/a6/21d76d902ebbdc732627cf60da3fd5c30af8cefde8f66d68743ed8c0670d/scidb-strm-16.9.1.tar.gz"
            }
        ],
        "18.1.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "bb40728ee3ada4dc295fc9c8be96071c",
                    "sha256": "422ba7de5076c68362ec658f2efc1ea732e69acf8c968a19e75d78528a4f9200"
                },
                "downloads": -1,
                "filename": "scidb_strm-18.1.0-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "bb40728ee3ada4dc295fc9c8be96071c",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 5926,
                "upload_time": "2018-02-11T21:14:52",
                "url": "https://files.pythonhosted.org/packages/3e/cc/a8f4f0fbcc9b82494c1e958b6cf3eb8f817167fa3919ef511eccda98723d/scidb_strm-18.1.0-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "a306495dddb2236bed2d09521b98086c",
                    "sha256": "9c49c84210a4aaad08056ae0b2022eea89951cff67c4a1e652a58f14701b6bc3"
                },
                "downloads": -1,
                "filename": "scidb-strm-18.1.0.tar.gz",
                "has_sig": false,
                "md5_digest": "a306495dddb2236bed2d09521b98086c",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 3660,
                "upload_time": "2018-02-11T21:14:55",
                "url": "https://files.pythonhosted.org/packages/7b/d3/5039bae2620e76c335090b919cf9dc4cccffbbf69259708df0c3eb864c62/scidb-strm-18.1.0.tar.gz"
            }
        ],
        "18.1.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "3915ddc8d45bcf8879934c4dbf2f9867",
                    "sha256": "b2079ac8f4a650fd79dd11399f3905670490f9b448f1793b7987a2d306e3e9ec"
                },
                "downloads": -1,
                "filename": "scidb_strm-18.1.1-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "3915ddc8d45bcf8879934c4dbf2f9867",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 4682,
                "upload_time": "2019-06-07T04:20:58",
                "url": "https://files.pythonhosted.org/packages/71/ec/a815f9b1cb55d2635b4dd70239458b6998813707f6d486bf1a5319060109/scidb_strm-18.1.1-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "c828bfe08238682dc8818bdd83ce2daf",
                    "sha256": "d46f868b33fd61b36a935e51f23d69508e2a4291781d42fd5fee46145c7ab2c4"
                },
                "downloads": -1,
                "filename": "scidb-strm-18.1.1.tar.gz",
                "has_sig": false,
                "md5_digest": "c828bfe08238682dc8818bdd83ce2daf",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 4119,
                "upload_time": "2019-06-07T04:21:00",
                "url": "https://files.pythonhosted.org/packages/5e/f8/1436e7db9089729ac20d8991cef6e72475ef8f9f560d3de63e04b2b0ff1a/scidb-strm-18.1.1.tar.gz"
            }
        ],
        "19.3.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "fe32a5c24d12f9486fae4df302a8ca3f",
                    "sha256": "cc2a81facb97cfd22a0a17d95b35fc0bb69eabf1313bcf86abd57f806b0064a9"
                },
                "downloads": -1,
                "filename": "scidb_strm-19.3.0-py2.py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "fe32a5c24d12f9486fae4df302a8ca3f",
                "packagetype": "bdist_wheel",
                "python_version": "py2.py3",
                "requires_python": null,
                "size": 4694,
                "upload_time": "2019-07-08T05:30:58",
                "url": "https://files.pythonhosted.org/packages/86/a0/ea3cfbb65b9462162a544bac95136cf4481458819ac2ef56b245b1b1ed85/scidb_strm-19.3.0-py2.py3-none-any.whl"
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "6662ea88f075f3f3b6b977f1b710eb91",
                    "sha256": "e5e6a6012710580e279f600b4612532ec8b2f9d08ffacfe3b646e07053ff82f2"
                },
                "downloads": -1,
                "filename": "scidb-strm-19.3.0.tar.gz",
                "has_sig": false,
                "md5_digest": "6662ea88f075f3f3b6b977f1b710eb91",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 4132,
                "upload_time": "2019-07-08T05:31:00",
                "url": "https://files.pythonhosted.org/packages/36/73/b39d555d9a7f7caf8ae166dab189182652774ed539d3372a7845e5a26572/scidb-strm-19.3.0.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "fe32a5c24d12f9486fae4df302a8ca3f",
                "sha256": "cc2a81facb97cfd22a0a17d95b35fc0bb69eabf1313bcf86abd57f806b0064a9"
            },
            "downloads": -1,
            "filename": "scidb_strm-19.3.0-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "fe32a5c24d12f9486fae4df302a8ca3f",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": null,
            "size": 4694,
            "upload_time": "2019-07-08T05:30:58",
            "url": "https://files.pythonhosted.org/packages/86/a0/ea3cfbb65b9462162a544bac95136cf4481458819ac2ef56b245b1b1ed85/scidb_strm-19.3.0-py2.py3-none-any.whl"
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "6662ea88f075f3f3b6b977f1b710eb91",
                "sha256": "e5e6a6012710580e279f600b4612532ec8b2f9d08ffacfe3b646e07053ff82f2"
            },
            "downloads": -1,
            "filename": "scidb-strm-19.3.0.tar.gz",
            "has_sig": false,
            "md5_digest": "6662ea88f075f3f3b6b977f1b710eb91",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 4132,
            "upload_time": "2019-07-08T05:31:00",
            "url": "https://files.pythonhosted.org/packages/36/73/b39d555d9a7f7caf8ae166dab189182652774ed539d3372a7845e5a26572/scidb-strm-19.3.0.tar.gz"
        }
    ]
}