{ "info": { "author": "Cung Tran", "author_email": "minishcung@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 2 - Pre-Alpha", "Intended Audience :: Developers", "License :: OSI Approved :: Apache Software License", "Natural Language :: English", "Programming Language :: Python :: 3.6", "Programming Language :: Python :: 3.7" ], "description": "===========\nNeedlestack\n===========\n\n.. image:: https://img.shields.io/pypi/v/needlestack.svg\n :target: https://pypi.python.org/pypi/needlestack\n\n.. image:: https://img.shields.io/travis/needlehaystack/needlestack.svg\n :target: https://travis-ci.org/needlehaystack/needlestack\n\n.. image:: https://coveralls.io/repos/github/needlehaystack/needlestack/badge.svg?branch=master\n :target: https://coveralls.io/github/needlehaystack/needlestack?branch=master\n\n.. image:: https://readthedocs.org/projects/needlestack/badge/?version=latest\n :target: https://needlestack.readthedocs.io/en/latest/?badge=latest\n :alt: Documentation Status\n\n\n\nNeedlestack is a distributed vector search microservice.\n\n\n- Free software: MIT license\n- Documentation: https://needlestack.readthedocs.io.\n\n\nFeatures\n--------\n\n- gRPC server for kNN vector search\n- Shard vectors over multiple nodes\n- Replicate shard over multiple nodes\n- Retrieve vectors by ID\n\n\nCaveats\n-------\nThese are some limitations of the current alpha builds\n\n- Vectors must be sharded and indexed before loading to Needlestack\n- To reload updated vectors, all ``MergerServicer`` and ``SearcherServicer`` nodes must be restarted\n- Vectors must be saved locally to disk for Needlestack to load them\n- Only kNN library supported currently is `Faiss `_\n\n\nNext Steps\n----------\nThese are valuable features to make Needlestack usable in production\n\n- Endpoint to index vectors in realtime\n- Update vectors from pre-built data sources without restarting the cluster\n- Allow vectors to be loaded from data sources like S3 or GCS\n- Add support for other kNN libraries\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/needlehaystack/needlestack", "keywords": "distributed nearest neighbors", "license": "Apache License 2.0", "maintainer": "", "maintainer_email": "", "name": "needlestack", "package_url": "https://pypi.org/project/needlestack/", "platform": "", "project_url": "https://pypi.org/project/needlestack/", "project_urls": { "Homepage": "https://github.com/needlehaystack/needlestack" }, "release_url": "https://pypi.org/project/needlestack/0.0.7/", "requires_dist": [ "grpcio (>=1.18.0)", "numpy (>=1.15.2)", "protobuf (>=3.6.1)", "kazoo (>=2.6.1)", "faiss (==1.5.3) ; extra == 'faiss'" ], "requires_python": "", "summary": "A distributed vector search microservice.", "version": "0.0.7" }, "last_serial": 5566177, "releases": { "0.0.7": [ { "comment_text": "", "digests": { "md5": "4c1172e22147c39084e67aed2bca9978", "sha256": "0f986d645a44fbcc34ee79a6dfc2fbbfa2957c61abb983a76a9bfdc1dd6ff9bb" }, "downloads": -1, "filename": "needlestack-0.0.7-py3-none-any.whl", "has_sig": false, "md5_digest": "4c1172e22147c39084e67aed2bca9978", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 43851, "upload_time": "2019-07-22T08:14:31", "url": "https://files.pythonhosted.org/packages/2c/85/8cc2fe6ed2033a5265c176e1e5de4f1b94b55f10f11ea2f2b14abc1c66d9/needlestack-0.0.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "33216cd6b71ab302e597135ad35f7a7b", "sha256": "dbf87436de299938380287a415e7d487ff7158dabe3374a25201660606a11a0c" }, "downloads": -1, "filename": "needlestack-0.0.7.tar.gz", "has_sig": false, "md5_digest": "33216cd6b71ab302e597135ad35f7a7b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 24680, "upload_time": "2019-07-22T08:14:34", "url": "https://files.pythonhosted.org/packages/da/5b/18776aba07c8ad1b09294d35c4b1522d509f28436a9132133283930872eb/needlestack-0.0.7.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "4c1172e22147c39084e67aed2bca9978", "sha256": "0f986d645a44fbcc34ee79a6dfc2fbbfa2957c61abb983a76a9bfdc1dd6ff9bb" }, "downloads": -1, "filename": "needlestack-0.0.7-py3-none-any.whl", "has_sig": false, "md5_digest": "4c1172e22147c39084e67aed2bca9978", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 43851, "upload_time": "2019-07-22T08:14:31", "url": "https://files.pythonhosted.org/packages/2c/85/8cc2fe6ed2033a5265c176e1e5de4f1b94b55f10f11ea2f2b14abc1c66d9/needlestack-0.0.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "33216cd6b71ab302e597135ad35f7a7b", "sha256": "dbf87436de299938380287a415e7d487ff7158dabe3374a25201660606a11a0c" }, "downloads": -1, "filename": "needlestack-0.0.7.tar.gz", "has_sig": false, "md5_digest": "33216cd6b71ab302e597135ad35f7a7b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 24680, "upload_time": "2019-07-22T08:14:34", "url": "https://files.pythonhosted.org/packages/da/5b/18776aba07c8ad1b09294d35c4b1522d509f28436a9132133283930872eb/needlestack-0.0.7.tar.gz" } ] }