{ "info": { "author": "Skylable Ltd.", "author_email": "sx-users@lists.skylable.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "Intended Audience :: System Administrators", "License :: OSI Approved :: Apache Software License", "Natural Language :: English", "Programming Language :: Python", "Programming Language :: Python :: 2.7" ], "description": "s3import: S3 data import utility\n================================\n\nIntroduction\n------------\n\ns3import is a tool for importing data from S3 to an SX Cluster. For each source\nS3 bucket s3import creates a volume on the cluster and copies the keys from the\nbucket to the new volume.\n\ns3import uses boto (https://pypi.python.org/pypi/boto) and python-sxclient\n(https://pypi.python.org/pypi/sxclient) and works in Python 2.7.\n\n\nInstallation\n------------\n\nTo install s3import, run::\n\n $ pip install s3import\n\nAlternatively, to install s3import from source, run::\n\n $ pip install \n\nor\n\n::\n\n $ pip install -e \n\nreplacing ```` with path to the source.\n\n\nConfiguration\n-------------\n\nS3\n^^\n\nConfiguration for connecting with an S3 service is obtained from boto config\nfile. Your file should contain at least:\n\n- ``aws_access_key_id`` in ``[Credentials]`` section, with your S3 access key\n ID as a value;\n- ``aws_secret_access_key`` in ``[Credentials]`` section, with your S3 secret\n access key as a value.\n\nAdditionally, if you want to connect to an S3 service other than Amazon S3,\nyour file should contain:\n\n- ``s3_host`` in ``[Credentials]`` section, with hostname of the S3 service you\n want to access;\n- ``s3_port`` in ``[Credentials]`` section, with port which the S3 service\n uses.\n\nBy default, connection with S3 is secured by SSL and the SSL certificates are\nverified. If you wish to change any of these behaviours, add ``is_secure =\nFalse`` and ``https_validate_certificates = False`` respectively to the\n``[Boto]`` section of your config file.\n\nIn order for boto to read the config file automatically, you should name it\n``.boto`` and place it in your home directory. You can also set the environment\nvariable ``BOTO_CONFIG`` with the path to the configuration file you want to\nuse prior to running s3import.\n\nBe wary that boto tries to read configuration options from other locations than\nboto config file. For example, if a file ``~/.aws/credentials`` exists, boto\nwill read credential settings from there. For more information see\nhttp://docs.pythonboto.org/en/latest/boto_config_tut.html.\n\nBelow is an example content of a configuration file::\n\n [Credentials]\n s3_host = s3.example.com\n s3_port = 8443\n aws_access_key_id = s3_user\n aws_secret_access_key = secret_key\n\n [Boto]\n is_secure = True\n https_validate_certificates = True\n\n\nSX and import configuration\n^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\nConfiguration for connecting with an SX Cluster and importing the buckets is\nobtained from s3import command-line arguments. You can display their\ndescriptions by running ``s3import --help``.\n\n\nUsage\n-----\n\nAfter installation, a command-line tool named ``s3import`` will become\navailable. Run::\n\n $ s3import --help\n\nfor a list of available options.", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://www.skylable.com/products", "keywords": "", "license": "Apache 2.0", "maintainer": "", "maintainer_email": "", "name": "s3import", "package_url": "https://pypi.org/project/s3import/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/s3import/", "project_urls": { "Homepage": "http://www.skylable.com/products" }, "release_url": "https://pypi.org/project/s3import/0.6.4/", "requires_dist": [ "boto (==2.39.0)", "sxclient (>=0.16.4)" ], "requires_python": "", "summary": "S3 data import utility", "version": "0.6.4" }, "last_serial": 2381579, "releases": { "0.2.1": [ { "comment_text": "", "digests": { "md5": "7b5d504c83731a37f0f57c8976a2e911", "sha256": "78c402def5edfdc4b314c962af7cc38ebd1aed5261e190632cee48ace5115db0" }, "downloads": -1, "filename": "s3import-0.2.1-py2-none-any.whl", "has_sig": false, "md5_digest": "7b5d504c83731a37f0f57c8976a2e911", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 14420, "upload_time": "2015-12-15T10:44:09", "url": "https://files.pythonhosted.org/packages/d3/d6/fd03578744f78e73c60de210f3965818a4675e7aa51b6a4c85decd206afb/s3import-0.2.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "f5b0fd91f1db5adc821fa69cd15e8601", "sha256": "61cbed024bbb5f20836395c5ebee1cdd460b3ab3c52e3eaf294e00004d9cd2d0" }, "downloads": -1, "filename": "s3import-0.2.1.tar.gz", "has_sig": false, "md5_digest": "f5b0fd91f1db5adc821fa69cd15e8601", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 9663, "upload_time": "2015-12-15T10:44:24", "url": "https://files.pythonhosted.org/packages/ef/fd/04664be452dc8fb049a0d433fc4ddfc414c376f846988a18a17a7b24466f/s3import-0.2.1.tar.gz" } ], "0.3.0": [ { "comment_text": "", "digests": { "md5": "be6cff56b59d8874d7b1fdedb6b81fc2", "sha256": "49fb902cf9bbbbaea102fb40f14a2d55ed140d24d16f5547c733ff58a96dc159" }, "downloads": -1, "filename": "s3import-0.3.0-py2-none-any.whl", "has_sig": false, "md5_digest": "be6cff56b59d8874d7b1fdedb6b81fc2", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 15071, "upload_time": "2016-01-20T11:01:59", "url": "https://files.pythonhosted.org/packages/d1/8a/1c2009648bb64cda6f611f46769d7d400e0f93517112bcffdb0146b99317/s3import-0.3.0-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "770aa2c241432ea276b798c380ee85ed", "sha256": "bfe0f8297aa42c3a7576256c01332a6fcdfeb0000247ce92d8423006a1ac72f8" }, "downloads": -1, "filename": "s3import-0.3.0.tar.gz", "has_sig": false, "md5_digest": "770aa2c241432ea276b798c380ee85ed", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10030, "upload_time": "2016-01-20T11:03:31", "url": "https://files.pythonhosted.org/packages/16/98/0b72428b818dcd70cc241107323df08bf0b21de0f0bcb2f2974d3e96a017/s3import-0.3.0.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "2dcfeab24222e02cfb1472c198419638", "sha256": "11d5df566f410b0d5717079c0fe62bc4effe559a8ccdb6ef40a1485ca2097116" }, "downloads": -1, "filename": "s3import-0.4.0-py2-none-any.whl", "has_sig": false, "md5_digest": "2dcfeab24222e02cfb1472c198419638", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 15577, "upload_time": "2016-01-21T16:00:06", "url": "https://files.pythonhosted.org/packages/14/c9/4bf513f7d37bd10bf7a427e0c7c285df26e26d70235cc711da133d10e4fb/s3import-0.4.0-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "0cc93eba6c6502afbfcc03c92a12321d", "sha256": "6bb5d0dddb592c70d55dd22143de9c142b05ae3f1f28987144a3aee6afc93e6e" }, "downloads": -1, "filename": "s3import-0.4.0.tar.gz", "has_sig": false, "md5_digest": "0cc93eba6c6502afbfcc03c92a12321d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10523, "upload_time": "2016-01-21T16:00:25", "url": "https://files.pythonhosted.org/packages/77/33/fc716240d5ae762c74e6b61d2955a5536b472f70fd87a9c53fcef24493bc/s3import-0.4.0.tar.gz" } ], "0.4.1": [ { "comment_text": "", "digests": { "md5": "37d9f7c394e5d10cc156cb7218b3fa63", "sha256": "91d3a2f1c495f864c7b4c0ff89478d57fae9768adfb8b02e7c11bc7b63b11ae3" }, "downloads": -1, "filename": "s3import-0.4.1-py2-none-any.whl", "has_sig": false, "md5_digest": "37d9f7c394e5d10cc156cb7218b3fa63", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 16120, "upload_time": "2016-01-29T13:30:23", "url": "https://files.pythonhosted.org/packages/07/95/8ba5aa75aa9fd1c4dacebc02bfdd242cf38614474403a6e71894709c0655/s3import-0.4.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "dfc4fef66546b9c9ed0c73823752af6c", "sha256": "737c041034701bc65c69c13ffc0fe4d2bbd0105086637ad622f1304acbe7be0f" }, "downloads": -1, "filename": "s3import-0.4.1.tar.gz", "has_sig": false, "md5_digest": "dfc4fef66546b9c9ed0c73823752af6c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10694, "upload_time": "2016-01-29T13:30:43", "url": "https://files.pythonhosted.org/packages/60/89/1f9818cda611c8457a019c0f6dd192eaf4e3342d9f37148665f81be01992/s3import-0.4.1.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "4ad5cb4c96c8970a9307e134e1965f41", "sha256": "125bed348db2eb0fba149a0db5437fa0c6c010c997ac946981b0c2080ab87046" }, "downloads": -1, "filename": "s3import-0.5.0-py2-none-any.whl", "has_sig": false, "md5_digest": "4ad5cb4c96c8970a9307e134e1965f41", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 16158, "upload_time": "2016-02-08T10:23:31", "url": "https://files.pythonhosted.org/packages/bb/c2/d0d751f414b051811fd789d435ae5715e124dc496b5865eb4a975ddfb48a/s3import-0.5.0-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "d9db79f2938d7bc0d85b97a807abf3e3", "sha256": "5e8b74f4a15c1d7c16d69ddc6ed0f0f5ab2bc567476d9d9de419b002ab790f6d" }, "downloads": -1, "filename": "s3import-0.5.0.tar.gz", "has_sig": false, "md5_digest": "d9db79f2938d7bc0d85b97a807abf3e3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10748, "upload_time": "2016-02-08T10:23:37", "url": "https://files.pythonhosted.org/packages/1c/66/131adb2bd62c0ec5a9fb63b5e612e9632625f88b12d200c1693129b69ff5/s3import-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "230fdd8a676f36e2f7ca31135d95c081", "sha256": "8acf77b46fe8eaeef5ec2a14bd4e040dbc030f931a4882cc1ce80410670ddd52" }, "downloads": -1, "filename": "s3import-0.5.1-py2-none-any.whl", "has_sig": false, "md5_digest": "230fdd8a676f36e2f7ca31135d95c081", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 16251, "upload_time": "2016-02-09T09:58:46", "url": "https://files.pythonhosted.org/packages/99/c7/b5427900f10edeff52eddbc41e15081c58332a5def45341230c81335ecb0/s3import-0.5.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "89d5a1f1f051c47d95a4bd31b07f8534", "sha256": "ac0342aae95997d2ec932c1a0e9822a2fe48cb4d9a36d66c4ae6406ca328f9a7" }, "downloads": -1, "filename": "s3import-0.5.1.tar.gz", "has_sig": false, "md5_digest": "89d5a1f1f051c47d95a4bd31b07f8534", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10827, "upload_time": "2016-02-09T09:58:51", "url": "https://files.pythonhosted.org/packages/9c/75/826204dac14dd97296e6bbd609ee0c5060154bfab4f2aae62d8773173715/s3import-0.5.1.tar.gz" } ], "0.6.0": [ { "comment_text": "", "digests": { "md5": "743160b3386a5b1abf1776357f497106", "sha256": "69b7de82830a98a1966c8d3ec8b3bc0c2a5eeb532cd946d1143adc5e29edd19b" }, "downloads": -1, "filename": "s3import-0.6.0-py2-none-any.whl", "has_sig": false, "md5_digest": "743160b3386a5b1abf1776357f497106", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17176, "upload_time": "2016-02-22T16:53:15", "url": "https://files.pythonhosted.org/packages/66/0c/8ceaa99f1ad53011c62cdef1f03cf1da6712c7a69bd9cd381f9b67ae6574/s3import-0.6.0-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "43ddeea1a51476eff6330a9a17326922", "sha256": "f657d1e0c725b2e82d75501276c062fb2034e634535c7470f383ee9c9e9f4a41" }, "downloads": -1, "filename": "s3import-0.6.0.tar.gz", "has_sig": false, "md5_digest": "43ddeea1a51476eff6330a9a17326922", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11451, "upload_time": "2016-02-22T16:53:20", "url": "https://files.pythonhosted.org/packages/2c/8b/e009ae80ca00102f051fe7599fa8e5a5d907c19e4efc99536849b90f1996/s3import-0.6.0.tar.gz" } ], "0.6.1": [ { "comment_text": "", "digests": { "md5": "f671d3c3d9bb90566e52307ea005f82e", "sha256": "a7823d3b927867eb095282eaea7443973c69bd45a64b405850fbf694e6099a6a" }, "downloads": -1, "filename": "s3import-0.6.1-py2-none-any.whl", "has_sig": false, "md5_digest": "f671d3c3d9bb90566e52307ea005f82e", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17190, "upload_time": "2016-04-05T14:22:15", "url": "https://files.pythonhosted.org/packages/9e/22/5ec4c2ce68352b6a6ad7afc867950356d3b28a10813e686b8d033089559e/s3import-0.6.1-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "1a2b32e42456a404ee878c1404009a60", "sha256": "a84f90a46d7b6809c790ce019143c97dadfaa94275e1a24ec0d0f6a163ae1a57" }, "downloads": -1, "filename": "s3import-0.6.1.tar.gz", "has_sig": false, "md5_digest": "1a2b32e42456a404ee878c1404009a60", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11481, "upload_time": "2016-04-05T14:23:18", "url": "https://files.pythonhosted.org/packages/9e/11/f912bed11e3ea54afce0f2a534dc8a1638d400b2d87d886d80f34b5edf11/s3import-0.6.1.tar.gz" } ], "0.6.2": [ { "comment_text": "", "digests": { "md5": "bcc2a215e751ab7de95c54707382f1ed", "sha256": "da2e7b4107256382b796d55b726141d06f04b272f31c7b5983bce03a0c9434e4" }, "downloads": -1, "filename": "s3import-0.6.2-py2-none-any.whl", "has_sig": false, "md5_digest": "bcc2a215e751ab7de95c54707382f1ed", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17197, "upload_time": "2016-04-06T12:52:51", "url": "https://files.pythonhosted.org/packages/66/76/e7504fc57ea03770228fd5c313ac66a953a46635f577e2e540f3e29971ce/s3import-0.6.2-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "b2dc5ebe277493367bf9738f3ca0031f", "sha256": "58c9c4f61fa9830de2700cde04b9fab0fc1545fe6284dd221b9c41d18b9f2d85" }, "downloads": -1, "filename": "s3import-0.6.2.tar.gz", "has_sig": false, "md5_digest": "b2dc5ebe277493367bf9738f3ca0031f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11496, "upload_time": "2016-04-06T12:53:16", "url": "https://files.pythonhosted.org/packages/ec/c2/324227ce448ffe997dc635eddf30f63c0175f5b530a9a6c4bc9984e7c7b6/s3import-0.6.2.tar.gz" } ], "0.6.3": [ { "comment_text": "", "digests": { "md5": "c37f945eb7bc82a90139b20bb81eb2a7", "sha256": "3327ae65caf61ed9c9cb85fd52fd97c63b0c78e47700a1f99897ea9fbba9f46a" }, "downloads": -1, "filename": "s3import-0.6.3-py2-none-any.whl", "has_sig": false, "md5_digest": "c37f945eb7bc82a90139b20bb81eb2a7", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17239, "upload_time": "2016-04-08T09:22:06", "url": "https://files.pythonhosted.org/packages/e9/e8/6667b3ed592e2a5e4f5c89a526de6b00f26ac95ed68d36142db2d0c96e37/s3import-0.6.3-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "04c8ae9632bed35dc90af948d70e64d7", "sha256": "31542558eb8de778806d4bff0c6fd77bc96aae3fd900587cf61874cf072599fa" }, "downloads": -1, "filename": "s3import-0.6.3.tar.gz", "has_sig": false, "md5_digest": "04c8ae9632bed35dc90af948d70e64d7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11537, "upload_time": "2016-04-08T09:23:41", "url": "https://files.pythonhosted.org/packages/cc/c5/f0b7a006f4897cefb1b6d2bdfc14d1813cd158c981b6654a5cd964bd64cb/s3import-0.6.3.tar.gz" } ], "0.6.4": [ { "comment_text": "", "digests": { "md5": "8abd7ee509e0718cbfeb76a0007a7db6", "sha256": "b4f875106896e3aa0b11a07807314769cec5dc9067c8a8d152d0c915bb10e848" }, "downloads": -1, "filename": "s3import-0.6.4-py2-none-any.whl", "has_sig": false, "md5_digest": "8abd7ee509e0718cbfeb76a0007a7db6", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17237, "upload_time": "2016-10-05T08:50:03", "url": "https://files.pythonhosted.org/packages/24/ae/f5085c3b89f4d9ed8607f8f0c40a03ad160bd823c6cd3ecff25ff48e283e/s3import-0.6.4-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "db4ca6dcaf8b9bd28b2ebaaa2b3f89a3", "sha256": "54444cb9aa003d5f7eb42abaab01d405ed56ab8920bcfcca4d10775371d318f3" }, "downloads": -1, "filename": "s3import-0.6.4.tar.gz", "has_sig": false, "md5_digest": "db4ca6dcaf8b9bd28b2ebaaa2b3f89a3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12665, "upload_time": "2016-10-05T08:50:05", "url": "https://files.pythonhosted.org/packages/d0/0e/7720505610cd635cf6ffa85127e67c4eff79141c34ee9953d105f85c9061/s3import-0.6.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "8abd7ee509e0718cbfeb76a0007a7db6", "sha256": "b4f875106896e3aa0b11a07807314769cec5dc9067c8a8d152d0c915bb10e848" }, "downloads": -1, "filename": "s3import-0.6.4-py2-none-any.whl", "has_sig": false, "md5_digest": "8abd7ee509e0718cbfeb76a0007a7db6", "packagetype": "bdist_wheel", "python_version": "py2", "requires_python": null, "size": 17237, "upload_time": "2016-10-05T08:50:03", "url": "https://files.pythonhosted.org/packages/24/ae/f5085c3b89f4d9ed8607f8f0c40a03ad160bd823c6cd3ecff25ff48e283e/s3import-0.6.4-py2-none-any.whl" }, { "comment_text": "", "digests": { "md5": "db4ca6dcaf8b9bd28b2ebaaa2b3f89a3", "sha256": "54444cb9aa003d5f7eb42abaab01d405ed56ab8920bcfcca4d10775371d318f3" }, "downloads": -1, "filename": "s3import-0.6.4.tar.gz", "has_sig": false, "md5_digest": "db4ca6dcaf8b9bd28b2ebaaa2b3f89a3", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12665, "upload_time": "2016-10-05T08:50:05", "url": "https://files.pythonhosted.org/packages/d0/0e/7720505610cd635cf6ffa85127e67c4eff79141c34ee9953d105f85c9061/s3import-0.6.4.tar.gz" } ] }