{ "info": { "author": "Ken Farmer", "author_email": "kenfar@gmail.com", "bugtrack_url": null, "classifiers": [ "Programming Language :: Python :: 2.7", "Programming Language :: Python :: Implementation :: CPython", "Programming Language :: Python :: Implementation :: PyPy" ], "description": "BuffaloFQ - a method of moving files via a file system queue\n============================================================\n\nThe objective of BuffaloFQ is to provide a very simple and reliable\nmethod of moving files around an architecture.\n\nBackground, Examples, and FAQ\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nPlease see the Wiki: https://github.com/kenfar/buffalofq/wiki\n\nInstallation:\n~~~~~~~~~~~~~\n\n$ pip install buffalofq\n\nConfiguration:\n~~~~~~~~~~~~~~\n\nMost configuration is handled through a simple yaml file, that is kept\nin the xdg-compliant config directory. On linux this would be:\n\n- $HOME/.config/buffalofq\\_mover/[config-name1].yml\n- $HOME/.config/buffalofq\\_mover/[config-name2].yml\n- $HOME/.config/buffalofq\\_mover/[config-name3].yml\n\nConfig example:\n\n- name: ids\\_to\\_load #\n- status: enabled # choices are: enabled, disabled\n- polling\\_seconds: None # delay in seconds between checks for new\n files, defaults to 300\n- limit\\_total: -1 # choices: -1 (run continuously), 0 (run until\n source\\_dir is empty), [some number] run until this number have been\n moved.\n- port: None # defaults to 22\n- key\\_filename: None # defaults to id\\_buffalofq\\_rsa\n- log\\_dir: /data/logs # location buffalofq\\_mover will write its logs\n- log\\_level: None # choices are: info, warning, error, critical,\n defaults to debug\n- sort\\_key: time # choices are: None, name, or name of a field within\n filename, defaults to None\n- source\\_host: localhost # must be localhost at this time\n- source\\_user: None # not yet used, defaults to current userid\n- source\\_dir: /data/output #\n- source\\_fn: '\\*' # wild-card for selecting source files\n- source\\_post\\_dir: /data/archive #\n- source\\_post\\_action: move # choices: move, delete, None\n- dest\\_host: datawarehouse #\n- dest\\_user: None # used to log into dest\\_host, defaults to current\n userid\n- dest\\_dir: /data/input #\n- dest\\_fn: None # needed if dest\\_post\\_action is symlink or move\n- dest\\_post\\_dir: None # not used yet\n- dest\\_post\\_action: None # choices: symlink, move, None\n\nRun:\n~~~~\n\nTo run once, you can simply run it like:\n\n- $ ./buffalofq\\_mover --config-name [config-name1]\n\nA trivial way to keep it running continuously:\n\n- $ nohup ./buffalofq\\_mover --config-name [config-name1] &\n\n\n\n0.0.3 - add dest\\_post\\_action of move - change config values of pass to\nNone - add config defaults & validation - housekeeping\n\n0.0.2 - initial genuinely usable working version - add ability to\nreceive files in order of their name, or any field within the name - add\nability to provide name of ssh key to use - rename audit file &\nbuffalofq program to buffalofq\\_mover - misc general improvements and\nrefactorings\n\n0.0.1 - initial working version", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://github.com/kenfar/buffalofq", "keywords": "data management file utility", "license": "BSD", "maintainer": "", "maintainer_email": "", "name": "buffalofq", "package_url": "https://pypi.org/project/buffalofq/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/buffalofq/", "project_urls": { "Homepage": "http://github.com/kenfar/buffalofq" }, "release_url": "https://pypi.org/project/buffalofq/0.0.3/", "requires_dist": null, "requires_python": "", "summary": "File movement utility", "version": "0.0.3" }, "last_serial": 1902069, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "11775addf74fd6fb01c0abd68be2c665", "sha256": "e58264a35509496e01dc59cc4d1d873d897cad135d83ec0e926a1c34963d47d3" }, "downloads": -1, "filename": "buffalofq-0.0.1.tar.gz", "has_sig": false, "md5_digest": "11775addf74fd6fb01c0abd68be2c665", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8842, "upload_time": "2016-01-08T05:12:09", "url": "https://files.pythonhosted.org/packages/0b/14/f71c8b927773a94e3b52684ef6bd15a432d0c6a2f212a868ba3a2eed301f/buffalofq-0.0.1.tar.gz" } ], "0.0.2": [ { "comment_text": "", "digests": { "md5": "1aec56b110f7a0bf49f7b3e9b46049bd", "sha256": "2a17578fb57c66a10d073b9034ea8167096383e1a097e9d5375a4e4eeb774150" }, "downloads": -1, "filename": "buffalofq-0.0.2.tar.gz", "has_sig": false, "md5_digest": "1aec56b110f7a0bf49f7b3e9b46049bd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 10616, "upload_time": "2016-01-10T07:06:09", "url": "https://files.pythonhosted.org/packages/0d/7e/bcbd628682fee7e6b004e9ccc91cb6dbbccf2a212e09f22c0fb4a9f758d2/buffalofq-0.0.2.tar.gz" } ], "0.0.3": [ { "comment_text": "", "digests": { "md5": "13a7285c7af939bb2403d945219d9e54", "sha256": "4ff609c579b07c286396137361fed90a80bcd109df9e0f051ab688ddc62e9cf2" }, "downloads": -1, "filename": "buffalofq-0.0.3.tar.gz", "has_sig": false, "md5_digest": "13a7285c7af939bb2403d945219d9e54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11540, "upload_time": "2016-01-13T04:50:45", "url": "https://files.pythonhosted.org/packages/30/df/54ac3062468c11e85a9f70fa3edf734ca2f31a9ffa269254da259dc9c94d/buffalofq-0.0.3.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "13a7285c7af939bb2403d945219d9e54", "sha256": "4ff609c579b07c286396137361fed90a80bcd109df9e0f051ab688ddc62e9cf2" }, "downloads": -1, "filename": "buffalofq-0.0.3.tar.gz", "has_sig": false, "md5_digest": "13a7285c7af939bb2403d945219d9e54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11540, "upload_time": "2016-01-13T04:50:45", "url": "https://files.pythonhosted.org/packages/30/df/54ac3062468c11e85a9f70fa3edf734ca2f31a9ffa269254da259dc9c94d/buffalofq-0.0.3.tar.gz" } ] }