{ "info": { "author": "Akiva Miura", "author_email": "akiva.miura@gmail.com", "bugtrack_url": null, "classifiers": [ "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Topic :: Utilities" ], "description": "# LPU\n\n![version](https://img.shields.io/pypi/v/lpu.svg)\n![python](https://img.shields.io/pypi/pyversions/lpu.svg)\n![license](https://img.shields.io/pypi/l/lpu.svg)\n\n`LPU` is a collection of utility classes/functions for language processing\n\n## Installation\n\n### Installing from PyPI release\n\n```shell\n$ pip install --user lpu\n```\n\n### Installing from GitHub master\n\n```shell\n$ pip install --user https://github.com/akivajp/lpu/archive/master.zip\n```\n\n## Modules\n\n### modules in `lpu` package\n\n#### lpu.common.config\n\n inheritable and serializable configurutation classes, useful for calling functions with many arguments\n\n#### lpu.common.environ\n\n handling environment variables with stacks, useful for changing/reverting global settings, such as debugging modes\n\n#### lpu.common.files\n\n utility functions for file handling, including transparent file access of gzip files\n\n#### lpu.common.logging\n\n enhanced logging objects (from standard logging library) with colorizing features and operations with environment variables\n\n#### lpu.common.progress\n\n utility classes and functions for progress reporting (as known as progress bars), working with file-type objects and iterators\n\n#### lpu.smt.align.ibm_models\n\nutility classes to train and estimate word alignemt based on IBM models\n\n## Commands\n\nLPU package also includes directly executable commands \n\n### commands in `lpu` package\n\n#### lpu-abspath\n\n```shell\n $ lpu-abspath [-h] filepath [filepath ...]\n```\n\nget absolute paths of given files or directories\n\n#### lpu-clean-parallel\n\n```shell\n $ lpu-clean-parallel [-h] [--min min_length] [--max max_length] \\\n [--ratio ratio] [--target-directory directory_path] [--escape] \\\n [--normalize] filepath [filepath ...] output_tag\n```\n\n#### lpu-dialog\n\n```shell\n $ lpu-dialog [-h] [--exist filepath] [--continue] [--yes] [--no]\n```\n\nShow message on condition, wait and receive user's response\n\n#### lpu-exec-parallel\n\n```shell\n $ lpu-exec-parallel [-h] [--input filepath] [--output filepath] \\\n [--splitsize num_lines] [--chunks num_files] [--threads num_threads] \\\n [--tmpdir directory_path] [--verbose] [--interval seconds] command\n```\n\nExecute command in multiple processes by splitting the targe file\n\n#### lpu-guess-langcode\n\n```shell\n $ lpu-guess-langcode [-h] filepath [filepath ...]\n```\n\nGuess the language codes from given files\n\n#### lpu-progress\n\n```shell\n $ lpu-progress [-h] [--lines] [--refresh seconds] [--header string] \\\n [filepath filepath ...]]\n```\n\nShow the progress of pipe I/O\n\n#### lpu-random-split\n\n```shell\n $ lpu-random-split [-h] --input filepath [filepath ...] \\\n [--prefixes prefix [prefix ...]] [--suffixes suffix [suffix ...]] \\\n --tags tag [tag ...] --split-sizes size [size ...] [--ignore-empty] \\\n [--quiet] [--debug] [--random-seed seed] [--ids [suffix]]\n```\n\n#### lpu-wait-files\n\n```shell\n $ lpu-wait-files [-h] [--quiet] [--debug] [--delay seconds] \\\n [--interval seconds] [--timeout seconds] filepath [filepath ...]\n```\n\nWait until file will be found\n\n#### lpu-word-align-train\n\n```shell\n $ lpu-word-align-train [-h] [--save-sores filepath] [--decode-align filepath] \\\n [--iteration-limit num_iterations] [--threshold min_probability] \\\n [--nbest integer] [--character] [--debug] [--quiet] \\\n src_path trg_path save_trans_path [save_align_path]\n```\n\n#### lpu-word-align-score\n\n```shell\n $ lpu-word-align-score [-h] [--save-scores filepath] \\\n [--decode-align filepath] [--character] [--debug] [--quiet] \\\n src_path trg_path trans_path [align_path]\n```", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/akivajp/lpu", "keywords": "CL,NLP,computational linguistics,natural language processing", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "lpu", "package_url": "https://pypi.org/project/lpu/", "platform": "", "project_url": "https://pypi.org/project/lpu/", "project_urls": { "Homepage": "https://github.com/akivajp/lpu" }, "release_url": "https://pypi.org/project/lpu/0.2.5/", "requires_dist": null, "requires_python": "", "summary": "A Language Processing Utility", "version": "0.2.5" }, "last_serial": 5871397, "releases": { "0.0.2": [ { "comment_text": "", "digests": { "md5": "a806a04d9a0e15cd2d198af03029066c", "sha256": "237e5f493457864339434da12674f4acd20aaad835863792c5796a0273e9fa42" }, "downloads": -1, "filename": "lpu-0.0.2.tar.gz", "has_sig": false, "md5_digest": "a806a04d9a0e15cd2d198af03029066c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 640812, "upload_time": "2019-01-25T20:57:35", "url": "https://files.pythonhosted.org/packages/af/1e/25220f4cc0b40a38d8f935d026f11b39b9f0cea47171987bf9a552b9f250/lpu-0.0.2.tar.gz" } ], "0.0.4": [ { "comment_text": "", "digests": { "md5": "17ec9cb2edb0fd049fef9cc4f89a82ac", "sha256": "448fe40522bd634294a5f7671d7a5381a1fab7ed082c88fd4c26640a0a2c8e48" }, "downloads": -1, "filename": "lpu-0.0.4.tar.gz", "has_sig": false, "md5_digest": "17ec9cb2edb0fd049fef9cc4f89a82ac", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 940444, "upload_time": "2019-01-30T23:19:34", "url": "https://files.pythonhosted.org/packages/c3/9b/f3ced0aaf3351a2cf4738e885d85602fb9ad71ee7e7eb861b7804edd6218/lpu-0.0.4.tar.gz" } ], "0.0.6": [ { "comment_text": "", "digests": { "md5": "b8351b1ecfbef151ce5a13327ea00d71", "sha256": "0ffbd9f09490a36c1f7f4de45bbad7320e76927119a10d9f288e59638ad655d6" }, "downloads": -1, "filename": "lpu-0.0.6.tar.gz", "has_sig": false, "md5_digest": "b8351b1ecfbef151ce5a13327ea00d71", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 944953, "upload_time": "2019-02-03T12:51:58", "url": "https://files.pythonhosted.org/packages/78/41/bda043b853c3c3f7cf3da41804fc1c4336cdb0fbc9f65576047bed790176/lpu-0.0.6.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "29427682fc1a065719772bc2d601d352", "sha256": "f4afe17b647eb267866099e8759a6a717a522cdb386fb3e4122a6b88756931f9" }, "downloads": -1, "filename": "lpu-0.0.7.tar.gz", "has_sig": false, "md5_digest": "29427682fc1a065719772bc2d601d352", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 944748, "upload_time": "2019-02-04T22:35:59", "url": "https://files.pythonhosted.org/packages/7f/18/1f6193b96e4025223cc98407ee3ca3a685e55ec41ec64a74457c34967253/lpu-0.0.7.tar.gz" } ], "0.1.0": [ { "comment_text": "", "digests": { "md5": "fd677324d7d53464e856b27bb2c97b89", "sha256": "04bbd61c790c72726da9e536f6b061071e0d1e2c9f9f0fd050fad46cd7db36bc" }, "downloads": -1, "filename": "lpu-0.1.0.tar.gz", "has_sig": false, "md5_digest": "fd677324d7d53464e856b27bb2c97b89", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 981899, "upload_time": "2019-02-11T14:52:48", "url": "https://files.pythonhosted.org/packages/7c/d2/29024371e13824d58fb359364e398f20bfa3a65c49562540617adea0006d/lpu-0.1.0.tar.gz" } ], "0.1.1": [ { "comment_text": "", "digests": { "md5": "333f0ebb9f2f7a5d2ff8bbfccebe7b68", "sha256": "3f0d2d7499b4e7a412aa1ada1c0b8a01a51d79e74336b0565837ef15dee9dcd8" }, "downloads": -1, "filename": "lpu-0.1.1.tar.gz", "has_sig": false, "md5_digest": "333f0ebb9f2f7a5d2ff8bbfccebe7b68", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 982306, "upload_time": "2019-02-11T18:26:25", "url": "https://files.pythonhosted.org/packages/18/f6/a083ef8b75cc31889bb2e76317b219375f20ced90107aad352f1c0545e82/lpu-0.1.1.tar.gz" } ], "0.1.2": [ { "comment_text": "", "digests": { "md5": "99c8352dc174055745cfded66f69ccc5", "sha256": "34dce258f4bf7bddb222dd49c9505b4ed0ab35f9fb3e35673a6ce3ce1fb09322" }, "downloads": -1, "filename": "lpu-0.1.2.tar.gz", "has_sig": false, "md5_digest": "99c8352dc174055745cfded66f69ccc5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 983764, "upload_time": "2019-02-17T17:04:43", "url": "https://files.pythonhosted.org/packages/b8/b1/ec7c6593ed9f93837f2315ee532a9472a7bdfd2add9d20c5396f2a0a71db/lpu-0.1.2.tar.gz" } ], "0.1.3": [ { "comment_text": "", "digests": { "md5": "2de442d43b654e7ce4c059db21fce1f2", "sha256": "a5314a078c67181fdc19e422a555d01972a9200031b76a4084a5d921d7542384" }, "downloads": -1, "filename": "lpu-0.1.3.tar.gz", "has_sig": false, "md5_digest": "2de442d43b654e7ce4c059db21fce1f2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 999026, "upload_time": "2019-02-27T23:22:30", "url": "https://files.pythonhosted.org/packages/7c/bc/076a633bf9a8fdacd1f3a08a27f2b76fcc09bb90384628d855c5ff086455/lpu-0.1.3.tar.gz" } ], "0.1.4": [ { "comment_text": "", "digests": { "md5": "2069b58ee4db8ba8d60110f1ca6a8a8a", "sha256": "9a35ddbbff37eb832061f75b652878280670b208f869faa354a91d2477b926bd" }, "downloads": -1, "filename": "lpu-0.1.4.tar.gz", "has_sig": false, "md5_digest": "2069b58ee4db8ba8d60110f1ca6a8a8a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1225055, "upload_time": "2019-03-03T19:56:42", "url": "https://files.pythonhosted.org/packages/94/79/1175a14d50ebbfa0e7d7a12aac36dd24e9e2e2490f13a06a589c6fedc4e7/lpu-0.1.4.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "ed1f276d64cc7269cd4c694abb2adff0", "sha256": "50752e1de3afe45ea511b27b89b419c1e46b8f2ef6dca9cfc916d716a26df0b5" }, "downloads": -1, "filename": "lpu-0.1.5.tar.gz", "has_sig": false, "md5_digest": "ed1f276d64cc7269cd4c694abb2adff0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1225197, "upload_time": "2019-03-03T20:04:29", "url": "https://files.pythonhosted.org/packages/65/29/a2199b1be055b9102ff131807aebb80882ed787f20105bb077f9950ac4b3/lpu-0.1.5.tar.gz" } ], "0.1.6": [ { "comment_text": "", "digests": { "md5": "dc753649aa02909d01ea018adca192e8", "sha256": "12c4baf34ce4298c2fe9443777dda9a3a4576035cc641ee50ef2a26a4a4304f5" }, "downloads": -1, "filename": "lpu-0.1.6.tar.gz", "has_sig": false, "md5_digest": "dc753649aa02909d01ea018adca192e8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1224822, "upload_time": "2019-03-03T23:00:17", "url": "https://files.pythonhosted.org/packages/78/fd/2e970b4337578aff77bf7cf61d55fd62d05dafbc2a9d4d5ef52500e1a963/lpu-0.1.6.tar.gz" } ], "0.1.7": [ { "comment_text": "", "digests": { "md5": "e613a5460c12456b98b0cb556d7e05e5", "sha256": "55f7e8102d01d89582ade936f2da962d1522ec97006e122db5b5a23d0af5b1a7" }, "downloads": -1, "filename": "lpu-0.1.7.tar.gz", "has_sig": false, "md5_digest": "e613a5460c12456b98b0cb556d7e05e5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1244591, "upload_time": "2019-03-10T13:15:52", "url": "https://files.pythonhosted.org/packages/fd/b1/fccd6e38f970a03b1e9fc25aa9f1f301c534ceef063e46d779171f281d62/lpu-0.1.7.tar.gz" } ], "0.1.8": [ { "comment_text": "", "digests": { "md5": "eafeb58ab228600a30878e6fbca2d093", "sha256": "5ae8e0856b3116243833505e51665c9a6426aa662cb83c5770033a7718d6869b" }, "downloads": -1, "filename": "lpu-0.1.8.tar.gz", "has_sig": false, "md5_digest": "eafeb58ab228600a30878e6fbca2d093", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1400038, "upload_time": "2019-06-17T14:05:49", "url": "https://files.pythonhosted.org/packages/c7/7f/963d223c77e85d90e74cf5296a156c24baabbdd334f97a88566987cf37c8/lpu-0.1.8.tar.gz" } ], "0.1.9": [ { "comment_text": "", "digests": { "md5": "72de2dd6fe7eee651590a69a0fdb1140", "sha256": "cba2840e99955d3ed72f2a997b2ef798ee5b46e0a8ff83c153b7c93d805aa944" }, "downloads": -1, "filename": "lpu-0.1.9.tar.gz", "has_sig": false, "md5_digest": "72de2dd6fe7eee651590a69a0fdb1140", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1400611, "upload_time": "2019-07-03T22:40:10", "url": "https://files.pythonhosted.org/packages/a6/1b/5cf30924e96ee450418ca1ca9ef2673237e2b813b3610ff9f03944e7d1ab/lpu-0.1.9.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "ea91785c0b310c54d7422e65fc73d2f5", "sha256": "b8bad62799020f3c234c2c958f547f0b7b4e5437649b075e89308e3e38143261" }, "downloads": -1, "filename": "lpu-0.2.1.tar.gz", "has_sig": false, "md5_digest": "ea91785c0b310c54d7422e65fc73d2f5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2081446, "upload_time": "2019-09-02T23:18:54", "url": "https://files.pythonhosted.org/packages/3f/6d/45f0964d2e47c72bcefaab46fe683f6b6594816ee6ed66694cf247b9c917/lpu-0.2.1.tar.gz" } ], "0.2.2": [ { "comment_text": "", "digests": { "md5": "a7af09962bc108cbe659fe8276711814", "sha256": "374b3804b4a33ea92aed8d24961cacc45d8a4a953456797705813f98c1c5f908" }, "downloads": -1, "filename": "lpu-0.2.2.tar.gz", "has_sig": false, "md5_digest": "a7af09962bc108cbe659fe8276711814", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2129064, "upload_time": "2019-09-09T16:54:54", "url": "https://files.pythonhosted.org/packages/12/72/0dd06f01a2b3b7902c50653badd285c27606d22113cb53e8e2ff2d5fffed/lpu-0.2.2.tar.gz" } ], "0.2.3": [ { "comment_text": "", "digests": { "md5": "ba2bf4894e38eea4513f8d3e95b0b2a0", "sha256": "eb4a8b745a38577b8198974f5087e0727c61a480ccad5116e4fe5aeb9d37bf5c" }, "downloads": -1, "filename": "lpu-0.2.3.tar.gz", "has_sig": false, "md5_digest": "ba2bf4894e38eea4513f8d3e95b0b2a0", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2171428, "upload_time": "2019-09-17T23:10:49", "url": "https://files.pythonhosted.org/packages/2c/b5/35550171ce2738a7ff9d1a8911b47686a923fb030d2bb17c05860b4d9af4/lpu-0.2.3.tar.gz" } ], "0.2.4": [ { "comment_text": "", "digests": { "md5": "e5d9691f97b8d47a4750457e2b7ed960", "sha256": "2ed015a67d059aa098a007ddd47ae95d3ef30bc84a585356a40124172ecbd45d" }, "downloads": -1, "filename": "lpu-0.2.4.tar.gz", "has_sig": false, "md5_digest": "e5d9691f97b8d47a4750457e2b7ed960", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2224489, "upload_time": "2019-09-19T23:37:38", "url": "https://files.pythonhosted.org/packages/04/fc/02ac8e82398a8e944576792d8d1704eeac09ececbb5615855b33395ec85c/lpu-0.2.4.tar.gz" } ], "0.2.5": [ { "comment_text": "", "digests": { "md5": "55cd80cf0559d64898309d5afc3a026e", "sha256": "14b10c0525b79760e3874d8f88cbc34f99be078600853fbc764f253295cba285" }, "downloads": -1, "filename": "lpu-0.2.5-cp36-cp36m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "55cd80cf0559d64898309d5afc3a026e", "packagetype": "bdist_wheel", "python_version": "cp36", "requires_python": null, "size": 2237018, "upload_time": "2019-09-23T04:02:16", "url": "https://files.pythonhosted.org/packages/96/b8/bcf88da85f42e38dd94fcbe501d5980d8e1334b3d5bcdc9775a927610967/lpu-0.2.5-cp36-cp36m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "26411b394455cbfc0d777cd137734806", "sha256": "08107f8d9a459eede7a74f192318421306ce0d80db2fd9e5360a41baecbb4c1c" }, "downloads": -1, "filename": "lpu-0.2.5.tar.gz", "has_sig": false, "md5_digest": "26411b394455cbfc0d777cd137734806", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2222013, "upload_time": "2019-09-23T03:57:18", "url": "https://files.pythonhosted.org/packages/41/10/3d3ded1719bee44d0ab88f6405e61665b70b7d333e109c6d4351d413c3bc/lpu-0.2.5.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "55cd80cf0559d64898309d5afc3a026e", "sha256": "14b10c0525b79760e3874d8f88cbc34f99be078600853fbc764f253295cba285" }, "downloads": -1, "filename": "lpu-0.2.5-cp36-cp36m-macosx_10_14_x86_64.whl", "has_sig": false, "md5_digest": "55cd80cf0559d64898309d5afc3a026e", "packagetype": "bdist_wheel", "python_version": "cp36", "requires_python": null, "size": 2237018, "upload_time": "2019-09-23T04:02:16", "url": "https://files.pythonhosted.org/packages/96/b8/bcf88da85f42e38dd94fcbe501d5980d8e1334b3d5bcdc9775a927610967/lpu-0.2.5-cp36-cp36m-macosx_10_14_x86_64.whl" }, { "comment_text": "", "digests": { "md5": "26411b394455cbfc0d777cd137734806", "sha256": "08107f8d9a459eede7a74f192318421306ce0d80db2fd9e5360a41baecbb4c1c" }, "downloads": -1, "filename": "lpu-0.2.5.tar.gz", "has_sig": false, "md5_digest": "26411b394455cbfc0d777cd137734806", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2222013, "upload_time": "2019-09-23T03:57:18", "url": "https://files.pythonhosted.org/packages/41/10/3d3ded1719bee44d0ab88f6405e61665b70b7d333e109c6d4351d413c3bc/lpu-0.2.5.tar.gz" } ] }