{ "info": { "author": "Jeremies P\u00e9rez Morata", "author_email": "jeremiespm@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Intended Audience :: Developers", "License :: OSI Approved :: GNU General Public License v3 (GPLv3)", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3.5", "Programming Language :: Python :: 3.6", "Topic :: Text Processing", "Topic :: Text Processing :: Filters", "Topic :: Text Processing :: General", "Topic :: Text Processing :: Indexing", "Topic :: Text Processing :: Linguistic" ], "description": " # nlptools\n*nlptools* are an Unix inspired utilities for Natural Language Processing.\n\n- [Examples](#examples)\n - [Basic tokenization](#basic-tokenization)\n - [Lemmatization and Stemming](#lemmatization-and-stemming)\n - [Basic features](#basic-features)\n - [Data fetching](#data-fetching)\n- [Documentation](#documentation)\n - [Commands](#commands)\n - [Cookbook](#cookbook)\n\n## Examples\n\n### Basic tokenization\n\n```bash\necho \"Hello world!\" | proc-tkn\n\n# Result:\n#\n# Hello\n# world\n# !\n```\n\n### Lemmatization and Stemming\n\n```bash\necho \"dog dogs\" | bin/proc-tkn | bin/proc-lmtz\n\n# Result:\n#\n# dog\n# dog\n```\n\n### Basic features\n\n```bash\necho \"Roses are red. Violets are blue. Sugar is sweet. And so are you.\" \\\n | proc-tkn \\\n | proc-lmtz \\\n | feat-tfidf --type idf --sep .\n\n# Result\n#\n# and 0.0 0.0 0.0 1.0\n# are 0.4444444444444444 0.4444444444444444 0.0 0.3333333333333333\n# blue 0.0 1.3333333333333333 0.0 0.0\n# is 0.0 0.0 1.3333333333333333 0.0\n# red 1.3333333333333333 0.0 0.0 0.0\n# roses 1.3333333333333333 0.0 0.0 0.0\n# so 0.0 0.0 0.0 1.0\n# sugar 0.0 0.0 1.3333333333333333 0.0\n# sweet 0.0 0.0 1.3333333333333333 0.0\n# violets 0.0 1.3333333333333333 0.0 0.0\n# you 0.0 0.0 0.0 1.0\n```\n\n### Data fetching\n```bash\nfetch-url https://www.gutenberg.org/files/996/old/1donq10.txt \\\n | proc-tkn \\\n | sort \\\n | uniq -c\n\n# Result\n#\n# 5312 ``\n# 1 ~\n# 1 <\n# 1 =\n# 1 >\n# 1 _\n# 40 -\n# 36793 ,\n# 6057 ;\n# 370 :\n# 677 !\n# 970 ?\n# 1 /\n# 7723 .\n# 1 ...\n# 503 '\n# 1 '-\n# 5222 ''\n# 209 (\n# 209 )\n# 20 [\n# 20 ]\n# .....\n```\n\n## Documentation\n\n### [Commands](doc/commands.md)\n### [CookBook](doc/cookbook.md)\n", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/jepemo/nlptools", "keywords": "NLP", "license": "GPL-v3", "maintainer": "", "maintainer_email": "", "name": "nlptools", "package_url": "https://pypi.org/project/nlptools/", "platform": "", "project_url": "https://pypi.org/project/nlptools/", "project_urls": { "Homepage": "https://github.com/jepemo/nlptools" }, "release_url": "https://pypi.org/project/nlptools/0.5.1/", "requires_dist": null, "requires_python": "", "summary": "Unix inspired utilities for Natural Language Processing", "version": "0.5.1" }, "last_serial": 3062336, "releases": { "0.5.1": [ { "comment_text": "", "digests": { "md5": "b865a8001ab3f541de6991b2ecad3129", "sha256": "3c2de873634566fea1da0a2e3ebf01cf6b54725e784954cb78a961d5246b8a93" }, "downloads": -1, "filename": "nlptools-0.5.1.tar.gz", "has_sig": false, "md5_digest": "b865a8001ab3f541de6991b2ecad3129", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7382, "upload_time": "2017-07-31T18:50:00", "url": "https://files.pythonhosted.org/packages/a1/a7/62a8f60e5c3fb4f2708c63d51ed74b9f56b93fde3c3151a1d48f2ccc7034/nlptools-0.5.1.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "b865a8001ab3f541de6991b2ecad3129", "sha256": "3c2de873634566fea1da0a2e3ebf01cf6b54725e784954cb78a961d5246b8a93" }, "downloads": -1, "filename": "nlptools-0.5.1.tar.gz", "has_sig": false, "md5_digest": "b865a8001ab3f541de6991b2ecad3129", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 7382, "upload_time": "2017-07-31T18:50:00", "url": "https://files.pythonhosted.org/packages/a1/a7/62a8f60e5c3fb4f2708c63d51ed74b9f56b93fde3c3151a1d48f2ccc7034/nlptools-0.5.1.tar.gz" } ] }