{ "info": { "author": "CMScom", "author_email": "terada@cmscom.jp", "bugtrack_url": null, "classifiers": [ "Framework :: Plone", "Programming Language :: Python", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "Introduction\n------------------------------\n\nSpecification:\nText character normalization process uses Python unicodedata.\nConvert full-width numeric and alphabet character into half-width equivalent.\nConvert half-width Katakana into full-width equivalent.\nTherefore all of above character variations can be recognized as same ones.\n\nLanguage Specifications:\n\n- Chinese\n\n - No space between words.\n - There is only Kanji(Chinese) character\n - Process\twith Bigram(2-gram) model\n\n- Japanese\n\n - No space between words\n - Combination 0f Kanji(Chinese), Katakana, and Hiragana character\n\n- Korean\n\n - There are spaces between words, but it contains a particle\n - Combination of Korean alphabet and Kanji(Chinese) character\n - Discriminate Korean alphabet and Kanji(Chinese) character and processed with Bigram(2-gram) model\n\n- Thai\n\n - No space between words\n - It's very difficult to handle this language in a computer\n - A vowel and a consonant are registered in Unicode separately so that it is difficult to recognize as one word.\n - However, there is a possibility of dealing with Thai characters to use Bigram(2-gram) model.\n\n- Other languages (Including English)\n\n - There is a space between words\n\n - It is indexed each word\n\nNotes:\n\n- Source Code\n\n Since no documents are available on how to develop 'word splitter', we refer to other splitter source code. But I still have a number of questions. If you have any more information, please feel free let us know.\n\n- Hotfix to Plone 3.0 source code\n\n Because Plone 3.x catalog setting, catalog.xml, doesn't have existing index overwrite mechanism, we developed hotfix and added XML attribute. We believe Plone 3 XML define mechanism is simple and clear, so that we take this approach. We appreciate any comment.\n\n\nInstallation\n-----------------\nUse zc.buildout\n===============\n- Add ``Products.BigramSplitter`` to the list of eggs to install, e.g.::\n\n [buildout]\n ...\n eggs =\n ...\n Products.BigramSplitter\n \n- Tell the plone.recipe.zope2instance recipe to install a ZCML slug::\n\n [instance]\n recipe = plone.recipe.zope2instance\n ...\n zcml =\n Products.BigramSplitter\n \n- Re-run buildout, e.g. with::\n\n $ ./bin/buildout\n\n- Restart Zope\n- Plone setting -- Add on products -- Quick install\n\n\nOld Style\n=========\n- Untar downloaded file, then copy to 'Products' directory of your Plone instance.\n- Restart Zope\n- Plone setting -- Add on products -- Quick install\n\n\nRequired\n--------\n- Plone3.0.x or higher\n\nLicense\n--------\n- See docs/LICENSE.txt\n\nAuthor\n------\n- CMScom http://www.cmscom.jp/\n\n - Manabu Terada e-mail : terada@cmscom.jp\n - Mikio Hokari\n - Naoki Nakanishi\n - Naotaka Hotta\n - Takashi Nagai\n\n\n\nChangelog\n=========\n\n1.0 (2010-12-06)\n---------------------\n\n* Adding uninstall script\n\n1.0b4 (2010-06-07)\n---------------------\n\n* Fixed missing skin folder name\n\n\n1.0b3 (2010-03-20)\n---------------------\n\n* Adding keyword highlight (JavaScript)\n\n\n1.0a2 (2010-01-29)\n---------------------\n\n* Fixed full width space for and search\n\n\n\n1.0a1 (2009-12-05)\n---------------------\n\n* Initial release", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://www.cmscom.jp/", "keywords": "Plone Zope Splitter Japanese", "license": "GPL", "maintainer": null, "maintainer_email": null, "name": "Products.BigramSplitter", "package_url": "https://pypi.org/project/Products.BigramSplitter/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/Products.BigramSplitter/", "project_urls": { "Download": "UNKNOWN", "Homepage": "http://www.cmscom.jp/" }, "release_url": "https://pypi.org/project/Products.BigramSplitter/1.0/", "requires_dist": null, "requires_python": null, "summary": "'BigramSplitter' is add-on search product for Plone 3.x. It supports non-English languages, especially south east Asian languages.", "version": "1.0" }, "last_serial": 784983, "releases": { "1.0": [ { "comment_text": "", "digests": { "md5": "ba6109b5e3ba64ec242d20714d5ad52c", "sha256": "c144efd5d85b34cb4d90f0e6e9b854b40fa95f154c8ab72aeb02ba460a88d384" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0-py2.4.egg", "has_sig": false, "md5_digest": "ba6109b5e3ba64ec242d20714d5ad52c", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 39594, "upload_time": "2010-12-06T15:29:54", "url": "https://files.pythonhosted.org/packages/0d/f9/45e1465769b728cad47aa2ac1e2a6358037cf40bb2e49f065364e2765806/Products.BigramSplitter-1.0-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "a417dbca63fbb31e198d61e47a6228c8", "sha256": "83cd6d6323e4771c6f289cf212f9a10dffaec771a2b427d41c13dce83f1771b4" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0.tar.gz", "has_sig": false, "md5_digest": "a417dbca63fbb31e198d61e47a6228c8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 22057, "upload_time": "2010-12-06T15:29:52", "url": "https://files.pythonhosted.org/packages/bf/c7/21741f17ba89dafa0a5ea673e4f69cb35900ffc39fb91d01fbf5930e5634/Products.BigramSplitter-1.0.tar.gz" } ], "1.0b1": [ { "comment_text": "", "digests": { "md5": "d2fc55c2a856581786b6848313b1c072", "sha256": "d99a2d2809abbc99444d2d42c88dcc585579c546559462a5070904e28ffd6577" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b1-py2.4.egg", "has_sig": false, "md5_digest": "d2fc55c2a856581786b6848313b1c072", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 35483, "upload_time": "2009-12-05T07:37:25", "url": "https://files.pythonhosted.org/packages/2c/49/6cda95b3f5313e6da5cd58f74696c235f65571ff637448453ff0a116bb09/Products.BigramSplitter-1.0b1-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "20d2ad4a606ee992a7b66a764a2c5df1", "sha256": "92a2522dbd7a3c30e8406da9987b73d4b6ab07bff0a342599e6342e5d4b9f0d2" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b1.tar.gz", "has_sig": false, "md5_digest": "20d2ad4a606ee992a7b66a764a2c5df1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 25599, "upload_time": "2009-12-05T07:37:21", "url": "https://files.pythonhosted.org/packages/68/3b/f69cede4f9543112661db4fad74717dbaeac742030ecdfe983650767be73/Products.BigramSplitter-1.0b1.tar.gz" } ], "1.0b2": [ { "comment_text": "", "digests": { "md5": "82ba224faef915f249c7b2ff7c9bdbd6", "sha256": "bce4e67aaccaeca06ca332b51704cba9eee54bb95a8264d124a7c0b9727666de" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b2-py2.4.egg", "has_sig": false, "md5_digest": "82ba224faef915f249c7b2ff7c9bdbd6", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 36503, "upload_time": "2010-01-29T11:15:53", "url": "https://files.pythonhosted.org/packages/16/f8/bde5d173afa27f28503eedb8b4483db0eb3ae82a5770d2883d6a5159db11/Products.BigramSplitter-1.0b2-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "c910e0595e390f191c85baf2dccfbf61", "sha256": "ca8738821b8f082a3ddb25de365279604b6479739f22aba568c8812acad8d714" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b2.tar.gz", "has_sig": false, "md5_digest": "c910e0595e390f191c85baf2dccfbf61", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 25738, "upload_time": "2010-01-29T11:15:41", "url": "https://files.pythonhosted.org/packages/78/03/9ecd72431a7e852e5ef41c7cf60ea8ec1887ac4056c97cb0f83573b89e07/Products.BigramSplitter-1.0b2.tar.gz" } ], "1.0b3": [ { "comment_text": "", "digests": { "md5": "7b1846decbdbbcbd79e8cef01f6b0bfc", "sha256": "9eb25e2b434dd727807115fa2acc9d33c7a21ca97a19091fdb3fd4090276b231" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b3-py2.4.egg", "has_sig": false, "md5_digest": "7b1846decbdbbcbd79e8cef01f6b0bfc", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 38480, "upload_time": "2010-03-20T07:59:06", "url": "https://files.pythonhosted.org/packages/97/ba/af5bae480e8b43574c371d15ff8288f33ef1d200b6081c005adcce18b008/Products.BigramSplitter-1.0b3-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "ca11722b51cd7cb5ec46c14e5a045c54", "sha256": "6b04676820c21fd468dd9585f34bc5ad5534e6185598ddc3a9892ec98c309815" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b3.tar.gz", "has_sig": false, "md5_digest": "ca11722b51cd7cb5ec46c14e5a045c54", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 28429, "upload_time": "2010-03-20T07:59:03", "url": "https://files.pythonhosted.org/packages/31/7a/54d5f103ba1782a2eb0d0f5efed26a5b10dc394787f7c296962b3d85d3d2/Products.BigramSplitter-1.0b3.tar.gz" } ], "1.0b4": [ { "comment_text": "", "digests": { "md5": "90597e7ee0fe9d50b1d14674f2976319", "sha256": "e5018af2e473b6c4da034a3bbf0ec9d5f8e4f12e4568acc19ac096b00f81e2b0" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b4-py2.4.egg", "has_sig": false, "md5_digest": "90597e7ee0fe9d50b1d14674f2976319", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 38543, "upload_time": "2010-06-07T05:13:24", "url": "https://files.pythonhosted.org/packages/f0/ec/81c0dce9cb758b5e39d82e22d9c3a5bf0fc3e2e8785141b00fa660503a39/Products.BigramSplitter-1.0b4-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "cd016c97e2d2e7af1a5836dad27a14ab", "sha256": "c723e6bfd5a626810ded08920e1e1e566639cdacf4ee1948be0389544e4695d0" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0b4.tar.gz", "has_sig": false, "md5_digest": "cd016c97e2d2e7af1a5836dad27a14ab", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 22361, "upload_time": "2010-06-07T05:13:22", "url": "https://files.pythonhosted.org/packages/89/23/3135c184684cd8d801a2d7490749fd55a88e83fa556b34c1551e25caa020/Products.BigramSplitter-1.0b4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ba6109b5e3ba64ec242d20714d5ad52c", "sha256": "c144efd5d85b34cb4d90f0e6e9b854b40fa95f154c8ab72aeb02ba460a88d384" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0-py2.4.egg", "has_sig": false, "md5_digest": "ba6109b5e3ba64ec242d20714d5ad52c", "packagetype": "bdist_egg", "python_version": "2.4", "requires_python": null, "size": 39594, "upload_time": "2010-12-06T15:29:54", "url": "https://files.pythonhosted.org/packages/0d/f9/45e1465769b728cad47aa2ac1e2a6358037cf40bb2e49f065364e2765806/Products.BigramSplitter-1.0-py2.4.egg" }, { "comment_text": "", "digests": { "md5": "a417dbca63fbb31e198d61e47a6228c8", "sha256": "83cd6d6323e4771c6f289cf212f9a10dffaec771a2b427d41c13dce83f1771b4" }, "downloads": -1, "filename": "Products.BigramSplitter-1.0.tar.gz", "has_sig": false, "md5_digest": "a417dbca63fbb31e198d61e47a6228c8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 22057, "upload_time": "2010-12-06T15:29:52", "url": "https://files.pythonhosted.org/packages/bf/c7/21741f17ba89dafa0a5ea673e4f69cb35900ffc39fb91d01fbf5930e5634/Products.BigramSplitter-1.0.tar.gz" } ] }