{ "info": { "author": "Salem Harrache", "author_email": "salem.harrache@inria.fr", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Intended Audience :: System Administrators", "License :: OSI Approved :: GNU General Public License (GPL)", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Topic :: Software Development :: Libraries :: Python Modules", "Topic :: System :: Clustering", "Topic :: System :: Monitoring" ], "description": "Colmet - Collecting metrics about jobs running in a distributed environnement\n\nIntroduction:\n-------------\n\nColmet is a monitoring tool to collect metrics about jobs running in a\ndistributed environnement, especially for gathering metrics on clusters and\ngrids. It provides currently several backends :\n - taskstats: fetch task metrics from the linux kernel\n - stdout: display the metrics on the terminal\n - zeromq: transport the metrics across the network\n - hdf5: store the metrics on the filesystem\n\nInstallation:\n-------------\n\nRequirements\n~~~~~~~~~~~~\n\n* a Linux kernel that supports\n - Taskstats\n\n* Python Version 2.7 or newer\n - python-zmq 2.2.0 or newer\n - python-tables 3.3.0 or newer\n - python-pyinotify 0.9.3-2 or newer\n\nInstallation\n~~~~~~~~~~~~\n\nYou can install, upgrade, uninstall colmet with these commands::\n\n $ pip install [--user] colmet\n $ pip install [--user] --upgrade colmet\n $ pip uninstall colmet\n\nOr from git (last development version)::\n\n $ pip install [--user] git+https://github.com/oar-team/colmet.git\n\nOr if you already pulled the sources::\n\n $ pip install [--user] path/to/sources\n\nOr if you don't have pip::\n\n $ easy_install colmet\n\nUsage:\n------\n\nfor the nodes :\n\n sudo colmet-node -vvv --zeromq-uri tcp://127.0.0.1:5556\n\nfor the collector :\n\n colmet-collector -vvv --zeromq-bind-uri tcp://127.0.0.1:5556 --hdf5-filepath /data/colmet.hdf5 --hdf5-complevel 9\n\nYou will see the number of counters retrieved in the debug log.\n\n\nFor more information, please refer to the help of theses scripts (--help)\n\nLicensing:\n----------\n\nThis product is distributed under the GNU General Public License Version2.\nPlease read through the file LICENSE for more information about our license.\n\n\nColmet CHANGELOG\n================\n\nVersion 0.5.4\n-------------\n\nReleased on January 19th 2018\n\n- hdf5 extractor script for OAR RESTFUL API\n- Added infiniband backend\n- Added lustre backend\n- Fixed cpuset_rootpath default always appended\n\nVersion 0.5.3\n-------------\n\nReleased on April 29th 2015\n\n- Removed unnecessary lock from the collector to avoid colmet to wait forever\n- Removed (async) zmq eventloop and added ``--sample-period`` to the collector.\n- Fixed some bugs about hdf file\n\nVersion 0.5.2\n-------------\n\nReleased on Apr 2nd 2015\n\n- Fixed python syntax error\n\n\nVersion 0.5.1\n-------------\n\nReleased on Apr 2nd 2015\n\n- Fixed error about missing ``requirements.txt`` file in the sdist package\n\n\nVersion 0.5.0\n-------------\n\nReleased on Apr 2nd 2015\n\n- Don't run colmet as a daemon anymore\n- Maintained compatibility with zmq 3.x/4.x\n - Dropped ``--zeromq-swap`` (swap was dropped from zmq 3.x)\n - Handled zmq name change from HWM to SNDHWM and RCVHWM\n- Fixed requirements\n- Dropped python 2.6 support\n\nVersion 0.4.0\n-------------\n\n- Saved metrics in new HDF5 file if colmet is reloaded in order to avoid HDF5 data corruption\n- Handled HUP signal to reload ``colmet-collector``\n- Removed ``hiwater_rss`` and ``hiwater_vm`` collected metrics.\n\n\nVersion 0.3.1\n-------------\n\n- New metrics ``hiwater_rss`` and ``hiwater_vm`` for taskstats\n- Worked with pyinotify 0.8\n- Added ``--disable-procstats`` option to disable procstats backend.\n\n\nVersion 0.3.0\n-------------\n\n- Divided colmet package into three parts\n\n - colmet-node : Retrieve data from taskstats and procstats and send to\n collectors with ZeroMQ\n - colmet-collector : A collector that stores data received by ZeroMQ in a\n hdf5 file\n - colmet-common : Common colmet part.\n- Added some parameters of ZeroMQ backend to prevent a memory overflow\n- Simplified the command line interface\n- Dropped rrd backend because it is not yet working\n- Added ``--buffer-size`` option for collector to define the maximum number of\n counters that colmet should queue in memory before pushing it to output\n backend\n- Handled SIGTERM and SIGINT to terminate colmet properly\n\nVersion 0.2.0\n-------------\n\n- Added options to enable hdf5 compression\n- Support for multiple job by cgroup path scanning\n- Used Inotify events for job list update\n- Don't filter packets if no job_id range was specified, especially with zeromq\n backend\n- Waited the cgroup_path folder creation before scanning the list of jobs\n- Added procstat for node monitoring through fictive job with 0 as identifier\n- Used absolute time take measure and not delay between measure, to avoid the\n drift of measure time\n- Added workaround when a newly cgroup is created without process in it\n (monitoring is suspended upto one process is launched)\n\n\nVersion 0.0.1\n-------------\n\n- Conception\n", "description_content_type": null, "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://oar.imag.fr/", "keywords": "monitoring", "license": "GNU GPL", "maintainer": "", "maintainer_email": "", "name": "colmet", "package_url": "https://pypi.org/project/colmet/", "platform": "Linux", "project_url": "https://pypi.org/project/colmet/", "project_urls": { "Homepage": "http://oar.imag.fr/" }, "release_url": "https://pypi.org/project/colmet/0.5.4/", "requires_dist": null, "requires_python": "", "summary": "A utility to monitor the jobs ressources in a HPC environment, espacially OAR", "version": "0.5.4" }, "last_serial": 3523679, "releases": { "0.3.0": [ { "comment_text": "", "digests": { "md5": "962ee2b5dbdebaee114a98e6b1581203", "sha256": "84d8d55ce83fabeb1ced304e712c0b8b8942e651de2489dea179df9c8bf6f3dc" }, "downloads": -1, "filename": "colmet-0.3.0.tar.gz", "has_sig": false, "md5_digest": "962ee2b5dbdebaee114a98e6b1581203", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 35440, "upload_time": "2014-05-21T15:10:16", "url": "https://files.pythonhosted.org/packages/89/3c/573df8e6a18a1f52e5b7eecef6c6d96e2fa327f4f413e64681cf232d1916/colmet-0.3.0.tar.gz" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "4c4b54470394820b9fea400beefb0172", "sha256": "801e3a868886f3c6b1367f003918b7a41a850f5dc9f285c907bc4766f67cda92" }, "downloads": -1, "filename": "colmet-0.3.1.tar.gz", "has_sig": false, "md5_digest": "4c4b54470394820b9fea400beefb0172", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 33731, "upload_time": "2014-05-26T15:27:29", "url": "https://files.pythonhosted.org/packages/35/54/20dd43e0ec23dfd93b1740712779e68a238a3b1d2a7dd6110cb0eafe12ef/colmet-0.3.1.tar.gz" } ], "0.4.0": [ { "comment_text": "", "digests": { "md5": "167f3ea46f4be42a5baa97fca7e25ad1", "sha256": "3b6fa31d797ef272bf5558dd4b958afe49e5a5c65e37ecca4a11080b2c0b9d2a" }, "downloads": -1, "filename": "colmet-0.4.0.tar.gz", "has_sig": false, "md5_digest": "167f3ea46f4be42a5baa97fca7e25ad1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 32413, "upload_time": "2015-03-31T21:03:26", "url": "https://files.pythonhosted.org/packages/da/b6/bbdf09575e49cf8105fc9b4492ddc45d3ebe8d9fb0a71f1f5c3e40c1f301/colmet-0.4.0.tar.gz" } ], "0.5.0": [ { "comment_text": "", "digests": { "md5": "8fcb686b78cf24a994099eee43d17fa7", "sha256": "936c9f9babeaa3e47823734969251cd8749e700e6f1b9e4d8add3b8148838ef1" }, "downloads": -1, "filename": "colmet-0.5.0.tar.gz", "has_sig": false, "md5_digest": "8fcb686b78cf24a994099eee43d17fa7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 30111, "upload_time": "2015-04-02T14:33:57", "url": "https://files.pythonhosted.org/packages/8c/08/d2d819b2a7daa84dc66e0d01308e707c33b7a3d87e0b44b34bf23ffbc67c/colmet-0.5.0.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "258c463af59a6b2026443e3a46ec323f", "sha256": "2015043f803a9f0184065372ce8e7689a8b7fde08fe0a24eb08f956ffa826ac6" }, "downloads": -1, "filename": "colmet-0.5.1.tar.gz", "has_sig": false, "md5_digest": "258c463af59a6b2026443e3a46ec323f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 30186, "upload_time": "2015-04-02T14:53:10", "url": "https://files.pythonhosted.org/packages/6a/f8/0653c8cf0e5bc358943d7a25455b156b3d149814526df633de7edf9b6979/colmet-0.5.1.tar.gz" } ], "0.5.2": [ { "comment_text": "", "digests": { "md5": "7c4abd612150e71cf592321c6ff6eb47", "sha256": "dff965c2847281a3e7844c290aed13332003c663f84204df2b7b3e84f58188f1" }, "downloads": -1, "filename": "colmet-0.5.2.tar.gz", "has_sig": false, "md5_digest": "7c4abd612150e71cf592321c6ff6eb47", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 30087, "upload_time": "2015-04-02T15:13:31", "url": "https://files.pythonhosted.org/packages/50/90/925b8144b8bb9bb533d96991fcd4ad8b09c337e302bcd1205c5af1ae5124/colmet-0.5.2.tar.gz" } ], "0.5.3": [ { "comment_text": "", "digests": { "md5": "130e87ab36e8592e08895bb4cab80f63", "sha256": "003825ba8d38d573f7cc1407201a337751e2010e26add48264c579576cf2cc37" }, "downloads": -1, "filename": "colmet-0.5.3.tar.gz", "has_sig": false, "md5_digest": "130e87ab36e8592e08895bb4cab80f63", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 30306, "upload_time": "2015-04-29T15:50:32", "url": "https://files.pythonhosted.org/packages/dd/9b/ff52c2842e0ae261703285d34c7f53f9bffb8c2b9d080d5002f775d0180f/colmet-0.5.3.tar.gz" } ], "0.5.4": [ { "comment_text": "", "digests": { "md5": "1f1795071d2709be3ccd61a8706a3422", "sha256": "a39aec75440167dd5f71ae0e97be7e5435217be1221564d1f878045547d73c60" }, "downloads": -1, "filename": "colmet-0.5.4.tar.gz", "has_sig": false, "md5_digest": "1f1795071d2709be3ccd61a8706a3422", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 32271, "upload_time": "2018-01-26T10:22:43", "url": "https://files.pythonhosted.org/packages/05/fd/647744b4b7dd60bbb5ecad612b10a52adab1b928c6c5f35becd673f05465/colmet-0.5.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "1f1795071d2709be3ccd61a8706a3422", "sha256": "a39aec75440167dd5f71ae0e97be7e5435217be1221564d1f878045547d73c60" }, "downloads": -1, "filename": "colmet-0.5.4.tar.gz", "has_sig": false, "md5_digest": "1f1795071d2709be3ccd61a8706a3422", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 32271, "upload_time": "2018-01-26T10:22:43", "url": "https://files.pythonhosted.org/packages/05/fd/647744b4b7dd60bbb5ecad612b10a52adab1b928c6c5f35becd673f05465/colmet-0.5.4.tar.gz" } ] }