{ "info": { "author": "Louis Plissonneau", "author_email": "louis.plissonneau@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "Environment :: Console", "Intended Audience :: Science/Research", "Operating System :: MacOS :: MacOS X", "Operating System :: Microsoft", "Operating System :: OS Independent", "Operating System :: POSIX", "Programming Language :: Python :: 2", "Topic :: Internet" ], "description": "======\nPYTOMO\n======\n\nPytomo is a YouTube crawler designed to figure out network information out of\nYouTube video download.\n\n\nUsage\n-----\n\n- Video crawl:\nstart_crawl.py [-r max_rounds] [-u max_crawled_url] [-p max_per_url] [-P\nmax_per_page] [-t time_frame] [-n ping_packets] [-D download_time] [-B\nbuffering_video_duration] [-M min_playout_buffer_size] [-x] [-L log_level] [-R]\n[input_urls]\nOptions:\n -h, --help show this help message and exit\n -r MAX_ROUNDS Max number of rounds to perform (default 10000)\n -l, --loop Loop after completing the max nb of rounds\n -u MAX_CRAWLED_URL Max number of urls to visit (default 5000000)\n -p MAX_PER_URL Max number of related urls from each page (default 20)\n -P MAX_PER_PAGE Max number of related videos from each page (default\n 20)\n -t TIME_FRAME Timeframe for the most popular videos to fetch at\n start of crawl put 'today', 'week', 'month' or\n 'all_time' (default 'week')\n -n PING_PACKETS Number of packets to be sent for each ping (default\n 10)\n -D DOWNLOAD_TIME Download time for the video in seconds (default\n 30.000000)\n -B INITIAL_PLAYBACK_DURATION \n Buffering video duration in seconds (default\n 2000.000000)\n -M MIN_PLAYOUT_BUFFER_SIZE\n Minimum Playout Buffer Size in seconds (default\n 0.100000)\n -x Do NOT store public IP address of the machine in the\n logs\n -L LOG_LEVEL The log level setting for the Logging module.Choose\n from: 'DEBUG', 'INFO', 'WARNING', 'ERROR' and\n 'CRITICAL' (default 'DEBUG')\n --http-proxy=PROXIES in case of http proxy to reach Internet (default None)\n --provider=PROVIDER Indicate the ISP\n -R, --no-related Do NOT crawl related videos (stays with the first urls\n found: either most popular or arguments given)\n\n- Graphical web interface to display graphs about the crawled data:\nstart_server.py [-v] [-f database] [-d database_directory] port\nOptions:\n -h, --help show this help message and exit\n -v, --verbose run as verbose mode\n -f DB_NAME, --file=DB_NAME\n run on a specific database (by default the latest\n database in the default database directory is\n selected)\n -d DB_DIR_NAME, --dir=DB_DIR_NAME\n run on a specific directory where the latest database\n will be selected\n\n\nInstallation-free\n-----------------\nIn order to provide installation-free package, we provide binary executables\nfor Linux (32 and 64bits), Windows, and Mac OS X.\nThe binaries files were generated with Pyinstaller_ (version 1.5RC1).\n\nIf you have Python installed, you can directly run the 'start_crawl.py' script at\nroot or the pytomo script in bin directory.\n\nIf you have Python installed and the RRDtool and webpy python bindings, you can\ndirectly run the 'start_server.py' script at root - you need to specify a port\non which to start the server and then connect to that port on the respective\nhost from your favourite browser. For example, you start the graphical web\ninterface on port 5555:\n $ ./start_server.py 5555\nYou will then connect on the respective machine (you need to know its IP and\nmake sure it allows external connections, otherwise you will only be able to\nsee the graphs locally on that machine):\n http://127.0.0.1:5555/ <= visualisation on local machine\n http://10.193.224.73:5555/ <= visualisation from remote host\nBy default, the graphs are collected with information from the latest database\nin the default database directory. If a new live crawl is started, it is\nrecommened to stop and start again the graphical web interface and refresh the\npage from your browser.\n\n\nExternal Resources\n------------------\n\nWe based the lib_youtube_download on `YouTube Download`_ script: we simplified\nit at most and include only the classes we needed (and only YouTube video\nretrieval).\n\nThe dns module is taken from the `DNS Python Package`_: we just modified rdata\nso that Pyinstaller_ include all needed modules.\n\nThe extraction of metadata out of video files is an adaptation of `Kaa Metadata\nPython Package`_: it has been modified in order to be independent of Kaa-base\n(thus pure Python and portable).\n\nThe graphical web interface requires the following external resources, that we\nrecommend you to install from the repository of your OS distribution:\na) RRDtool python binding\n- For Debian based OS:\n sudo apt-get install python-rrdtool\n- For RHEL based OS:\n yum install python-rrdtool\nb) webpy\n- For Debian based OS:\n sudo apt-get install python-webpy\n- For RHEL based OS:\n yum install python-webpy\n\n\nExternal Links\n~~~~~~~~~~~~~~\n\n1. `YouTube Download`_.\n2. `Kaa Metadata Python Package`_.\n3. `DNS Python Package`_\n4. Pyinstaller_\n5. RRDtool_\n6. web.py_\n\n.. _YouTube Download: http://rg3.github.com/youtube-dl/\n.. _Kaa Metadata Python Package: http://packages.debian.org/sid/python-kaa-metadata\n.. _DNS Python Package: http://pypi.python.org/pypi/dnspython\n.. _Pyinstaller: http://www.pyinstaller.org/\n.._RRDtool: http://oss.oetiker.ch/rrdtool/\n.._web.py: http://webpy.org/", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://code.google.com/p/pytomo", "keywords": null, "license": "GPLv2", "maintainer": null, "maintainer_email": null, "name": "Pytomo", "package_url": "https://pypi.org/project/Pytomo/", "platform": "Linux,Windows,Mac", "project_url": "https://pypi.org/project/Pytomo/", "project_urls": { "Download": "UNKNOWN", "Homepage": "http://code.google.com/p/pytomo" }, "release_url": "https://pypi.org/project/Pytomo/3.0.5/", "requires_dist": null, "requires_python": null, "summary": "Python tomography tool", "version": "3.0.5" }, "last_serial": 943892, "releases": { "0.1.0": [], "0.1.2": [ { "comment_text": "", "digests": { "md5": "14958e3c294360d00761d25e94e1d1d2", "sha256": "f659060d85e06e19502e9a1ded263725728ba976dcf8705d7e0eba7e41bae602" }, "downloads": -1, "filename": "Pytomo-0.1.2.tar.gz", "has_sig": false, "md5_digest": "14958e3c294360d00761d25e94e1d1d2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 203893, "upload_time": "2011-03-29T23:30:06", "url": "https://files.pythonhosted.org/packages/4f/0d/3053e6353d0eae866261f8b9c682c896c67ca70fbda309e38fc4d30894c8/Pytomo-0.1.2.tar.gz" } ], "0.1.5": [ { "comment_text": "", "digests": { "md5": "666f6a92acce0f6f7a689ad0af2eb845", "sha256": "2588640c72a24ca1015bf0b71437a5c388198c3f7ccdfd5b5fbab068b9735881" }, "downloads": -1, "filename": "Pytomo-0.1.5.tar.gz", "has_sig": false, "md5_digest": "666f6a92acce0f6f7a689ad0af2eb845", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 204936, "upload_time": "2011-03-30T22:55:59", "url": "https://files.pythonhosted.org/packages/55/3e/a365eea7593664fb46570d3643604f8c23c258706eb0c0ed4bbf365e0ab6/Pytomo-0.1.5.tar.gz" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "fe5ff01e61de4bdfa072280aec183b27", "sha256": "cd77f84479cd9161677387592778525d61df655624085f298f553f24996fb77d" }, "downloads": -1, "filename": "Pytomo-0.2.tar.gz", "has_sig": false, "md5_digest": "fe5ff01e61de4bdfa072280aec183b27", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 207535, "upload_time": "2011-04-04T21:47:56", "url": "https://files.pythonhosted.org/packages/7e/37/4dd8fc1655d7e434ceb0c27de0b2d9e5e9e3d5eea18659902462c077e613/Pytomo-0.2.tar.gz" } ], "0.2.1": [ { "comment_text": "", "digests": { "md5": "8324692b5cb6dd65ef7b6def90a81f2a", "sha256": "363ba5174e243491c03e1eac29cd0eb1f6221d0c559fa34e10af703afb55a64f" }, "downloads": -1, "filename": "Pytomo-0.2.1.tar.gz", "has_sig": false, "md5_digest": "8324692b5cb6dd65ef7b6def90a81f2a", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 207627, "upload_time": "2011-04-04T22:14:44", "url": "https://files.pythonhosted.org/packages/61/10/d5b4bb927466640839cfa5585a2d7af4e7fb9a5d673cd4fec8d1be0310e7/Pytomo-0.2.1.tar.gz" } ], "0.3.2": [], "0.3.3": [], "0.4.0": [], "0.9.3": [], "0.9.7": [], "0.9.8": [], "0.9.9": [], "1.0.8": [], "1.1.1": [], "1.1.2": [], "1.1.3": [], "1.1.4": [], "1.1.5": [], "1.1.6": [], "1.1.7": [], "1.1.8": [], "1.2.0": [], "1.2.1": [], "1.3.1": [], "1.3.2": [], "1.4.0": [], "1.4.1": [], "1.4.2": [], "1.5.0": [], "1.5.1": [], "1.5.2": [], "1.5.3": [], "1.5.4": [], "1.5.7": [], "1.6.0": [], "1.7.0": [], "1.7.1": [], "1.8.0": [], "1.8.1": [], "1.8.2": [], "1.9.0": [], "1.9.1": [], "1.9.19": [], "1.9.2": [], "1.9.20": [], "1.9.21": [], "2.0.0": [], "2.0.4": [], "2.1.0": [], "2.1.1": [], "2.1.2": [], "2.1.3": [], "2.1.4": [], "2.1.5": [], "2.1.6": [], "2.2.0": [], "2.2.1": [], "2.2.2": [], "2.2.3": [], "2.2.4": [], "2.3.1": [], "2.4.0": [], "2.4.2": [], "2.4.4": [], "2.4.5": [], "2.4.6": [], "2.5.0": [], "2.6.0": [], "2.6.1": [], "2.6.2": [], "2.6.3": [], "2.6.4": [], "2.7.0": [], "2.7.1": [], "2.7.2": [], "2.7.3": [ { "comment_text": "", "digests": { "md5": "12af506813358af320e9b2c39a351006", "sha256": "57b50f788e77723721fd1c0270a34bb9ad9d20fe517ac1b65719e0d302e5e5db" }, "downloads": -1, "filename": "Pytomo-2.7.3.tar.gz", "has_sig": false, "md5_digest": "12af506813358af320e9b2c39a351006", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4112240, "upload_time": "2013-09-26T13:14:07", "url": "https://files.pythonhosted.org/packages/d4/c9/2daaceaa19d017e31d87846d234607a064b92877214a43b86dacd069c072/Pytomo-2.7.3.tar.gz" } ], "2.7.4": [ { "comment_text": "", "digests": { "md5": "7fcf70f38c8a0b35f342faf69df4af35", "sha256": "a98c3245a31f1a93699e0e3343961cf0ec670fdd2f59b38fb164ab7d8ff61379" }, "downloads": -1, "filename": "Pytomo-2.7.4.tar.gz", "has_sig": false, "md5_digest": "7fcf70f38c8a0b35f342faf69df4af35", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4112143, "upload_time": "2013-09-30T12:20:12", "url": "https://files.pythonhosted.org/packages/4f/f9/d531d84d854bc1cb5eeacea6d8657b36c73ef129588081589009dfd589e5/Pytomo-2.7.4.tar.gz" } ], "2.7.5": [ { "comment_text": "", "digests": { "md5": "567b81b02cefcb73562fd0892306d8c2", "sha256": "d023aa892f94ec17532d62f918528cd2e303492eec6ac6d9a9ef8b667e5e9c70" }, "downloads": -1, "filename": "Pytomo-2.7.5.tar.gz", "has_sig": false, "md5_digest": "567b81b02cefcb73562fd0892306d8c2", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4112382, "upload_time": "2013-10-01T15:14:41", "url": "https://files.pythonhosted.org/packages/83/dc/d96ea8cf9d5cd69c99b41b5c474685f9f53df3b6838fa19d7a048825dfef/Pytomo-2.7.5.tar.gz" } ], "2.8.1": [ { "comment_text": "", "digests": { "md5": "87aa5c2c64da14e209ca6d65c434f27d", "sha256": "65e966505bff2afb2604d1c05e9a0541ac1190616a27f7ad82ddf2afea33902a" }, "downloads": -1, "filename": "Pytomo-2.8.1.tar.gz", "has_sig": false, "md5_digest": "87aa5c2c64da14e209ca6d65c434f27d", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113006, "upload_time": "2013-10-14T07:39:45", "url": "https://files.pythonhosted.org/packages/61/64/4c4f73623ac4ec11e4c5280e75e560e960b0b2b2f4b97aeab3b8d5ca2cfb/Pytomo-2.8.1.tar.gz" } ], "2.8.2": [ { "comment_text": "", "digests": { "md5": "0e2dcf2e2e6506f5d3edc5719c3ebecc", "sha256": "2432a48de5ce04d69690fdf374c489dae2059bce533a221ad9a2dabf30c9b2bc" }, "downloads": -1, "filename": "Pytomo-2.8.2.tar.gz", "has_sig": false, "md5_digest": "0e2dcf2e2e6506f5d3edc5719c3ebecc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4112999, "upload_time": "2013-10-14T09:40:01", "url": "https://files.pythonhosted.org/packages/8f/9e/61ac0921af6bf7a5d1e8102d979435d5691efa8f2be928db9f0518002d95/Pytomo-2.8.2.tar.gz" } ], "2.8.3": [ { "comment_text": "", "digests": { "md5": "eee8e1d69a342bcf795c56f676146364", "sha256": "56712c1d04069b3947ee2c12b9abb6515adde3e6425202f4522ea349d23a754d" }, "downloads": -1, "filename": "Pytomo-2.8.3.tar.gz", "has_sig": false, "md5_digest": "eee8e1d69a342bcf795c56f676146364", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113026, "upload_time": "2013-10-14T09:57:45", "url": "https://files.pythonhosted.org/packages/bf/f0/e23a51b3948e32e86f274e6077ae2e1e2b3815e3d47bf396f083304bc09b/Pytomo-2.8.3.tar.gz" } ], "2.8.4": [ { "comment_text": "", "digests": { "md5": "ab3cdf98ba6ade90941b05d25094b715", "sha256": "16a067b6ae7b671b4f30fd9c4c7bfe7869de1e70aab42cd06d0e6402d7134759" }, "downloads": -1, "filename": "Pytomo-2.8.4.tar.gz", "has_sig": false, "md5_digest": "ab3cdf98ba6ade90941b05d25094b715", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113207, "upload_time": "2013-10-18T15:29:22", "url": "https://files.pythonhosted.org/packages/74/eb/0691e439495cefc3dd82a84531498244de3a9cf5a8fd4fc60d1bc43efb4b/Pytomo-2.8.4.tar.gz" } ], "2.8.5": [ { "comment_text": "", "digests": { "md5": "9f591b41f39ca5b97d4bb989553b4b25", "sha256": "6c3d161ba2230ec578ae1594454aff231a710187b99b356a4f6bb68d9bc47426" }, "downloads": -1, "filename": "Pytomo-2.8.5.tar.gz", "has_sig": false, "md5_digest": "9f591b41f39ca5b97d4bb989553b4b25", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113198, "upload_time": "2013-10-21T12:54:47", "url": "https://files.pythonhosted.org/packages/d4/ab/770573bfaf989489c8567eac0dedf215f5c8832879a3843aedca3ded99a7/Pytomo-2.8.5.tar.gz" } ], "2.8.6": [ { "comment_text": "", "digests": { "md5": "0d6f05d495e543f1cb92fc6e41a4289f", "sha256": "8c2f52f4245caf521fcf94c336ce9fe560fbb83fabdb6cf6e0fd30f305e60035" }, "downloads": -1, "filename": "Pytomo-2.8.6.tar.gz", "has_sig": false, "md5_digest": "0d6f05d495e543f1cb92fc6e41a4289f", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113209, "upload_time": "2013-10-22T09:11:09", "url": "https://files.pythonhosted.org/packages/7a/f1/a1f5a8d93cc9f64f0b62b0d3e0ff10272df546396a8f7c10f8ae36d1d6bf/Pytomo-2.8.6.tar.gz" } ], "2.8.7": [ { "comment_text": "", "digests": { "md5": "0b54c2cd5103b45abf93f743927784f7", "sha256": "d4ca2792bd7e2285a75fdeca66ca7832de543a45d8d7124ee7a4ed70e48cf937" }, "downloads": -1, "filename": "Pytomo-2.8.7.tar.gz", "has_sig": false, "md5_digest": "0b54c2cd5103b45abf93f743927784f7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4113318, "upload_time": "2013-11-06T13:49:54", "url": "https://files.pythonhosted.org/packages/cb/32/0304881ffdc8208f9b60cbe4812da23c622bc32dbc9e0915e981147767d2/Pytomo-2.8.7.tar.gz" } ], "3.0.0": [ { "comment_text": "", "digests": { "md5": "93bb32fdb789b44375dc11a7f1f7e0a7", "sha256": "6f9b5d5d274d3f0fc226b0d527272e2407d6b740f24715ef3a74f6157759ef16" }, "downloads": -1, "filename": "Pytomo-3.0.0.tar.gz", "has_sig": false, "md5_digest": "93bb32fdb789b44375dc11a7f1f7e0a7", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4121905, "upload_time": "2013-11-22T14:51:27", "url": "https://files.pythonhosted.org/packages/32/c1/45eaa88b9bfb077acd05b9f3eae3ab12fb3b0b62c2fcb23b09bc1adfbe28/Pytomo-3.0.0.tar.gz" } ], "3.0.1": [ { "comment_text": "", "digests": { "md5": "2c521f7e38acd762a0138d8a5ac93730", "sha256": "acdbfe6df272a5c92cd2d67ab50f1def0f21e2aa844b0c9ad4ccd71ab05614ad" }, "downloads": -1, "filename": "Pytomo-3.0.1.tar.gz", "has_sig": false, "md5_digest": "2c521f7e38acd762a0138d8a5ac93730", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4122034, "upload_time": "2013-11-25T08:13:49", "url": "https://files.pythonhosted.org/packages/18/56/cc62fd5cfd58c12de2fbd9163aa159eee59e1a5448f31d5735d8570c4801/Pytomo-3.0.1.tar.gz" } ], "3.0.2": [ { "comment_text": "", "digests": { "md5": "c42bf2b101a74d0f424b6d9c0abe35cb", "sha256": "0e8a3c0b9c8088fa17c42744d9ad5ab1d5825a274793ed0b1d5dd29f47a08e90" }, "downloads": -1, "filename": "Pytomo-3.0.2.tar.gz", "has_sig": false, "md5_digest": "c42bf2b101a74d0f424b6d9c0abe35cb", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4122074, "upload_time": "2013-11-25T10:25:27", "url": "https://files.pythonhosted.org/packages/30/3a/805550235ff002434cbad7a682219f960549ae38411e6d51bea1986de4e5/Pytomo-3.0.2.tar.gz" } ], "3.0.3": [ { "comment_text": "", "digests": { "md5": "56001f223da103b8aed400f2db381a6c", "sha256": "cdd0b3683c2304c924d5b679838987b5eea76fa3821d2fc49b3ddc2923acf76f" }, "downloads": -1, "filename": "Pytomo-3.0.3.tar.gz", "has_sig": false, "md5_digest": "56001f223da103b8aed400f2db381a6c", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4122139, "upload_time": "2013-11-25T10:28:27", "url": "https://files.pythonhosted.org/packages/51/dc/408b34c273624ef7042ea1b2b519aedcfc4df64825ca71a289ad650137f7/Pytomo-3.0.3.tar.gz" } ], "3.0.4": [ { "comment_text": "", "digests": { "md5": "f8176e26a163807180d818fd865f7975", "sha256": "f54b55068941c01c4f664d994d0c092622a781c1456a9f076b42fc04d6d63047" }, "downloads": -1, "filename": "Pytomo-3.0.4.tar.gz", "has_sig": false, "md5_digest": "f8176e26a163807180d818fd865f7975", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 4122114, "upload_time": "2013-11-29T11:04:27", "url": "https://files.pythonhosted.org/packages/d4/33/03426d7db0b5dd2e69c039821db5d8feaaa2733775ce50ba5e4113a99ed5/Pytomo-3.0.4.tar.gz" } ], "3.0.5": [] }, "urls": [] }