{ "info": { "author": "RedTurtle Technology", "author_email": "sviluppoplone@redturtle.it", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "License :: OSI Approved :: GNU General Public License (GPL)", "Operating System :: OS Independent", "Programming Language :: Python", "Programming Language :: Python :: 2.7", "Topic :: Internet :: WWW/HTTP", "Topic :: Utilities" ], "description": "Quick info\n==========\n\nLet say you need to use the HTTP load testing and benchmarking utility `siege`__ on a web page\nand you also want to use the ``--internet`` option, to simulate at best the behavior of a web browser.\n\n__ http://www.joedog.org/siege-home/\n\nWhen a web browser load a page, it also load all the resources inside that page:\n\n* Images\n* JavaScript files\n* CSS\n* Media resources\n\nSo you need a list of all URLs taken from that page.\n\nThis utility (its name mean \"**You Will Download**\") will simply create this list for you.\n\nYou simply need to redirect the utility output to a file, then use also the siege ``--file`` option.\n\nUsage\n-----\n\n::\n\n $ youlldownload http://host.com/section/page\n\nUsing with siege::\n\n $ youlldownload http://host.com/section/page > list.txt\n $ siege -i -f list.txt [other options]\n\nTaken resouces\n--------------\n\n* from ``script`` tags we'll take the ``src`` URL\n* from ``link`` tags with ``rel`` equals to ``stylesheet`` we'll take the ``href`` url\n* from ``img`` tags we'll take the ``src`` URL\n* from ``object`` tags we'll take the ``data`` URL\n* from ``embed`` tags we'll take the ``src`` URL\n* from ``style`` tags we'll take the URL inside if the tag is using an \"*@import url*\"\n directive\n* from ``iframe`` tags we'll take the ``src`` URL\n* from ``source`` tags inside ``video`` we'll take the ``src`` URL\n\nAlso: CSS sources are deeply analyzed for found additional resources inside them\n(like background images, fonts, ...).\n\nAuthors\n=======\n\nThis product was developed by RedTurtle Technology team.\n\n.. image:: http://www.redturtle.it/redturtle_banner.png\n :alt: RedTurtle Technology Site\n :target: http://www.redturtle.it/\n\nChangelog\n=========\n\n0.4 (2015-11-06)\n----------------\n\n- Fix setup.py to properly create a package\n [ale-rt]\n\n\n0.3 (2015-05-28)\n----------------\n\n- Remove duplicated URLs from final report\n [keul]\n- Do not include same version of an URL with anchors\n [keul]\n- Inspect also resources from CSS (backgroun images, fonts, ...)\n [keul]\n- Script was not properly working outside homepage if a \"base\" tag\n was not provided\n [keul]\n\n0.2 (2014-04-02)\n----------------\n\n- Added support for ``src`` attribute of ``iframe`` tag\n [keul]\n- Added support for ``src`` attribute of ``source`` tag\n (HTML 5 video element)\n [keul]\n- Do not break if ``base`` tag is not present\n [keul]\n\n0.1 (2013-01-30)\n----------------\n\n- initial release", "description_content_type": null, "docs_url": null, "download_url": "UNKNOWN", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/RedTurtle/YoullDownload", "keywords": "crawler log web", "license": "GPL", "maintainer": null, "maintainer_email": null, "name": "YoullDownload", "package_url": "https://pypi.org/project/YoullDownload/", "platform": "UNKNOWN", "project_url": "https://pypi.org/project/YoullDownload/", "project_urls": { "Download": "UNKNOWN", "Homepage": "https://github.com/RedTurtle/YoullDownload" }, "release_url": "https://pypi.org/project/YoullDownload/0.4/", "requires_dist": null, "requires_python": null, "summary": "Grab from a remote site page all resources that a browser will probably download visiting the page", "version": "0.4" }, "last_serial": 1807507, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "a8b3cb157386522bc88cd4e9ba266c68", "sha256": "edd7983887d765c256c751aeeab226d0b7b6e80d920fff5ae05178819b830062" }, "downloads": -1, "filename": "YoullDownload-0.1.zip", "has_sig": false, "md5_digest": "a8b3cb157386522bc88cd4e9ba266c68", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11711, "upload_time": "2013-01-30T17:05:06", "url": "https://files.pythonhosted.org/packages/c9/af/ddb1039221fd538d99d619da388b628ed8990a5ea8c2663ce8d9da0f75c4/YoullDownload-0.1.zip" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "4af20afecfa0231b62546681ffbf33a1", "sha256": "94aca04f33dc42d31aceb9dd8dc83ee6273fc9402b2903b6097412e31f2f02c9" }, "downloads": -1, "filename": "YoullDownload-0.2.zip", "has_sig": false, "md5_digest": "4af20afecfa0231b62546681ffbf33a1", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12208, "upload_time": "2014-04-02T06:51:13", "url": "https://files.pythonhosted.org/packages/a4/07/b959b8a5f745c33b638f7f05de97489d43ccb0730a98ea328658646feadb/YoullDownload-0.2.zip" } ], "0.3": [ { "comment_text": "", "digests": { "md5": "df7e91503d0c73b7100aa83cec832bb4", "sha256": "6c11585ea5c34f3bd54e182b138058fddc18579adff86a34842040c0986fac23" }, "downloads": -1, "filename": "YoullDownload-0.3.tar.gz", "has_sig": false, "md5_digest": "df7e91503d0c73b7100aa83cec832bb4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8842, "upload_time": "2015-05-28T15:25:07", "url": "https://files.pythonhosted.org/packages/98/eb/3052adb1e5ecd038b641a0b8287cb4c420c47af608fb1b60fc4f75fa9a63/YoullDownload-0.3.tar.gz" } ], "0.4": [ { "comment_text": "", "digests": { "md5": "512c2f41ca1c9e62291a6eadf20447ed", "sha256": "a33659b8ab1be1535c471065997995d0cb117933bf40e03a3d71225b650b718c" }, "downloads": -1, "filename": "YoullDownload-0.4.tar.gz", "has_sig": false, "md5_digest": "512c2f41ca1c9e62291a6eadf20447ed", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8991, "upload_time": "2015-11-09T08:51:47", "url": "https://files.pythonhosted.org/packages/cb/0f/013c09c25d8dce5a6088c783d6748ea316a3108c37f0d4fc825f200e505f/YoullDownload-0.4.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "512c2f41ca1c9e62291a6eadf20447ed", "sha256": "a33659b8ab1be1535c471065997995d0cb117933bf40e03a3d71225b650b718c" }, "downloads": -1, "filename": "YoullDownload-0.4.tar.gz", "has_sig": false, "md5_digest": "512c2f41ca1c9e62291a6eadf20447ed", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 8991, "upload_time": "2015-11-09T08:51:47", "url": "https://files.pythonhosted.org/packages/cb/0f/013c09c25d8dce5a6088c783d6748ea316a3108c37f0d4fc825f200e505f/YoullDownload-0.4.tar.gz" } ] }