{
    "info": {
        "author": "Hans-Peter Jansen",
        "author_email": "hpj@urpla.net",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 4 - Beta",
            "Environment :: Console",
            "Intended Audience :: System Administrators",
            "License :: OSI Approved :: GNU General Public License v2 (GPLv2)",
            "Operating System :: POSIX",
            "Operating System :: POSIX :: Linux",
            "Programming Language :: Python",
            "Programming Language :: Python :: 3",
            "Programming Language :: Python :: 3.1",
            "Programming Language :: Python :: 3.2",
            "Programming Language :: Python :: 3.3",
            "Programming Language :: Python :: 3.4",
            "Programming Language :: Python :: 3.5",
            "Topic :: Internet",
            "Topic :: Internet :: WWW/HTTP",
            "Topic :: Internet :: WWW/HTTP :: HTTP Servers"
        ],
        "description": "squid_dedup\r\n===========\r\n\r\nsquid_dedup is a squid proxy helper, helping to reduce cache misses when\r\nidentical content is accessed using different URLs (aka CDNs).\r\n\r\nThis helper implements the squid StoreID protocol, as found in squid 3\r\nonwards. URL patterns, specified in config files, are rewritten to a presumably\r\nunique internal address. Further accesses, modified in the same way, map to\r\nalready stored objects, even if using different URLs.\r\n\r\nGlobal configuration options are specified in the primary config file, which\r\nmust exist. A template can be created with the --extract command line switch in\r\nthe current directory.\r\n\r\nCDN match/replacement parameter are specified in additional config files.\r\n\r\n\r\nInstallation\r\n------------\r\n\r\n::\r\n\r\n    $ python3 setup.py install\r\n\r\nCreate directory for custom config files::\r\n\r\n    $ mkdir /etc/squid/dedup\r\n\r\nCreate primary config file template /etc/squid/squid_dedup.conf::\r\n\r\n    $ cd /etc/squid\r\n    $ squid_dedup -X\r\n\r\nopenSUSE CDN::\r\n\r\n    $ gen_openSUSE_dedups\r\n\r\ncreates /etc/squid/dedup/opensuse.conf.\r\n\r\n\r\nActivation\r\n----------\r\n\r\nAdd similar values to /etc/squid/squid.conf::\r\n\r\n    store_id_program /usr/bin/squid_dedup\r\n    store_id_children 20 startup=10 idle=5 concurrency=0\r\n\r\n    acl getmethod method GET\r\n    store_id_access deny !getmethod\r\n    store_id_access allow all\r\n\r\nThat's it.\r\n\r\n\r\nConfiguration\r\n-------------\r\n\r\nThe primary configuration is located in /etc/squid/squid_dedup.conf,\r\nand defines the general behaviour.\r\n\r\nAdditional config files should be stored in /etc/squid/dedup, e.g.::\r\n\r\n    [sourceforge]\r\n    match: http:\\/\\/[a-zA-Z0-9\\-\\_\\.]+\\.dl\\.sourceforge\\.net\\/(.*)\r\n    replace: http://dl.sourceforge.net.%(intdomain)s/\\1\r\n    fetch: false\r\n\r\nHere, any URL pointing to a sub domain of dl.sourceforge.net, is mapped to\r\ndl.sourceforge.net.%(intdomain)s, where %(intdomain)s is replaced according\r\nto the value of intdomain in /etc/squid/squid_dedup.conf.\r\n\r\nmatch is a list of regular expressions matching URLs, separated by newlines,\r\nwith all subsequent URLs indented.\r\n\r\nreplace is a single replacement value.\r\n\r\nfetch is an optional boolean flag. If fetch is enabled, the object is fetched\r\nalso (with a certain delay). This is useful for clients, that download byte\r\nranges only from multiple sources. That behavior results in uncachable objects\r\notherwise. Care is taken for not fetching objects more than once.\r\n\r\nChanges to the config files result in an automatic reload by default.\r\n\r\n\r\nWatch\r\n-----\r\n\r\nYou might want to increase the log level in /etc/squid/squid_dedup.conf.::\r\n\r\n    $ less +F /var/log/squid/dedup.log\r\n\r\n\r\nNotes\r\n-----\r\n\r\nThe gen_openSUSE_dedups utility is meant to be executed as a user by\r\ncrontab, e.g.::\r\n\r\n    $ touch /etc/squid/dedup/opensuse.conf\r\n    $ chown user:group /etc/squid/dedup/opensuse.conf\r\n    $ chmod 644 /etc/squid/dedup/opensuse.conf\r\n    $ su - user\r\n    > crontab -e\r\n\r\nAdd a line similar to::\r\n\r\n    0 6 * * * /usr/bin/gen_openSUSE_dedups -vs\r\n\r\n\r\nCredits\r\n-------\r\n\r\nThe basic idea and a reference implementation in PHP was done by Per Jessen.\r\n\r\n**Per, thank you for the valuable discussions on this topic.**",
        "description_content_type": null,
        "docs_url": null,
        "download_url": "UNKNOWN",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/frispete/squid_dedup",
        "keywords": "",
        "license": "GPLv2",
        "maintainer": "",
        "maintainer_email": "",
        "name": "squid-dedup",
        "package_url": "https://pypi.org/project/squid-dedup/",
        "platform": "UNKNOWN",
        "project_url": "https://pypi.org/project/squid-dedup/",
        "project_urls": {
            "Download": "UNKNOWN",
            "Homepage": "https://github.com/frispete/squid_dedup"
        },
        "release_url": "https://pypi.org/project/squid-dedup/0.0.3/",
        "requires_dist": null,
        "requires_python": null,
        "summary": "A squid 3 proxy helper for deduplicating CDN accesses",
        "version": "0.0.3"
    },
    "last_serial": 2168521,
    "releases": {
        "0.0.1": [],
        "0.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "75762d7909591270fa4683ad5e367aeb",
                    "sha256": "dabe98b03aa60ca9dfacf698ec18094f8bc483b9d5f084c8a2841f901d0dc2f3"
                },
                "downloads": -1,
                "filename": "squid_dedup-0.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "75762d7909591270fa4683ad5e367aeb",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 29313,
                "upload_time": "2016-05-09T21:50:16",
                "url": "https://files.pythonhosted.org/packages/9a/b7/f3a39d40bd4568b2beec62c735e032768f20af6755fe5ab16e7a9b7b4418/squid_dedup-0.0.2.tar.gz"
            }
        ],
        "0.0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "bbc70f3408d3a87efc85de6595835ad3",
                    "sha256": "0520ed43e0d44fb20b3080614a95c9f97d96c39ea9520d68db80a71d78ce41e7"
                },
                "downloads": -1,
                "filename": "squid_dedup-0.0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "bbc70f3408d3a87efc85de6595835ad3",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 31285,
                "upload_time": "2016-05-13T16:42:15",
                "url": "https://files.pythonhosted.org/packages/50/90/28685a4b6cd74d77c5da72552fe1f2ac7651153ab1e205243db339e5db1b/squid_dedup-0.0.3.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "bbc70f3408d3a87efc85de6595835ad3",
                "sha256": "0520ed43e0d44fb20b3080614a95c9f97d96c39ea9520d68db80a71d78ce41e7"
            },
            "downloads": -1,
            "filename": "squid_dedup-0.0.3.tar.gz",
            "has_sig": false,
            "md5_digest": "bbc70f3408d3a87efc85de6595835ad3",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 31285,
            "upload_time": "2016-05-13T16:42:15",
            "url": "https://files.pythonhosted.org/packages/50/90/28685a4b6cd74d77c5da72552fe1f2ac7651153ab1e205243db339e5db1b/squid_dedup-0.0.3.tar.gz"
        }
    ]
}