{
    "info": {
        "author": "Ori Hoch",
        "author_email": "ori@uumpa.com",
        "bugtrack_url": null,
        "classifiers": [
            "Development Status :: 4 - Beta",
            "License :: OSI Approved :: GNU Affero General Public License v3 or later (AGPLv3+)",
            "Programming Language :: Python :: 2.7"
        ],
        "description": "# ckanext-datapackage_pipelines\n\n[![CKAN pipelines server Docker image: orihoch/datapackage-pipelines-ckan](https://img.shields.io/badge/CKAN%20pipelines%20server%20Docker%20image-orihoch/datapackage--pipelines--ckanext-darkgreen.svg)](https://hub.docker.com/r/orihoch/datapackage-pipelines-ckanext/)\n\nIntegrate [datapackage-pipelines](https://github.com/frictionlessdata/datapackage-pipelines) with CKAN\n\nMinimal supported CKAN version: 2.8.1\n\n## Installation\n\n### Install the plugin\n\n* Create a directory to hold the pipelines, ckan pipeline extensions write to that directory\n  * `sudo mkdir -p /var/ckan/pipelines`\n  * `sudo chown -R $USER:$GROUP /var/ckan`\n  * This directory should be shared between the pipelines server and CKAN\n* Activate your CKAN virtual environment\n* Install the ckanext-datapackage_pipelines package into your virtual environment:\n  * `pip install ckanext-datapackage_pipelines`\n* Add `datapackage_pipelines` to the `ckan.plugins` setting in your CKAN\n* Restart CKAN.\n\n### Start the datapackage-pipelines server\n\nThe following command starts a local pipelines server for development on the host network\n\nCKAN_API_KEY should be a CKAN user's api key which has sysadmin privileges\n\nIf you are running the CKAN Redis server on the same host, you should modify the port to prevent collision\nwith the pipelines server Redis which runs on port 6379.\n\nThe pipelines server runs on port 5050.\n\n```\ndocker run -v /var/ckan/pipelines:/pipelines:rw \\\n           -e CKAN_API_KEY=*** \\\n           -e CKAN_URL=http://localhost:5000 \\\n           --net=host \\\n           orihoch/datapackage-pipelines-ckanext server\n```\n\n## Usage\n\nPipelines dashboard is available publically at http://your-ckan-url/pipelines\n\nCKAN plugins can use the pipelines server by implementing the `IDatapackagePipelines` interface which contains the following  methods:\n\n* `register_pipelines` - returns the pipelines name (usually the name of the plugin) and directory to get the plugin's\npipelines from. When CKAN is restarted the pipelines are copied by default to /var/ckan/pipelines - this directory should be\nshared between CKAN and the pipelines server. If the plugin pipelines directories contains a `requirements.txt` it will be\ninstalled on restart of the pipelines server.\n* `get_pipelines_config` - returns a dict of key-value pairs containing the plugin's configuration or other data which should be available to the pipeline processors.\n\nPipeline processors can get this configuration using  `datapackage_pipelines_ckanext.helpers.get_plugin_configuration(plugin_name)`.\n\nThe following pipelines processors are available:\n\n* `ckanext.dump_to_path` - same as standard library `dump.to_path` but dumps to the CKAN data directory.\n  * parameters:\n  * `plugin`: **required** name of the plugin\n  * `out-path`: relative path within the plugin's data directory\n\n* `ckanext.load_resource` - same as standard library `load_resource` but loads from CKAN data directory.\n  * parameters:\n  * `path`: **required** relative path to the datapackage in the plugin's data directory\n  * `plugin`: **required** the plugin's name\n\nTo support pipeline dependencies, rename your `pipeline-spec.yaml` to `ckanext.source-spec.yaml`\n\nFollowing is an example pipeline spec where the `download_data` pipeline will run on a schedule\nand after each scheduled run the `load_data_to_ckan` pipeline will run:\n\n```\ndownload_data:\n  schedule:\n    crontab: \"1 2 * * *\"\n  pipeline:\n  - ...\n\nload_data_to_ckan:\n  dependencies:\n  - ckanext-pipeline: your_plugin_name download_data\n```\n\n## CKAN Plugin Configuration\n\nFollowing are the supported configurations and default values\n\n```\nckanext.datapackage_pipelines.directory = /var/ckan/pipelines\nckanext.datapackage_pipelines.dashboard_url = http://localhost:5050\n```",
        "description_content_type": "",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "https://github.com/OriHoch/ckanext-datapackage_pipelines",
        "keywords": "CKAN datapackage-pipelines",
        "license": "AGPL",
        "maintainer": "",
        "maintainer_email": "",
        "name": "ckanext-datapackage-pipelines",
        "package_url": "https://pypi.org/project/ckanext-datapackage-pipelines/",
        "platform": "",
        "project_url": "https://pypi.org/project/ckanext-datapackage-pipelines/",
        "project_urls": {
            "Homepage": "https://github.com/OriHoch/ckanext-datapackage_pipelines"
        },
        "release_url": "https://pypi.org/project/ckanext-datapackage-pipelines/0.0.4/",
        "requires_dist": null,
        "requires_python": "",
        "summary": "Integrate datapackage-pipelines with CKAN",
        "version": "0.0.4"
    },
    "last_serial": 4360633,
    "releases": {
        "0.0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "553b8d5b6f34593a8265092c3b50fb01",
                    "sha256": "0a355e0357b0cbe0c76b7d39bc1d1d21c14e6eaf2e4f07aa15c3a7d3a8922209"
                },
                "downloads": -1,
                "filename": "ckanext-datapackage_pipelines-0.0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "553b8d5b6f34593a8265092c3b50fb01",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 18920,
                "upload_time": "2018-09-16T18:38:41",
                "url": "https://files.pythonhosted.org/packages/4a/cc/f57b6442e638615d138303983b291802a17b433d6e1a44d6adfa804a96c9/ckanext-datapackage_pipelines-0.0.1.tar.gz"
            }
        ],
        "0.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "179a72199bd890f938389b75a5d33ac1",
                    "sha256": "86e47de4ca87560f681306acd0626dafaa5929dbbaa4e3baa0de2042d11eb658"
                },
                "downloads": -1,
                "filename": "ckanext-datapackage_pipelines-0.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "179a72199bd890f938389b75a5d33ac1",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 19636,
                "upload_time": "2018-10-04T13:30:28",
                "url": "https://files.pythonhosted.org/packages/6f/4d/f5c3402c1ff43875394fd25dc25f8d23ab2e698851932e80f34c2b33139c/ckanext-datapackage_pipelines-0.0.2.tar.gz"
            }
        ],
        "0.0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "70a44da2628f57acfe28081c3f59376f",
                    "sha256": "8d70b6f7494306509fe36761e8a670879651f2354be30f76127a2d8a71e5a8e5"
                },
                "downloads": -1,
                "filename": "ckanext-datapackage_pipelines-0.0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "70a44da2628f57acfe28081c3f59376f",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 19809,
                "upload_time": "2018-10-04T20:28:48",
                "url": "https://files.pythonhosted.org/packages/6c/47/3709e7a1a2466d901156960990f27c8341e71ad52d354a24083f5db97f74/ckanext-datapackage_pipelines-0.0.3.tar.gz"
            }
        ],
        "0.0.4": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "dfa765ad489e22e22ee9dc991bc219e1",
                    "sha256": "ea6f997090fc9e57ea7ac4333401a39642ac142c8e7dddd93cc0a402883151d9"
                },
                "downloads": -1,
                "filename": "ckanext-datapackage_pipelines-0.0.4.tar.gz",
                "has_sig": false,
                "md5_digest": "dfa765ad489e22e22ee9dc991bc219e1",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": null,
                "size": 19825,
                "upload_time": "2018-10-10T16:02:19",
                "url": "https://files.pythonhosted.org/packages/9b/74/ffcd5e9638e16df6d4fc34e1360e956f48a5bce5b4c786e64111b7cd6f60/ckanext-datapackage_pipelines-0.0.4.tar.gz"
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "dfa765ad489e22e22ee9dc991bc219e1",
                "sha256": "ea6f997090fc9e57ea7ac4333401a39642ac142c8e7dddd93cc0a402883151d9"
            },
            "downloads": -1,
            "filename": "ckanext-datapackage_pipelines-0.0.4.tar.gz",
            "has_sig": false,
            "md5_digest": "dfa765ad489e22e22ee9dc991bc219e1",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 19825,
            "upload_time": "2018-10-10T16:02:19",
            "url": "https://files.pythonhosted.org/packages/9b/74/ffcd5e9638e16df6d4fc34e1360e956f48a5bce5b4c786e64111b7cd6f60/ckanext-datapackage_pipelines-0.0.4.tar.gz"
        }
    ]
}