{
    "info": {
        "author": "Karik Isichei",
        "author_email": "karik.isichei@digital.justice.gov.uk",
        "bugtrack_url": null,
        "classifiers": [
            "License :: OSI Approved :: MIT License",
            "Programming Language :: Python :: 3",
            "Programming Language :: Python :: 3.6",
            "Programming Language :: Python :: 3.7",
            "Programming Language :: Python :: 3.8",
            "Programming Language :: Python :: 3.9",
            "Programming Language :: Python :: 3.10"
        ],
        "description": "# etl_manager\n\n[![Actions Status](https://github.com/moj-analytical-services/etl_manager/workflows/ETL%20Manager/badge.svg)](https://github.com/moj-analytical-services/etl_manager/actions)\n\nA python package that manages our data engineering framework and implements them on AWS Glue.\n\nThe main functionality of this package is to interact with AWS Glue to create meta data catalogues and run Glue jobs.\n\nTo install:\n\n```bash\npip install etl_manager\n```\n\n## Meta Data\n\nLet's say I have a single table (a csv file) and I want to query it using Amazon athena. My csv file is in the following S3 path: `s3://my-bucket/my-table-folder/file.csv`.\n\nfile.csv is a table that looks like this:\n\n| col1 | col2 |\n|------|------|\n| a    | 1    |\n| b    | 12   |\n| c    | 42   |\n\nAs you can see col1 is a string and col2 is a integer.\n\n> **Notes:**\n> - for Athena to work your table should not contain a header. So before file.csv is uploaded to S3 you should make sure it has no header.\n> - Tables must be in a folder. I.e. the location of your table (`table.location`) should be the parent folder of where you data exists. See example below.\n\nTo create a schema for your data to be queried by Athena you can use the following code:\n\n```python\nfrom etl_manager.meta import DatabaseMeta, TableMeta\n\n# Create database meta object\ndb = DatabaseMeta(name = 'my_database', bucket='my-bucket')\n\n# Create table meta object\ntab = TableMeta(name = 'my_table', location = 'my-table-folder')\n\n# Add column defintions to the table\ntab.add_column(name = 'col1', 'character', description = 'column contains a letter')\ntab.add_column(name = 'col2', 'int', description = 'column contains a number')\n\n# Add table to the database\ndb.add_table(tab)\n\n# Create the table on AWS glue\ndb.create_glue_database()\n```\n\nNow the table can be queried via SQL e.g. `SELECT * FROM my_database.my_table`\n\n### Meta data structure\n\nCurrently at very simple level. Assume you have the following folder structure from example code:\n\n```\nmeta_data/\n--- database.json\n--- teams.json\n--- employees.json\n```\n\ndatabase.json is a special json file that holds the meta data for the database. In our example it looks like this:\n\n```json\n{\n    \"description\": \"Example database\",\n    \"name\": \"workforce\",\n    \"bucket\": \"my-bucket\",\n    \"base_folder\": \"database/database1\"\n}\n```\n\nWhen you create your database it will have this `name` and `description`. The `bucket` key specifies where the database exists (and therefore where the tables exist) in S3. The `base_folder` is is the initial path to where the tables exist. If your tables are in folders directly in the bucket (e.g. `s3://my-bucket/table1/`) then you can leave base_folder as an empty string (`\"\"`).\n\nThe employees table has an ID for each employee their name and dob. The table meta looks like this:\n\n```json\n{\n    \"$schema\" : \"https://moj-analytical-services.github.io/metadata_schema/table/v1.0.0.json\",\n    \"name\": \"employees\",\n    \"description\": \"table containing employee information\",\n    \"data_format\": \"parquet\",\n    \"location\": \"employees/\",\n    \"columns\": [\n        {\n            \"name\": \"employee_id\",\n            \"type\": \"int\",\n            \"description\": \"an ID for each employee\"\n        },\n        {\n            \"name\": \"employee_name\",\n            \"type\": \"character\",\n            \"description\": \"name of the employee\"\n        },\n        {\n            \"name\": \"employee_dob\",\n            \"type\": \"date\",\n            \"description\": \"date of birth for the employee\"\n        }\n    ]\n}\n```\n\n**Currently supported data types for your columns currently are:**\n\n`character | int | long | float | double | decimal | date | datetime |  boolean`\n\nThis is a standard layout for a table metadata json. `$schema` points to another json that validates the structure of out table metadata files. Your table will have this `name` and `description` _(Note: It is strongly suggested that the name of your table matches the name of the metadata json file)_ when the database is created. The `location` is the relative folder path to where your table exists. This path is relative to your database `base_folder`. This means that the full path your table is `s3://<database.bucket>/<database.base_folder>/<table.folder>/`. So in this example the table employees should be in the s3 path `s3://my-bucket/database/database1/employees`. The `data_format` specifies what type of data the table is. Finally your columns is an array of objects. Where each object is a column definition specifying the `name`, `description` and `type` (data type) of the column. Each column can have optional arguments `pattern`, `enum` and `nullable` (see [table_schema.json](https://moj-analytical-services.github.io/metadata_schema/table/v1.0.0.json) for definition).\n\n**Note:** that the order of the columns listed here should be the order of the columns in the table _(remember that data for a table should not have a header so the data will be queried wrong if the column order does not match up with the actual data)_.\n\nHere is another table in the database called teams. The teams table is a list of employee IDs for each team. Showing which employees are in each team. This table is taken each month (so you can see which employee was in which team each month). Therefore this table is partitioned by each monthly snapshot.\n\n```json\n{\n    \"$schema\" : \"https://moj-analytical-services.github.io/metadata_schema/table/v1.0.0.json\",\n    \"name\": \"teams\",\n    \"description\": \"month snapshot of which employee with working in what team\",\n    \"data_format\": \"parquet\",\n    \"location\": \"teams/\",\n    \"columns\": [\n        {\n            \"name\": \"team_id\",\n            \"type\": \"int\",\n            \"description\": \"ID given to each team\",\n            \"nullable\" : false\n        },\n        {\n            \"name\": \"team_name\",\n            \"type\": \"character\",\n            \"description\": \"name of the team\"\n        },\n        {\n            \"name\": \"employee_id\",\n            \"type\": \"int\",\n            \"description\": \"primary key for each employee in the employees table\",\n            \"pattern\" : \"\\\\d+\"\n        },\n        {\n            \"name\": \"snapshot_year\",\n            \"type\": \"int\",\n            \"description\": \"year at which snapshot of workforce was taken\"\n        },\n        {\n            \"name\": \"snapshot_month\",\n            \"type\": \"int\",\n            \"description\": \"month at which snapshot of workforce was taken\",\n            \"enum\" : [1,2,3,4,5,6,7,8,9,10,11,12]\n        }\n    ],\n    \"partitions\" : [\"snapshot_year\", \"snapshot_month\"]\n}\n```\n\nFrom the above you can see this has additional properties `enum`, `pattern`, `nullable` and a `partitions` property:\n\n- **enum:** What values the column can take (does not have to include nulls - should use nullable property)\n- **pattern:** Values in this column should match this regex string in the pattern property\n- **nullable:** Specifies if this column should accept `NULL` values.\n- **partitions:** Specifies if any of the columns in the table are file partitions rather than columns in the data. `etl_manager` will force your meta data json files to have columns that are partitions at the end of your data's list of columns.\n\n> **Note:** etl_manager does not enforce information provided by `enum`, `pattern` and `nullable`. It is just there to provide information to other tools or functions that could use this information to validate your data. Also the information in `pattern`, `enum` and `nullable` can conflict etl_manager does not check for conflicts. For example a column with an enum of `[0,1]` and a pattern of `[A-Za-z]` is allowed.\n\n### Examples using the DatabaseMeta Class\n\nThe easiest way to create a database is to run the code below. It reads a database schema based on the json files in a folder and creates this database meta in the glue catalogue. Allowing you to query the data using SQL using Athena.\n\n```python\nfrom etl_manager.meta import read_database_folder\ndb = read_database_folder('example_meta_data/')\ndb.create_glue_database()\n```\n\nThe code snippet below creates a database meta object that allows you to manipulate the database and the tables that exist in it\n\n```python\nfrom etl_manager.meta import read_database_folder\n\ndb = read_database_folder('example_meta_data/')\n\n# Database has callable objects\n\ndb.name # workforce\n\ndb.table_names # [employees, teams]\n\n# Each table in the database is an object from the TableMeta Class which can be callable from the database meta object\n\ndb.table('employees').columns # returns all columns in employees table\n\n# The db and table object properties can also be altered and updated\n\ndb.name = 'new_db_name'\ndb.name # 'new_db_name\n\ndb.table('employees').name = 'new_name'\n\ndb.table_names # [new_name, teams]\n\ndb.remove_table('new_name')\n\ndb.name # workforce_dev (note as default the package adds _dev if a db_suffix is not provided in DatabaseMeta)\n\n# Set all table types to parquet and create database schema in glue\nfor t in db_table_names :\n    db.table(t).data_format = 'parquet'\ndb.create_glue_database()\n```\n\n## Using the GlueJob Class\n\nThe GlueJob class can be used to run pyspark jobs on AWS Glue. It is worth keeping up to date with AWS release notes and general guidance on running Glue jobs. This class is a wrapper function to simplify running glue jobs by using a structured format.\n\n```python\nfrom etl_manager.etl import GlueJob\n\nmy_role = 'aws_role'\nbucket = 'bucket-to-store-temp-glue-job-in'\n\njob = GlueJob('glue_jobs/simple_etl_job/', bucket=bucket, job_role=my_role, job_arguments={\"--test_arg\" : 'some_string'})\njob.run_job()\n\nprint(job.job_status)\n```\n\n### Glue Job Folder Structure\n\nGlue jobs have the prescribed folder format as follows:\n\n```\n\u251c\u2500\u2500 glue_jobs/\n|   |\n\u2502   \u251c\u2500\u2500 job1/\n|   |   \u251c\u2500\u2500 job.py\n|   |   \u251c\u2500\u2500 glue_resources/\n|   |   |   \u2514\u2500\u2500 my_lookup_table.csv\n|   |   \u2514\u2500\u2500 glue_py_resources/\n|   |       \u251c\u2500\u2500 my_python_functions.zip\n|   |       \u2514\u2500\u2500 github_zip_urls.txt\n|   |   \u2514\u2500\u2500 glue_jars/\n|   |       \u2514\u2500\u2500 my_jar.jar\n|   |\n\u2502   \u251c\u2500\u2500 job2/\n\u2502   |   \u251c\u2500\u2500 job.py\n\u2502   |   \u251c\u2500\u2500 glue_resources/\n\u2502   |   \u2514\u2500\u2500 glue_py_resources/\n|   |\n|   \u251c\u2500\u2500 shared_job_resources/\n\u2502   |   \u251c\u2500\u2500 glue_resources/\n|   |   |   \u2514\u2500\u2500 meta_data_dictionary.json\n\u2502   |   \u2514\u2500\u2500 glue_py_resources/\n|   |   \u2514\u2500\u2500 glue_jars/\n|   |       \u2514\u2500\u2500 my_other_jar.jar\n```\n\nEvery glue job folder must have a `job.py` script in that folder. That is the only required file everything else is optional. When you want to create a glue job object you point the GlueJob class to the parent folder of the `job.py` script you want to run. There are two additional folders you can add to this parent folder :\n\n#### glue_resources folder\n\nAny files in this folder are uploaded to the working directory of the glue job. This means in your `job.py` script you can get the path to these files by:\n\n```python\npath_to_file = os.path.join(os.getcwd(), 'file_in_folder.txt')\n```\n\nThe GlueJob class will only upload files with extensions (.csv, .sql, .json, .txt) to S3 for the glue job to access.\n\n#### glue_py_resources\n\nThese are python scripts you can import in your `job.py` script. e.g. if I had a `utils.py` script in my glue_py_resources folder. I could import that script normally e.g.\n\n```python\nfrom utils import *\n```\n\nYou can also supply zip file which is a group of python functions in the standard python package structure. You can then reference this package as you would normally in python. For example if I had a package zipped as `my_package.zip` in the glue_py_resources folder then you could access that package normally in your job script like:\n\n```python\nfrom my_package.utils import *\n```\n\nYou can also supply a text file with the special name `github_zip_urls.txt`. This is a text file where each line is a path to a github zip ball. The GlueJob class will download the github package rezip it and send it to S3. This github python package can then be accessed in the same way you would the local zip packages. For example if the `github_zip_urls.txt` file had a single line `https://github.com/moj-analytical-services/gluejobutils/archive/master.zip`. The package `gluejobutils` would be accessible in the `job.py` script:\n\n```python\nfrom gluejobutils.s3 import read_json_from_s3\n```\n\n#### shared_job_resources folder\n\nThis a specific folder (must have the name `shared_job_resources`). This folder has the same structure and restrictions as a normal glue job folder but does not have a `job.py` file. Instead anything in the `glue_resources` or `glue_py_resources` folders will also be used (and therefore uploaded to S3) by any other glue job. Take the example below:\n\n```\n\u251c\u2500\u2500 glue_jobs/\n\u2502   \u251c\u2500\u2500 job1/\n\u2502   |   \u251c\u2500\u2500 job.py\n\u2502   |   \u251c\u2500\u2500 glue_resources/\n|   |   |   \u2514\u2500\u2500 lookup_table.csv\n\u2502   |   \u2514\u2500\u2500 glue_py_resources/\n|   |       \u2514\u2500\u2500 job1_specific_functions.py\n|   |\n|   \u251c\u2500\u2500 shared_job_resources/\n\u2502   |   \u251c\u2500\u2500 glue_resources/\n|   |   |   \u2514\u2500\u2500 some_global_config.json\n\u2502   |   \u2514\u2500\u2500 glue_py_resources/\n|   |       \u2514\u2500\u2500 utils.py\n```\n\nRunning the glue job `job1` i.e.\n\n```python\njob = GlueJob('glue_jobs/job1/', bucket, job_role)\njob.run_job()\n```\n\nThis glue job would not only have access the the python script `job1_specific_functions.py` and file `lookup_table.csv` but also have access to the python script `utils.py` and file `some_global_config.json`. This is because the latter two files are in the `shared_job_resources` folder and accessible to all job folders (in their `glue_jobs` parent folder).\n\n**Note:** Users should make sure there is no naming conflicts between filenames that are uploaded to S3 as they are sent to the same working folder.\n\n### Using the Glue Job class\n\nReturning to the initial example:\n\n```python\nfrom etl_manager.etl import GlueJob\n\nmy_role = 'aws_role'\nbucket = 'bucket-to-store-temp-glue-job-in'\n\njob = GlueJob('glue_jobs/simple_etl_job/', bucket=bucket, job_role=my_role)\n```\n\nAllows you to create a job object. The GlueJob class will have a `job_name` which is defaulted to the folder name you pointed it to i.e. in this instance the job is called `simple_etl_job`. To change the job name:\n\n```python\njob.job_name = 'new_job_name'\n```\n\nIn AWS you can only have unique job names.\n\nOther useful function and properties:\n\n```python\n# Increase the number of workers on a glue job (default is 2)\njob.allocated_capacity = 5\n\n# Set job arguments these are input params that can be accessed by the job.py script\njob.job_arguments = {\"--test_arg\" : 'some_string', \"--enable-metrics\" : \"\"}\n```\n\n####\u00a0job_arguments\n\nThese are strings that can be passed to the glue job script. Below is an example of how these are accessed in the `job.py` script. This code snippit is taken from the `simple_etl_job` found in the `example` folder of this repo.\n\n```python\n# Example job tests access to all files passed to the job runner class\nimport sys\nimport os\n\nfrom awsglue.utils import getResolvedOptions\nfrom pyspark.context import SparkContext\nfrom awsglue.context import GlueContext\nfrom awsglue.job import Job\n\nfrom gluejobutils.s3 import read_json_from_s3\n\nargs = getResolvedOptions(sys.argv, ['JOB_NAME', 'metadata_base_path', 'test_arg'])\n\nprint \"JOB SPECS...\"\nprint \"JOB_NAME: \", args[\"JOB_NAME\"]\nprint \"test argument: \", args[\"test_arg\"]\n\n# Read in meta data json\nmeta_employees = read_json_from_s3(os.path.join(args['metadata_base_path'], \"employees.json\"))\n\n### etc\n```\n\n>**Notes:**\n> - The `test_arg` does not have two dashes in front of it. When specifying job_arguments with the GlueJob class it must be suffixed with `--` but you should remove these when accessing the args in the `job.py` script.\n> - `metadata_base_path` is a special parameter that is set by the GlueJob class. It is the S3 path to where the `meta_data` folder is in S3 so that you can read in your agnostic metadata files if you want to use them in your glue job. Note that the [gluejobutils](https://github.com/moj-analytical-services/gluejobutils) package has a lot of functionality with integrating our metadata jsons with spark.\n> - The GlueJob argument `--enable-metrics` is also a special parameter that enables you to see metrics of your glue job. [See here for more details on enabling metrics](https://docs.aws.amazon.com/en_us/glue/latest/dg/monitor-profile-glue-job-cloudwatch-metrics.html).\n> - Note that `JOB_NAME` is a special parameter that is not set in GlueJob but automatically passed to the AWS Glue when running `job.py`. [See here for more on special parameters](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html).\n\nExample of full `glue_job` and `meta_data` structures and code can be found [here](https://github.com/moj-analytical-services/etl_manager/tree/master/example).\n\n# Unit Tests\n\nThis package has [unit tests](https://github.com/moj-analytical-services/etl_manager/blob/master/tests/test_tests.py) which can also be used to see functionality.\n\nUnit tests can be ran by:\n\n```python\npython -m unittest tests.test_tests -v\n```\n",
        "description_content_type": "text/markdown",
        "docs_url": null,
        "download_url": "",
        "downloads": {
            "last_day": -1,
            "last_month": -1,
            "last_week": -1
        },
        "home_page": "",
        "keywords": "",
        "license": "MIT",
        "maintainer": "",
        "maintainer_email": "",
        "name": "etl-manager",
        "package_url": "https://pypi.org/project/etl-manager/",
        "platform": "",
        "project_url": "https://pypi.org/project/etl-manager/",
        "project_urls": null,
        "release_url": "https://pypi.org/project/etl-manager/7.5.1/",
        "requires_dist": [
            "boto3 (>=1.9.205)",
            "jsonschema (>=3.0.0)",
            "parameterized (>=0.7.0,<0.8.0)",
            "regex (>=2020.7.14,<2021.0.0)"
        ],
        "requires_python": ">=3.6,<4.0",
        "summary": "A python package to manage etl processes on AWS",
        "version": "7.5.1",
        "yanked": false,
        "yanked_reason": null
    },
    "last_serial": 12159156,
    "releases": {
        "7.0.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "be3e952b3b447b0a82b01f53196ad135",
                    "sha256": "258df6ee2ac7a2f8c8c0c11d1ce680d45c3a8551ba4de248c648f256170d2b69"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.1-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "be3e952b3b447b0a82b01f53196ad135",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 25886,
                "upload_time": "2019-10-29T14:07:17",
                "upload_time_iso_8601": "2019-10-29T14:07:17.447010Z",
                "url": "https://files.pythonhosted.org/packages/cd/c9/0670cee93ddde63493ee31ed2faab11b868206a96a1642fced2d56d12656/etl_manager-7.0.1-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "fe25af6096fe2321d03be194f29ddb7d",
                    "sha256": "744387e90462d3647745baa4949f2c19e34c992ed365d5a9221d4140e3e0c19d"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.1.tar.gz",
                "has_sig": false,
                "md5_digest": "fe25af6096fe2321d03be194f29ddb7d",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 27824,
                "upload_time": "2019-10-29T14:07:19",
                "upload_time_iso_8601": "2019-10-29T14:07:19.665961Z",
                "url": "https://files.pythonhosted.org/packages/7b/04/87729a5c67207745db6c44c2dec5ea29aa35cecc85d321afb0e0476525a0/etl_manager-7.0.1.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.0.2": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "d35d6cf6da12bf3f7d190161ade1b39d",
                    "sha256": "ed1b1086a24309c30084db7e094773906aead1d996cb6c016d6f37b5e88bbafe"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.2-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "d35d6cf6da12bf3f7d190161ade1b39d",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 26134,
                "upload_time": "2019-12-18T17:42:43",
                "upload_time_iso_8601": "2019-12-18T17:42:43.360864Z",
                "url": "https://files.pythonhosted.org/packages/58/c5/060d3bb6dacf58dca0cf1588fcdd255a87b1bbb687a01bfd0521ad8e5083/etl_manager-7.0.2-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "14360d5c4f4cf459c2d0194044547350",
                    "sha256": "cf384614a5f71596bab7d9f82d6f8ecacd7f59bca67e63b2138a766ce755e126"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.2.tar.gz",
                "has_sig": false,
                "md5_digest": "14360d5c4f4cf459c2d0194044547350",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 28021,
                "upload_time": "2019-12-18T17:42:45",
                "upload_time_iso_8601": "2019-12-18T17:42:45.378253Z",
                "url": "https://files.pythonhosted.org/packages/83/c1/b072603f6dfc4fdd47c0e389d9dade82685fe44b24b78011816d2b975e71/etl_manager-7.0.2.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.0.3": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "92467bc3fdd3737a71a42f9a7d09e440",
                    "sha256": "34b1d3a78c615b9e8e40741033b7ff65d83d5a7baa03d8004be479e6a8113e79"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.3-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "92467bc3fdd3737a71a42f9a7d09e440",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 26251,
                "upload_time": "2020-01-14T16:50:30",
                "upload_time_iso_8601": "2020-01-14T16:50:30.132221Z",
                "url": "https://files.pythonhosted.org/packages/b0/d2/b16ed2d81d1e256255a9f37bcb5fc4cd1cbbf0859ff899348ad501414d6b/etl_manager-7.0.3-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "38ac936437efb773708b6e8978b0f417",
                    "sha256": "9ca249e8a43f5dea924011564be31f3da11b9d498d209371631312f70d193096"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.3.tar.gz",
                "has_sig": false,
                "md5_digest": "38ac936437efb773708b6e8978b0f417",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 28306,
                "upload_time": "2020-01-14T16:50:32",
                "upload_time_iso_8601": "2020-01-14T16:50:32.544407Z",
                "url": "https://files.pythonhosted.org/packages/12/19/a333c002fffed67cbf0929a88df9b2d1095d99735ae3e3d2584da5686893/etl_manager-7.0.3.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.0.6": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "f6baadbc651c096a23c26098d04e2313",
                    "sha256": "1dae6f9b449fb5f02f849233a5983b11030c8ac1eaf97d239e5462786c7b9740"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.6-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "f6baadbc651c096a23c26098d04e2313",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28265,
                "upload_time": "2020-05-13T16:37:30",
                "upload_time_iso_8601": "2020-05-13T16:37:30.770805Z",
                "url": "https://files.pythonhosted.org/packages/aa/76/bb8c46459f325a47f5a4c0e0a66da4d406de7e97a22db601b25209494eab/etl_manager-7.0.6-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "7f5589ee2dff424a9319fd149191da3c",
                    "sha256": "12b44c012107bff4f1ae70b715d15177a43ebd02796b17330b9fd9b7a52f2f4e"
                },
                "downloads": -1,
                "filename": "etl_manager-7.0.6.tar.gz",
                "has_sig": false,
                "md5_digest": "7f5589ee2dff424a9319fd149191da3c",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30215,
                "upload_time": "2020-05-13T16:37:32",
                "upload_time_iso_8601": "2020-05-13T16:37:32.374514Z",
                "url": "https://files.pythonhosted.org/packages/7b/91/58dc65169b6977e1ba6c70f803600d5d255812253511e2d3c36714afbb3d/etl_manager-7.0.6.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.1.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "ebd665a68bec3b4c26cead9e02c8a035",
                    "sha256": "fe3d23dcf433fcd78c3fa51bf619b6cefc2581cb6ae6937cc7dcff33c0ecbc8e"
                },
                "downloads": -1,
                "filename": "etl_manager-7.1.1-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "ebd665a68bec3b4c26cead9e02c8a035",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28387,
                "upload_time": "2020-09-08T14:40:36",
                "upload_time_iso_8601": "2020-09-08T14:40:36.730961Z",
                "url": "https://files.pythonhosted.org/packages/34/cc/4bd3a5aaf0debfa58414eaf12410c1e0f7f9bf869edcbdc31d3176b9f08d/etl_manager-7.1.1-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "7d19d3e17c64df95d75e220d580d43bf",
                    "sha256": "27fd09fe7bd496ebeb36282c016af6b820ddd44e97f8a671325ab1270e0f4255"
                },
                "downloads": -1,
                "filename": "etl_manager-7.1.1.tar.gz",
                "has_sig": false,
                "md5_digest": "7d19d3e17c64df95d75e220d580d43bf",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30311,
                "upload_time": "2020-09-08T14:40:38",
                "upload_time_iso_8601": "2020-09-08T14:40:38.394677Z",
                "url": "https://files.pythonhosted.org/packages/f5/dc/503f88dea190bb97fa44741cd192bbc7083a30f07b6256add362312a22c5/etl_manager-7.1.1.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.2.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "876d86b36b577d1824638e4c5e75707c",
                    "sha256": "3bcedd918afea20c6ef5226c868e3bf29d57b5c90f5de3dd250ca2ebb3bb1491"
                },
                "downloads": -1,
                "filename": "etl_manager-7.2.0-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "876d86b36b577d1824638e4c5e75707c",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28637,
                "upload_time": "2020-09-22T10:56:01",
                "upload_time_iso_8601": "2020-09-22T10:56:01.348698Z",
                "url": "https://files.pythonhosted.org/packages/88/5e/db5427e74cb7fb7bb63762d7419575ca851d8a4819ad2610fa63062273ac/etl_manager-7.2.0-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "d5ace779b37f9a85b7e88d3bd6330e84",
                    "sha256": "26aa20134599448d6754a0683331afc851d88f1232372e8462432f48ab843a26"
                },
                "downloads": -1,
                "filename": "etl_manager-7.2.0.tar.gz",
                "has_sig": false,
                "md5_digest": "d5ace779b37f9a85b7e88d3bd6330e84",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30660,
                "upload_time": "2020-09-22T10:56:03",
                "upload_time_iso_8601": "2020-09-22T10:56:03.308722Z",
                "url": "https://files.pythonhosted.org/packages/14/16/421c145dc7adc6368e3f8844f4f282d08282837e9c05a74f2bb2b58742a0/etl_manager-7.2.0.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.3.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "85785c7fe597b088b8c7e0880fff6b2a",
                    "sha256": "e6181733de0257a2d8af6a0223d245c6c1d8758cbe33f764f634bf2b19ab4771"
                },
                "downloads": -1,
                "filename": "etl_manager-7.3.0-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "85785c7fe597b088b8c7e0880fff6b2a",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28641,
                "upload_time": "2020-10-27T14:54:56",
                "upload_time_iso_8601": "2020-10-27T14:54:56.620428Z",
                "url": "https://files.pythonhosted.org/packages/ab/4a/bf60d86ca0baa99d09db1f6d27df57d456117f2ce8f10648e2822c9f9721/etl_manager-7.3.0-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "0ea239567003b97d934e7bd208a63424",
                    "sha256": "f7f79a7611351f54a58fb1be28243bcb22a79888b5af96fbb5bd10383c644f81"
                },
                "downloads": -1,
                "filename": "etl_manager-7.3.0.tar.gz",
                "has_sig": false,
                "md5_digest": "0ea239567003b97d934e7bd208a63424",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30639,
                "upload_time": "2020-10-27T14:54:58",
                "upload_time_iso_8601": "2020-10-27T14:54:58.462780Z",
                "url": "https://files.pythonhosted.org/packages/a7/58/5df5e48398f3b52347e2b5ae63c9c04fd43b8c09094e3ee0ef9c9ddc7d24/etl_manager-7.3.0.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.4.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "85143c5a48eb17ca86feff0b7d2bce95",
                    "sha256": "4053d1bfa5f935ed54d90e6956f18e1445668476209f48c66fc0091101859d9a"
                },
                "downloads": -1,
                "filename": "etl_manager-7.4.0-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "85143c5a48eb17ca86feff0b7d2bce95",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28661,
                "upload_time": "2020-12-04T20:02:16",
                "upload_time_iso_8601": "2020-12-04T20:02:16.265405Z",
                "url": "https://files.pythonhosted.org/packages/51/37/bacdd73fe4bb88d018b91f628be3717b3ecbc6ec8b1469dec14bf0a6d068/etl_manager-7.4.0-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "e60ea2a0b36971c813ece7bd161054d6",
                    "sha256": "e389cb20c7817738a72cdedac42872926afc3606151778d37fca9889ebb21a80"
                },
                "downloads": -1,
                "filename": "etl_manager-7.4.0.tar.gz",
                "has_sig": false,
                "md5_digest": "e60ea2a0b36971c813ece7bd161054d6",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30708,
                "upload_time": "2020-12-04T20:02:17",
                "upload_time_iso_8601": "2020-12-04T20:02:17.998917Z",
                "url": "https://files.pythonhosted.org/packages/dd/98/b6186253b45b44103e01e6eefc8353040f43c7efee6493973c12ade63219/etl_manager-7.4.0.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.5.0": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "b6f68f19da0f62b53ca5bf10082bfb86",
                    "sha256": "28525db0464c9fd1f41cabc80168dab428a046a64cb9ec954f8bf4c3a9fe5d84"
                },
                "downloads": -1,
                "filename": "etl_manager-7.5.0-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "b6f68f19da0f62b53ca5bf10082bfb86",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28710,
                "upload_time": "2021-11-23T10:40:20",
                "upload_time_iso_8601": "2021-11-23T10:40:20.771216Z",
                "url": "https://files.pythonhosted.org/packages/75/61/962260ca64f809a39b4956c8a3c91c69f8ed2a011d32f207eb36def1bb58/etl_manager-7.5.0-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "d444a98ed8fbeaf44bb365653e7c614a",
                    "sha256": "d2977339c8f2597d6699200ab22311781e27107c5ad8c06f2d37043b462d9527"
                },
                "downloads": -1,
                "filename": "etl_manager-7.5.0.tar.gz",
                "has_sig": false,
                "md5_digest": "d444a98ed8fbeaf44bb365653e7c614a",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30603,
                "upload_time": "2021-11-23T10:40:22",
                "upload_time_iso_8601": "2021-11-23T10:40:22.176888Z",
                "url": "https://files.pythonhosted.org/packages/31/46/eaa0a445254d0da210d3957cd3079fdf1abc5ca91a84eefbe33490132acf/etl_manager-7.5.0.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ],
        "7.5.1": [
            {
                "comment_text": "",
                "digests": {
                    "md5": "0b0e645141879dfb421ebae3bd864ceb",
                    "sha256": "fe64c7c40a13865d85230ae7ca2ebde0c6ed5978555ac64f82aa78c6ad763ad4"
                },
                "downloads": -1,
                "filename": "etl_manager-7.5.1-py3-none-any.whl",
                "has_sig": false,
                "md5_digest": "0b0e645141879dfb421ebae3bd864ceb",
                "packagetype": "bdist_wheel",
                "python_version": "py3",
                "requires_python": ">=3.6,<4.0",
                "size": 28722,
                "upload_time": "2021-11-29T21:20:40",
                "upload_time_iso_8601": "2021-11-29T21:20:40.015758Z",
                "url": "https://files.pythonhosted.org/packages/ab/df/5cae96921c4629c38e29c41654b88346cfd13adc9a42b1fc356f77323994/etl_manager-7.5.1-py3-none-any.whl",
                "yanked": false,
                "yanked_reason": null
            },
            {
                "comment_text": "",
                "digests": {
                    "md5": "edffe1e7657e8aabb5a7416a3dcdf888",
                    "sha256": "d04306ec5c91e5b8817cad4a1d56e2d8d364f567b00adcc898338764cda4c294"
                },
                "downloads": -1,
                "filename": "etl_manager-7.5.1.tar.gz",
                "has_sig": false,
                "md5_digest": "edffe1e7657e8aabb5a7416a3dcdf888",
                "packagetype": "sdist",
                "python_version": "source",
                "requires_python": ">=3.6,<4.0",
                "size": 30604,
                "upload_time": "2021-11-29T21:20:41",
                "upload_time_iso_8601": "2021-11-29T21:20:41.886074Z",
                "url": "https://files.pythonhosted.org/packages/11/0d/c49eaa114af89159a253e5e7ba6d0b7bcee7764e330552b113b55b24c2df/etl_manager-7.5.1.tar.gz",
                "yanked": false,
                "yanked_reason": null
            }
        ]
    },
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "0b0e645141879dfb421ebae3bd864ceb",
                "sha256": "fe64c7c40a13865d85230ae7ca2ebde0c6ed5978555ac64f82aa78c6ad763ad4"
            },
            "downloads": -1,
            "filename": "etl_manager-7.5.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "0b0e645141879dfb421ebae3bd864ceb",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.6,<4.0",
            "size": 28722,
            "upload_time": "2021-11-29T21:20:40",
            "upload_time_iso_8601": "2021-11-29T21:20:40.015758Z",
            "url": "https://files.pythonhosted.org/packages/ab/df/5cae96921c4629c38e29c41654b88346cfd13adc9a42b1fc356f77323994/etl_manager-7.5.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "edffe1e7657e8aabb5a7416a3dcdf888",
                "sha256": "d04306ec5c91e5b8817cad4a1d56e2d8d364f567b00adcc898338764cda4c294"
            },
            "downloads": -1,
            "filename": "etl_manager-7.5.1.tar.gz",
            "has_sig": false,
            "md5_digest": "edffe1e7657e8aabb5a7416a3dcdf888",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6,<4.0",
            "size": 30604,
            "upload_time": "2021-11-29T21:20:41",
            "upload_time_iso_8601": "2021-11-29T21:20:41.886074Z",
            "url": "https://files.pythonhosted.org/packages/11/0d/c49eaa114af89159a253e5e7ba6d0b7bcee7764e330552b113b55b24c2df/etl_manager-7.5.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "vulnerabilities": []
}