{ "info": { "author": "Jeremy Maitin-Shepard", "author_email": "jeremy@jeremyms.com", "bugtrack_url": null, "classifiers": [], "description": "Python package for scraping personal financial data from financial\ninstitutions.\n\n[![License: GPL v2](https://img.shields.io/badge/License-GPL%20v2-blue.svg)](LICENSE)\n[![Build Status](https://travis-ci.com/jbms/finance-dl.svg?branch=master)](https://travis-ci.com/jbms/finance-dl)\n\nThis package may be useful on its own, but is specifically designed to be\nused with\n[beancount-import](https://github.com/jbms/beancount-import).\n\nSupported data sources\n==\n\n- [finance_dl.ofx](finance_dl/ofx.py): uses\n [ofxclient](https://github.com/captin411/ofxclient) to download data\n using the OFX protocol.\n- [finance_dl.mint](finance_dl/mint.py): uses\n [mintapi](https://github.com/mrooney/mintapi) to download data from\n the Mint.com website.\n- [finance_dl.venmo](finance_dl/venmo.py): downloads transaction and\n balance information from the Venmo.com website\n- [finance_dl.paypal](finance_dl/paypal.py): downloads transactions\n from the Paypal.com website\n- [finance_dl.amazon](finance_dl/amazon.py): downloads order invoices\n from the Amazon website\n- [finance_dl.healthequity](finance_dl/healthequity.py): downloads\n transaction history and balance information from the HealthEquity\n website.\n- [finance_dl.google_purchases](finance_dl/google_purchases.py):\n downloads purchases that Google has heuristically extracted from\n Gmail messages.\n- [finance_dl.stockplanconnect](finance_dl/stockplanconnect.py):\n downloads PDF documents (including release and trade confirmations)\n from the Morgan Stanley Stockplanconnect website.\n- [finance_dl.pge](finance_dl/pge.py): downloads Pacific Gas &\n Electric (PG&E) PDF bills.\n- [finance_dl.comcast](finance_dl/comcast.py): downloads Comcast PDF\n bills.\n- [finance_dl.ebmud](finance_dl/ebmud.py): downloads East Bay\n Municipal Utility District (EBMUD) water bills.\n- [finance_dl.anthem](finance_dl/anthem.py): downloads Anthem\n BlueCross insurance claim statements.\n- [finance_dl.waveapps](finance_dl/waveapps.py): downloads receipt\n images and extracted transaction data from\n [Wave](https://waveapps.com), which is a free receipt-scanning\n website/mobile app.\n- [finance_dl.ultipro_google](finance_dl/ultipro_google.py): downloads\n Google employee payroll statements in PDF format from Ultipro.\n\nSetup\n==\n\nTo install the most recent published package from PyPi, simply type:\n\n```shell\npip install finance-dl\n```\n\nTo install from a clone of the repository, type:\n\n```shell\npip install .\n```\n\nor for development:\n\n```shell\npip install -e .\n```\n\nConfiguration\n==\n\nCreate a Python file like `example_finance_dl_config.py`.\n\nRefer to the documentation of the individual scraper modules for\ndetails.\n\nBasic Usage\n==\n\nYou can run a scraping configuration named `myconfig` as follows:\n\n python -m finance_dl.cli --config-module example_finance_dl_config --config myconfig\n\nThe configuration `myconfig` refers to a function named\n`CONFIG_myconfig` in the configuration module.\n\nMake sure that your configuration module is accessible in your Python\n`sys.path`. Since `sys.path` includes the current directory by\ndefault, you can simply run this command from the directory that\ncontains your configuration module.\n\nBy default, the scrapers run fully automatically, and the ones based\non `selenium` and `chromedriver` run in headless mode. If the initial\nattempt for a `selenium`-based scraper fails, it is automatically\nretried again with the browser window visible. This allows you to\nmanually complete the login process and enter any multi-factor\nauthentication code that is required.\n\nTo debug a scraper, you can run it in interactive mode by specifying\nthe `-i` command-line argument. This runs an interactive IPython\nshell that lets you manually invoke parts of the scraping process.\n\nAutomatic Usage\n==\n\nTo run multiple configurations at once, and keep track of when each\nconfiguration was last updated, you can use the `finance_dl.update`\ntool.\n\nTo display the update status, first create a `logs` directory and run:\n\n python -m finance_dl.update --config-module example_finance_dl_config --log-dir logs status\n\nInitially, this will indicate that none of the configurations have\nbeen updated. To update a single configuration `myconfig`, run:\n\n python -m finance_dl.update --config-module example_finance_dl_config --log-dir logs update myconfig\n\nWith a single configuration specified, this does the same thing as the\n`finance_dl.cli` tool, except that the log messages are written to\n`logs/myconfig.txt` and a `logs/myconfig.lastupdate` file is created\nif it is successful.\n\nIf multiple configurations are specified, as in:\n\n python -m finance_dl.update --config-module example_finance_dl_config --log-dir logs update myconfig1 myconfig2\n\nthen all specified configurations are run in parallel.\n\nTo update all configurations, run:\n\n python -m finance_dl.update --config-module example_finance_dl_config --log-dir logs update --all\n\nLicense\n==\n\nCopyright (C) 2014-2018 Jeremy Maitin-Shepard.\n\nDistributed under the GNU General Public License, Version 2.0 only.\nSee [LICENSE](LICENSE) file for details.", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/jbms/finance-dl", "keywords": "", "license": "GPLv2", "maintainer": "", "maintainer_email": "", "name": "finance-dl", "package_url": "https://pypi.org/project/finance-dl/", "platform": "", "project_url": "https://pypi.org/project/finance-dl/", "project_urls": { "Homepage": "https://github.com/jbms/finance-dl" }, "release_url": "https://pypi.org/project/finance-dl/1.3.2/", "requires_dist": null, "requires_python": ">=3.5", "summary": "Tools for scraping personal financial data.", "version": "1.3.2" }, "last_serial": 5206098, "releases": { "1.0.0": [ { "comment_text": "", "digests": { "md5": "ff389ab03e788bd54dba9da5d19597f6", "sha256": "4518b7b901ae0196eba86e7930bf69ca7481c03f86df29150f9626c80e0482b9" }, "downloads": -1, "filename": "finance-dl-1.0.0.zip", "has_sig": false, "md5_digest": "ff389ab03e788bd54dba9da5d19597f6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 32938, "upload_time": "2018-10-04T21:57:54", "url": "https://files.pythonhosted.org/packages/35/90/7af2d7aaf10f7825093653c6388af959e3f95a1b89e52b3587dcfbeef620/finance-dl-1.0.0.zip" } ], "1.0.1": [ { "comment_text": "", "digests": { "md5": "e83b44909a3b64d70b4b59e328b986fc", "sha256": "bb24056fa04e180bfd6dcc58f73a55b89a5cefa290e9949ce51be26936ca4f97" }, "downloads": -1, "filename": "finance-dl-1.0.1.zip", "has_sig": false, "md5_digest": "e83b44909a3b64d70b4b59e328b986fc", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 40179, "upload_time": "2018-10-31T05:40:56", "url": "https://files.pythonhosted.org/packages/49/48/fb10c379e8492945d022b87fcdb90ffb10fd6fff03c8b3d27963faacd6e9/finance-dl-1.0.1.zip" } ], "1.0.2": [ { "comment_text": "", "digests": { "md5": "0105c035cb4c557649a92f1efb556333", "sha256": "9e181a2c00c4af11f773af7eb3158e7adc9852f697bc366b53470e9aaa46e03e" }, "downloads": -1, "filename": "finance-dl-1.0.2.zip", "has_sig": false, "md5_digest": "0105c035cb4c557649a92f1efb556333", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 53130, "upload_time": "2018-12-19T05:56:17", "url": "https://files.pythonhosted.org/packages/80/28/54e8e29f370bb95b811aade14774a0f883c14f3c4efc073aea6a4fba4332/finance-dl-1.0.2.zip" } ], "1.0.3": [ { "comment_text": "", "digests": { "md5": "a7d63bf8301f38a3fd9a622ffd6d690f", "sha256": "2fff6936727bf0795578799aebecda77a3f550363884cd298cae9e04addb3b9a" }, "downloads": -1, "filename": "finance-dl-1.0.3.zip", "has_sig": false, "md5_digest": "a7d63bf8301f38a3fd9a622ffd6d690f", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 53206, "upload_time": "2019-01-13T18:47:01", "url": "https://files.pythonhosted.org/packages/73/af/2b3bd4a77220f7586507f380f093fd0dd21b2112181754c586b31e634d78/finance-dl-1.0.3.zip" } ], "1.0.4": [ { "comment_text": "", "digests": { "md5": "c4cbffe98d8dfbb15c031b41d3ee62ce", "sha256": "f7415bb107b981dd649bb0fd0e2589d109304514b66654bc58e59ec01e93e3a5" }, "downloads": -1, "filename": "finance-dl-1.0.4.zip", "has_sig": false, "md5_digest": "c4cbffe98d8dfbb15c031b41d3ee62ce", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 58436, "upload_time": "2019-01-20T21:46:01", "url": "https://files.pythonhosted.org/packages/53/a9/e6cc94627f4ab3c3c97b3242deeac2991b858ee69882854275d4d56558c4/finance-dl-1.0.4.zip" } ], "1.1.0": [ { "comment_text": "", "digests": { "md5": "163a574305f20f2bf9f58ad9d394210e", "sha256": "2fe6ff8df322c23ec7f9d4c8c09301694cdd55241cb599bae938bee41738f59d" }, "downloads": -1, "filename": "finance-dl-1.1.0.zip", "has_sig": false, "md5_digest": "163a574305f20f2bf9f58ad9d394210e", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 61705, "upload_time": "2019-01-24T20:00:24", "url": "https://files.pythonhosted.org/packages/96/9c/ee21ba86d79eba1b412d17c0ca90080ff4a8ab48862b381fc81971651cd3/finance-dl-1.1.0.zip" } ], "1.2.0": [ { "comment_text": "", "digests": { "md5": "f22fe460d2c49eceb69fc9e4b4c75e06", "sha256": "744717a3218f4aa85f02505017537d29cba3c1144eccbf5c5963dbddbe31e445" }, "downloads": -1, "filename": "finance-dl-1.2.0.zip", "has_sig": false, "md5_digest": "f22fe460d2c49eceb69fc9e4b4c75e06", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 62193, "upload_time": "2019-03-04T00:10:04", "url": "https://files.pythonhosted.org/packages/65/b3/f364ab8efc3d23dd15c39bd1b9d4f500441b21e257b4e7ee68711f75955e/finance-dl-1.2.0.zip" } ], "1.2.1": [ { "comment_text": "", "digests": { "md5": "5c56119d727b5757a1b347567651eebd", "sha256": "b3f63ec344defad9c5c7d0f0ce731ae3f1fd78f3ff229adcef4f38108a82ad51" }, "downloads": -1, "filename": "finance-dl-1.2.1.zip", "has_sig": false, "md5_digest": "5c56119d727b5757a1b347567651eebd", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 62123, "upload_time": "2019-03-09T22:11:02", "url": "https://files.pythonhosted.org/packages/65/66/d430e5622abe4e0b79d1299edc00c4d8358b392c762f631600696629ae1f/finance-dl-1.2.1.zip" } ], "1.3.0": [ { "comment_text": "", "digests": { "md5": "d056e5e851adae40101538f25e52fe44", "sha256": "80b6ad927ccd2bb72ea87106b5ec49ccfada2bf3389a79f14d82f84e5c72e5c1" }, "downloads": -1, "filename": "finance-dl-1.3.0.zip", "has_sig": false, "md5_digest": "d056e5e851adae40101538f25e52fe44", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 62887, "upload_time": "2019-03-19T03:22:55", "url": "https://files.pythonhosted.org/packages/2c/7f/54a97a47b5e01393adb0a2cf59af03b1013a135a1b3e3bae596227dd0ecc/finance-dl-1.3.0.zip" } ], "1.3.1": [ { "comment_text": "", "digests": { "md5": "fb433f4a9d21b9681df9c864c04f2c5a", "sha256": "65d3565fd067fabbb6a8d4be7ab9f8c6e393ac9f91e2cc1924e15c07e2c22b4f" }, "downloads": -1, "filename": "finance-dl-1.3.1.zip", "has_sig": false, "md5_digest": "fb433f4a9d21b9681df9c864c04f2c5a", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 63624, "upload_time": "2019-03-24T14:14:25", "url": "https://files.pythonhosted.org/packages/49/ac/d4c9e1e511df6501e5239cde578fd687aba96ae67356d9b41495e9f6db43/finance-dl-1.3.1.zip" } ], "1.3.2": [ { "comment_text": "", "digests": { "md5": "03989d6314db551048caca26993f8f55", "sha256": "db176e62245a10e81fbd97aad8f60bfe833effdda8dd4cc3e2c84fde36f63301" }, "downloads": -1, "filename": "finance-dl-1.3.2.zip", "has_sig": false, "md5_digest": "03989d6314db551048caca26993f8f55", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 63836, "upload_time": "2019-04-30T03:07:53", "url": "https://files.pythonhosted.org/packages/0b/5d/d149c3650166f78821134174210aeba405ee61e83e7a4181a3f5ff0a294b/finance-dl-1.3.2.zip" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "03989d6314db551048caca26993f8f55", "sha256": "db176e62245a10e81fbd97aad8f60bfe833effdda8dd4cc3e2c84fde36f63301" }, "downloads": -1, "filename": "finance-dl-1.3.2.zip", "has_sig": false, "md5_digest": "03989d6314db551048caca26993f8f55", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.5", "size": 63836, "upload_time": "2019-04-30T03:07:53", "url": "https://files.pythonhosted.org/packages/0b/5d/d149c3650166f78821134174210aeba405ee61e83e7a4181a3f5ff0a294b/finance-dl-1.3.2.zip" } ] }