{ "info": { "author": "Torsten Wolter", "author_email": "tow.berlin@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 4 - Beta", "License :: OSI Approved :: MIT License", "Programming Language :: Python :: 3.6", "Topic :: Text Processing :: Linguistic" ], "description": "# StockNews\nScrape financial News from Yahoo and analyse the sentiment (PoC)\n\n## Summary\nWith `stocknews`, you can scrape news data from the Yahoo Financial RSS Feed and store them with the sentiment of the headline and the summary.\nDepending on the initialization 1 or 2 files are output as csv. No. 1 is the scraped news (optional) and no. 2 is the summary, having the summarized sentiment of news for the given date (see options) and the values.\n\n## Install\nTo install the package, run `pip install stocknews`\n\n## Usage\nIn order to use `stocknews` to scrape news data and prepare them for your model you simply need this:\n\n```\nfrom stocknews import StockNews\n...\nstocks = ['AAPL', 'MSFT', 'NFLX']\nsn = StockNews(stocks, wt_key='MY_WORLD_TRADING_DATA_KEY')\ndf = sn.summarize()\n...\n```\n\nThis returns a pandas DataFrame and saves it to `data/data.csv` by default (see options)\n\n## Options\n* `stocks`: A list of stocks to check. See [http://eoddata.com/symbols.aspx](http://eoddata.com/symbols.aspx) for all symbols available\n* `news_file='news.csv'`: filename of the saved news\n* `summary_file='data.csv'`: filename of the saved dataset, including sentiment and value per day and stock\n* `save_news=True`: save the news file or scrape and analyse on the fly for recent news\n* `closing_hour=20`: Close of the exchange (NASDAQ in this case). News after closing will be taken for next trading day (skips the weekend as well)\n* `closing_minute=0`: Same as `closing_hour`\n* `wt_key=None`: Your worldtradingdata.com API Key. Get one [here](https://www.worldtradingdata.com/). Not needed if `read_rss` is called directly.\n\n## Dependencies\n* `pandas` [https://pypi.org/project/pandas/](https://pypi.org/project/pandas/)\n* `feedparser` [https://pypi.org/project/feedparser/](https://pypi.org/project/feedparser/)\n* `nltk` [https://pypi.org/project/nltk/](https://pypi.org/project/nltk/)\n* `requests`[https://pypi.org/project/requests/](https://pypi.org/project/requests/)\n* `numpy` [https://pypi.org/project/numpy/](https://pypi.org/project/numpy/)\n\n## Tests\n`python setup.py test`\n\n## ToDo\n* add more news sources\n* add more tests\n\n## Changes\n\n### 0.9.11\n* Fixed another pathing issue...\n\n### 0.9.10\n* removed the `exit()` *rolleyes*\n\n### 0.9.9\n* path issues fixed. For real now...\n\n### 0.9.8\n* fixed some path issues\n\n### 0.9.7\n* tried to fix too many requests, added a counter for made requests to keep track\n\n### 0.9.6\n* Suppress ntlk download messages\n* renamed `test.py`\n\n### 0.9.5\n* \"Initial Release\"\n\n### <0.9.5:\n* Testing", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "http://github.com/primus852/stock-news.git", "keywords": "sentiment news rss stock", "license": "MIT", "maintainer": "", "maintainer_email": "", "name": "stocknews", "package_url": "https://pypi.org/project/stocknews/", "platform": "", "project_url": "https://pypi.org/project/stocknews/", "project_urls": { "Homepage": "http://github.com/primus852/stock-news.git" }, "release_url": "https://pypi.org/project/stocknews/0.9.11/", "requires_dist": null, "requires_python": "", "summary": "PoC for scraping Yahoo News with sentiment analysis", "version": "0.9.11" }, "last_serial": 5540135, "releases": { "0.1": [ { "comment_text": "", "digests": { "md5": "12851f355ba2e5055c770533a0178af4", "sha256": "46354e64edd27dd1b55d605fbd1641ac5884be346dcaf0b4bb185f154f4f0783" }, "downloads": -1, "filename": "stocknews-0.1.tar.gz", "has_sig": false, "md5_digest": "12851f355ba2e5055c770533a0178af4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1741, "upload_time": "2019-07-12T08:12:07", "url": "https://files.pythonhosted.org/packages/14/e2/8acf8c0705d6ec7ec465ac3ddbf76a06cf04e6d5cb17a1611ad83e8a54b7/stocknews-0.1.tar.gz" } ], "0.2": [ { "comment_text": "", "digests": { "md5": "167257a7aec352ab15b295b892fbf499", "sha256": "8b442495c161a89ff724de36a4e97f4335023ed215d3c5aad64416aa97533048" }, "downloads": -1, "filename": "stocknews-0.2.tar.gz", "has_sig": false, "md5_digest": "167257a7aec352ab15b295b892fbf499", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 1851, "upload_time": "2019-07-12T08:19:28", "url": "https://files.pythonhosted.org/packages/e1/cf/182051d02ba19b90a15ae40c466f2c2d52d1154ff085964809a3a30084ce/stocknews-0.2.tar.gz" } ], "0.3": [ { "comment_text": "", "digests": { "md5": "51a5ac72f669aef275c010a752a74bfc", "sha256": "3a4a19bb34c05d40c24e2efbe98de2c59f180d7a1392b7450468c897b5cdf76f" }, "downloads": -1, "filename": "stocknews-0.3.tar.gz", "has_sig": false, "md5_digest": "51a5ac72f669aef275c010a752a74bfc", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2402, "upload_time": "2019-07-12T09:00:49", "url": "https://files.pythonhosted.org/packages/57/d8/496db7fbf09ae9ae82f957eae4d6fa609a4934ef8bd9416bc8099e712d02/stocknews-0.3.tar.gz" } ], "0.3.1": [ { "comment_text": "", "digests": { "md5": "88638408f7e084bf94a52605883402bf", "sha256": "1f2d3d72513f76dbbc632407298c20fefc861634e9700505246088874703e773" }, "downloads": -1, "filename": "stocknews-0.3.1.tar.gz", "has_sig": false, "md5_digest": "88638408f7e084bf94a52605883402bf", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2512, "upload_time": "2019-07-12T09:28:50", "url": "https://files.pythonhosted.org/packages/3a/7f/a6ab1f4b84fa4f5e91cf0e83961c268c27e5a8106571c0e643fd9bc8d6c5/stocknews-0.3.1.tar.gz" } ], "0.3.2": [ { "comment_text": "", "digests": { "md5": "4689590011ce7d8148be36fec3f6ef65", "sha256": "9cf869cccf47be6ef9aaa3ba46ec45dada82121edfce763502558927814b519b" }, "downloads": -1, "filename": "stocknews-0.3.2-py3.7.egg", "has_sig": false, "md5_digest": "4689590011ce7d8148be36fec3f6ef65", "packagetype": "bdist_egg", "python_version": "3.7", "requires_python": null, "size": 6646, "upload_time": "2019-07-13T15:05:38", "url": "https://files.pythonhosted.org/packages/30/04/ed24d1abfbc1690a5374437be21b4016273db733454724c25d4fce0b97e3/stocknews-0.3.2-py3.7.egg" }, { "comment_text": "", "digests": { "md5": "c21530cff2d508f876c1a60c9cee94fa", "sha256": "7f8b24be741a858ebbac2bb2ce1a511331bb4defb5af5b67fc62b8a9971b0447" }, "downloads": -1, "filename": "stocknews-0.3.2.tar.gz", "has_sig": false, "md5_digest": "c21530cff2d508f876c1a60c9cee94fa", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 2543, "upload_time": "2019-07-12T09:38:35", "url": "https://files.pythonhosted.org/packages/a1/f0/53de6c18cb695adba9cc47493bde1f8da91f3bc00e1b9f24f8549405012c/stocknews-0.3.2.tar.gz" } ], "0.5.1": [ { "comment_text": "", "digests": { "md5": "41be8385ed5e746dbfa27a241ed35c8e", "sha256": "84e80e669bde040f81c5c2819f24b8bbd4326625b93a685523ee59e42a788a1a" }, "downloads": -1, "filename": "stocknews-0.5.1.tar.gz", "has_sig": false, "md5_digest": "41be8385ed5e746dbfa27a241ed35c8e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3416, "upload_time": "2019-07-13T16:33:44", "url": "https://files.pythonhosted.org/packages/5a/32/ed5788c4d662e4e471e379b706ea29f6afbfbc434928e3353ac40b624d99/stocknews-0.5.1.tar.gz" } ], "0.5.2": [ { "comment_text": "", "digests": { "md5": "c12f22ee17949d8d1337e98a04cd2c61", "sha256": "97a3705217460785ee377b0b52782a00add6854bcf01c08c6065d8189a998ad6" }, "downloads": -1, "filename": "stocknews-0.5.2.tar.gz", "has_sig": false, "md5_digest": "c12f22ee17949d8d1337e98a04cd2c61", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3427, "upload_time": "2019-07-13T16:45:14", "url": "https://files.pythonhosted.org/packages/d4/3c/4e96975e242ebfdc8c5c721b04a8cd96287f4e65629ed46cd9066e0b7f89/stocknews-0.5.2.tar.gz" } ], "0.5.3": [ { "comment_text": "", "digests": { "md5": "bcd5827d6c5b90292d10d1ca94bed03e", "sha256": "177dbb209258856fc057a9b3ca20f9e15dd26609e0ac97c6e74a4bee35447c0b" }, "downloads": -1, "filename": "stocknews-0.5.3.tar.gz", "has_sig": false, "md5_digest": "bcd5827d6c5b90292d10d1ca94bed03e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3361, "upload_time": "2019-07-13T18:26:27", "url": "https://files.pythonhosted.org/packages/34/a5/11f7fa188a601cf49cfd0bb30a12e71e8e839edf3b3bc0e88c38492e194f/stocknews-0.5.3.tar.gz" } ], "0.9.0": [ { "comment_text": "", "digests": { "md5": "6367058442458446e4c2ae7650a09f77", "sha256": "3af726833831d9ec9f966e1926a073c259767f67bbf84c694013ad6ce7d5f283" }, "downloads": -1, "filename": "stocknews-0.9.0.tar.gz", "has_sig": false, "md5_digest": "6367058442458446e4c2ae7650a09f77", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 3576, "upload_time": "2019-07-13T19:37:22", "url": "https://files.pythonhosted.org/packages/d8/47/bb667b05ee26df50c8ff6de32fd8bbd96004993f95481b2a9f5e239b20b1/stocknews-0.9.0.tar.gz" } ], "0.9.10": [ { "comment_text": "", "digests": { "md5": "4803fec428757df64c7e9f36ef7316dd", "sha256": "81a63f1565fa56b59faa4d4c3a780984c9727656b5f8f8626a5bc86f542d85a7" }, "downloads": -1, "filename": "stocknews-0.9.10.tar.gz", "has_sig": false, "md5_digest": "4803fec428757df64c7e9f36ef7316dd", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5379, "upload_time": "2019-07-16T07:16:25", "url": "https://files.pythonhosted.org/packages/60/9a/b05b81df0a92e5c7b711f25b5906aa41719e78cf043c554e216b4d7e57ad/stocknews-0.9.10.tar.gz" } ], "0.9.11": [ { "comment_text": "", "digests": { "md5": "ede3f815f668250ea8dfaca45452f637", "sha256": "c440ecfeccf3b4ddd9f27d4105ba450ed082ecc415845d03a646f872778fc659" }, "downloads": -1, "filename": "stocknews-0.9.11.tar.gz", "has_sig": false, "md5_digest": "ede3f815f668250ea8dfaca45452f637", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5403, "upload_time": "2019-07-16T11:54:23", "url": "https://files.pythonhosted.org/packages/ee/fd/b50941b623fc5bf54a79856b4685c50b055b65dd3a118f0e14f3e5a8eaab/stocknews-0.9.11.tar.gz" } ], "0.9.5": [ { "comment_text": "", "digests": { "md5": "7285c2d8b4c6396e503871269a6780c4", "sha256": "b2a3babd29b39f86081e4573f5dc32175674d2aa023639dea4d04b5567ef54be" }, "downloads": -1, "filename": "stocknews-0.9.5.tar.gz", "has_sig": false, "md5_digest": "7285c2d8b4c6396e503871269a6780c4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5120, "upload_time": "2019-07-15T12:23:20", "url": "https://files.pythonhosted.org/packages/b0/1c/2e3470ae35056becad0c58ec024b381ee300eb3aa771772683de78f2ba27/stocknews-0.9.5.tar.gz" } ], "0.9.6": [ { "comment_text": "", "digests": { "md5": "a047bebfe65f01d30c8b34ddefb6035e", "sha256": "b20c139948b1480385ca8da019f37dc49d566af1466db784ed56996290048781" }, "downloads": -1, "filename": "stocknews-0.9.6.tar.gz", "has_sig": false, "md5_digest": "a047bebfe65f01d30c8b34ddefb6035e", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5159, "upload_time": "2019-07-15T12:40:08", "url": "https://files.pythonhosted.org/packages/6e/43/be46f8add82fcb6324745311177d82e33550fcd4401e4b80bf013852677d/stocknews-0.9.6.tar.gz" } ], "0.9.7": [ { "comment_text": "", "digests": { "md5": "c4adf306c0544c89f96bce50590097c8", "sha256": "baa50c26cab34cb35f70064b9274a38d2a511e82bf168cd904403f31fd3c416f" }, "downloads": -1, "filename": "stocknews-0.9.7.tar.gz", "has_sig": false, "md5_digest": "c4adf306c0544c89f96bce50590097c8", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5247, "upload_time": "2019-07-16T06:48:58", "url": "https://files.pythonhosted.org/packages/dd/58/e5c1c50b0a9101f8ba254180f235fc141dd9e2434e7f2b55f6fb126dea0b/stocknews-0.9.7.tar.gz" } ], "0.9.8": [ { "comment_text": "", "digests": { "md5": "cfe78592e295f2eaa97a8bd5569bd8ad", "sha256": "bec4a1c1892a9b316a4d5807214a351f0a4a4b424036ed51ceb3edb14984de61" }, "downloads": -1, "filename": "stocknews-0.9.8.tar.gz", "has_sig": false, "md5_digest": "cfe78592e295f2eaa97a8bd5569bd8ad", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5301, "upload_time": "2019-07-16T07:04:54", "url": "https://files.pythonhosted.org/packages/f3/5c/c53146409bb20e162a6568a0370470bcb57c25e89c0b34811d922b7dd6ee/stocknews-0.9.8.tar.gz" } ], "0.9.9": [ { "comment_text": "", "digests": { "md5": "3fa26a5db99400c61f23dd12a841ff30", "sha256": "855eec7b01d08243844e4c1a286a8e8f1c88d1fd1babeb5761df9b11334750b0" }, "downloads": -1, "filename": "stocknews-0.9.9.tar.gz", "has_sig": false, "md5_digest": "3fa26a5db99400c61f23dd12a841ff30", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5345, "upload_time": "2019-07-16T07:13:40", "url": "https://files.pythonhosted.org/packages/af/18/09ed40f30f91987b8d335c461f37947aac0970ed1521e97ce9da13a593c1/stocknews-0.9.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "ede3f815f668250ea8dfaca45452f637", "sha256": "c440ecfeccf3b4ddd9f27d4105ba450ed082ecc415845d03a646f872778fc659" }, "downloads": -1, "filename": "stocknews-0.9.11.tar.gz", "has_sig": false, "md5_digest": "ede3f815f668250ea8dfaca45452f637", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 5403, "upload_time": "2019-07-16T11:54:23", "url": "https://files.pythonhosted.org/packages/ee/fd/b50941b623fc5bf54a79856b4685c50b055b65dd3a118f0e14f3e5a8eaab/stocknews-0.9.11.tar.gz" } ] }