{ "info": { "author": "Andrea Lamparelli", "author_email": "lampa9559@gmail.com", "bugtrack_url": null, "classifiers": [ "Development Status :: 3 - Alpha", "Intended Audience :: Developers", "Intended Audience :: Science/Research", "License :: OSI Approved :: MIT License", "Natural Language :: English", "Programming Language :: Python :: 3.7", "Topic :: Software Development :: Libraries :: Python Modules" ], "description": "PTDC: PYTHON TWITTER DATA COLLECTOR\n===================================\n\n[|Author|] |PyPi| [|Python 3.7|] |license|\n\nPython Twitter data collector built on\n`Tweepy `__ that allow users to\ndynamically collect accounts and statuses from Twitter during streaming,\nand automatically generate Datasets from collected data that you can as\nCSV.\n\nThis library provides a framework that you can use to build your own\ndata collector, specifying which are your features that have to be\nextracted from Twitter accounts/statuses.\n\nCreating your Twitter dataset: 1. Instantiate an ``AccountCollector``\nand/or ``StatusCollector`` class in according to what you want collect,\naccounts, statuses or both. At this step you can re-defined your own\nfeatures that have to be extracted from twitter data, you have to pass\ndict-like parameters in the following form: \nwhere the function has to be applied to the user or status object.\nPlease refer to\n`documentation `__\nfor more details about Twitter objects 2. Instantiate the\n``OnlineStreamer`` passing the collector as parameter 3. Start streaming\non some topics 4. Save the created dataset at specified location\n\nNB: It is not mandatory to use both collectors and streamer but you can\nalso use Collectors alone, for instance if you already have the users\nand/or statuses to collect and you don\u2019t need to stream anything.\n\n**NEW FEATURES:** \\* *Offline collection by name*, allow user to make a\nquery by name and collect some name-similar users extracting features\ndefined in the collector constructor\n\nINSTALLATION\n------------\n\nThe package is available on PyPi\n`here `__\n\n.. code:: bash\n\n $ pip install ptdc\n\nEXAMPLE USAGE\n-------------\n\nImport modules\n~~~~~~~~~~~~~~\n\n::\n\n from ptdc import authenticate, AccountCollector, OnlineStreamer, StatusCollector\n\nDefine tokens\n~~~~~~~~~~~~~\n\nReplace the following tokens with yours, see Twitter developers\n`authentication `__\nfor more details about how obtain them.\n\n::\n\n consumer_key = \"xxxxxxxxxxx\"\n consumer_key_secret = \"xxxxxxxxxxxxx\"\n access_token = \"xxxxxxxxxxxxxxxxxxxxxx\"\n access_token_secret = \"xxxxxxxxxxxxxxxxxx\"\n\nCreate the default Tweepy API object of tweepy\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\n::\n\n api = authenticate(consumer_key=consumer_key, consumer_key_secret=consumer_key_secret, access_token=access_token, access_token_secret=access_token_secret)\n\nCreate your own Collectors for collecting data\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nCreate your own StatusCollector object\n\n::\n\n s_collector = StatusCollector(api=api)\n\nCreate your own AccountCollector object, which will collect also\nstatuses\n\n::\n\n collector = AccountCollector(api=api, statuses_collector=s_collector)\n\nCreate the Streamer\n~~~~~~~~~~~~~~~~~~~\n\nCreate Online Streamer that will collect data (in this case will collect\nonly 5 accounts)\n\n::\n\n streamer = OnlineStreamer(api=api, collector=collector, data_limit=5, n_statuses=400)\n\nStart streaming\n~~~~~~~~~~~~~~~\n\nYou can start streaming in all ways defined by Tweepy, see its doc for\nmore details\n\n::\n\n streamer.stream(track=['famous', 'web', 'vip', 'holiday', 'pic', 'photo'], is_async=False)\n\nSave dataset/s\n~~~~~~~~~~~~~~\n\nAfter streaming ended (in according to your defined limits), save\nDataFrame/s generated into csv file/s. You just need to access the\ncollector object and call the save_dataset method providing the path.\n\n::\n\n streamer.collector.save_dataset(path=\"../data/accounts.csv\")\n\nQuestions and Contributing\n--------------------------\n\nFeel free to post questions and problems on the issue tracker. Pull\nrequests are welcome!\n\nFeel free to fork and modify or add new features and functionality to\nthe library\n\n.. |Author| image:: http://img.shields.io/badge/author-lampajr-blue.svg?style=flat-square\n.. |PyPi| image:: https://img.shields.io/pypi/v/ptdc.svg?style=flat-square\n :target: https://pypi.org/project/ptdc/\n.. |Python 3.7| image:: https://img.shields.io/pypi/pyversions/ptdc.svg\n.. |license| image:: https://img.shields.io/github/license/mashape/apistatus.svg?style=flat-square\n :target: https://github.com/lampajr/PTDC/blob/master/LICENSE\n\n\n", "description_content_type": "", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://github.com/lampajr/PTDC/", "keywords": "twitter api tweepy collection data streaming", "license": "MIT License", "maintainer": "", "maintainer_email": "", "name": "ptdc", "package_url": "https://pypi.org/project/ptdc/", "platform": "", "project_url": "https://pypi.org/project/ptdc/", "project_urls": { "Homepage": "https://github.com/lampajr/PTDC/" }, "release_url": "https://pypi.org/project/ptdc/1.3.6/", "requires_dist": [ "urllib3", "numpy", "pandas", "tweepy", "simplejson" ], "requires_python": "", "summary": "Twitter data collection library", "version": "1.3.6" }, "last_serial": 5328541, "releases": { "1.2.0": [ { "comment_text": "", "digests": { "md5": "848c0997c50c95d3eb85f461c94de829", "sha256": "e5c7e347a8d9962c022b4c4a29eeaf2efcaa00b1357a90db2ce3ab769d4dd1ad" }, "downloads": -1, "filename": "ptdc-1.2.0-py3-none-any.whl", "has_sig": false, "md5_digest": "848c0997c50c95d3eb85f461c94de829", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12080, "upload_time": "2019-05-08T12:03:21", "url": "https://files.pythonhosted.org/packages/4a/fc/3dd511b8db4ac6cf42043ad02a355274ff8d46e0eb92ea4bce0ffdd03b56/ptdc-1.2.0-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "cf87c5c96c2da51f044d8e96d1a98da4", "sha256": "57d26731096d286fddc387394c130c2bcada3b57727b5d8745b37cc27592a6ec" }, "downloads": -1, "filename": "ptdc-1.2.0.tar.gz", "has_sig": false, "md5_digest": "cf87c5c96c2da51f044d8e96d1a98da4", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11600, "upload_time": "2019-05-08T12:03:24", "url": "https://files.pythonhosted.org/packages/dd/82/be0cc97f5de10ebd2fe662d1a1a9d87ee7ecce788c352fea2888b77c7981/ptdc-1.2.0.tar.gz" } ], "1.2.1": [ { "comment_text": "", "digests": { "md5": "5db01af99c83dd6d7dcf2e2b22a16b15", "sha256": "f6c2cfbd63b56a2bd9aadc23a22e1d4cdd0ba48c19be426be3c39ca9bb4f34a8" }, "downloads": -1, "filename": "ptdc-1.2.1-py3-none-any.whl", "has_sig": false, "md5_digest": "5db01af99c83dd6d7dcf2e2b22a16b15", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12081, "upload_time": "2019-05-08T12:26:23", "url": "https://files.pythonhosted.org/packages/6a/e1/a3b49a18fbbd37683225019c673bc7a7a389f55d41ec1e0f5f4dd70a399b/ptdc-1.2.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "6cf3220718b029c4ce87a4c1b9b32b63", "sha256": "0cb0322ffd0eac63bf881acea768f255d5967c732fb0d82ef8a69decf25ef69c" }, "downloads": -1, "filename": "ptdc-1.2.1.tar.gz", "has_sig": false, "md5_digest": "6cf3220718b029c4ce87a4c1b9b32b63", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11608, "upload_time": "2019-05-08T12:26:25", "url": "https://files.pythonhosted.org/packages/98/d7/06ca85fb2cf8592e4e5c16e05b33d5f01ee72d2a4f87dbccb0a11bc6526f/ptdc-1.2.1.tar.gz" } ], "1.2.2": [ { "comment_text": "", "digests": { "md5": "05b3f19437e10f144c1eac814b255c9b", "sha256": "b64c394c3337a004400799e8d39c6bbef5616a92c5d32502c8a4c2f7f9ee43ac" }, "downloads": -1, "filename": "ptdc-1.2.2-py3-none-any.whl", "has_sig": false, "md5_digest": "05b3f19437e10f144c1eac814b255c9b", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11732, "upload_time": "2019-05-08T12:32:47", "url": "https://files.pythonhosted.org/packages/f9/c6/1497a629e1036e9d55e54a5c0712be99abeeef75268d665f91f356e84cb8/ptdc-1.2.2-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "19438ebcb22292b40a9d031033b88dbe", "sha256": "e4657bba85ea34d1437929170171bca9937cd4c2c5fa570bca555adae9ec95a5" }, "downloads": -1, "filename": "ptdc-1.2.2.tar.gz", "has_sig": false, "md5_digest": "19438ebcb22292b40a9d031033b88dbe", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11474, "upload_time": "2019-05-08T12:32:48", "url": "https://files.pythonhosted.org/packages/1e/f5/995abb8abb5da4f451ccb95f8bd2c32d0cecbdd830fd9caf2a57869824f0/ptdc-1.2.2.tar.gz" } ], "1.2.5": [ { "comment_text": "", "digests": { "md5": "60ba90d795a12a78357e4b2556cdb217", "sha256": "96fc86a59dad5b28f0cc2cfef0fb54b2a3d02ff6ef27bcfc5ab5ff1a07041ec7" }, "downloads": -1, "filename": "ptdc-1.2.5-py3-none-any.whl", "has_sig": false, "md5_digest": "60ba90d795a12a78357e4b2556cdb217", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11870, "upload_time": "2019-05-09T20:24:48", "url": "https://files.pythonhosted.org/packages/f7/9c/3770ef06dbe1ee6103675994fd0b2be36299d150f4bcddda019a88eb500f/ptdc-1.2.5-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "9f2cb5af98f344f80a5c42e35a911a74", "sha256": "5f7577cdd85a828d77a2b0f46b8000756158774f25921ef28be14b0acca0eb9f" }, "downloads": -1, "filename": "ptdc-1.2.5.tar.gz", "has_sig": false, "md5_digest": "9f2cb5af98f344f80a5c42e35a911a74", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11532, "upload_time": "2019-05-09T20:24:49", "url": "https://files.pythonhosted.org/packages/4e/81/4945000367c745d9ddd6680853d718d1678e511a627c2b26a4e5589411e7/ptdc-1.2.5.tar.gz" } ], "1.2.6": [ { "comment_text": "", "digests": { "md5": "21a9f33bf762fca373682f19c6ce6050", "sha256": "07ac31c00c32967bb6fcaa007443e8a39c907f055d239624646b5f2c014cf7fc" }, "downloads": -1, "filename": "ptdc-1.2.6-py3-none-any.whl", "has_sig": false, "md5_digest": "21a9f33bf762fca373682f19c6ce6050", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11865, "upload_time": "2019-05-09T21:11:29", "url": "https://files.pythonhosted.org/packages/b1/3c/88633ba588624352eff52f964adac70cca2dae6b3a0e3fea38a29776e239/ptdc-1.2.6-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "24cda23c53490555216174d59b07c2a5", "sha256": "fb9d2baa8bc77fbc560848ff9e7cc9470b732fc1e9d37ab562e671099c0395c0" }, "downloads": -1, "filename": "ptdc-1.2.6.tar.gz", "has_sig": false, "md5_digest": "24cda23c53490555216174d59b07c2a5", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11532, "upload_time": "2019-05-09T21:11:31", "url": "https://files.pythonhosted.org/packages/1c/d1/4f39d97558dd28e38611d4136122268d003cedbc5f47d5bd44df3440435e/ptdc-1.2.6.tar.gz" } ], "1.2.8": [ { "comment_text": "", "digests": { "md5": "f19866688a319f2eb0fc203b877310a4", "sha256": "999867fc3bb66bd5b14acb36a421c1b33d69c6a41136aa4eb86c7bf10d8be09f" }, "downloads": -1, "filename": "ptdc-1.2.8-py3-none-any.whl", "has_sig": false, "md5_digest": "f19866688a319f2eb0fc203b877310a4", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11864, "upload_time": "2019-05-10T08:41:31", "url": "https://files.pythonhosted.org/packages/a1/1b/0075c116586299705b3a322b10d119038bb2691930e73379df5805668e4c/ptdc-1.2.8-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "5e63ea264e141d27e258ff60bf57861b", "sha256": "a046353c875b64cbe63123b77bb360ec09277aea9f67d7cdf25c9e60bd0eef5e" }, "downloads": -1, "filename": "ptdc-1.2.8.tar.gz", "has_sig": false, "md5_digest": "5e63ea264e141d27e258ff60bf57861b", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 11651, "upload_time": "2019-05-10T08:41:33", "url": "https://files.pythonhosted.org/packages/b7/fe/f2cac9c16032b21c4a22e300aad3f89c053a1e2a87f8123bd4ddc6fa1f50/ptdc-1.2.8.tar.gz" } ], "1.2.9": [ { "comment_text": "", "digests": { "md5": "bceca71ce29fa307b3ae634240d13a64", "sha256": "fe4680d3a27363f06aa4f2f748c5f2ea4e2c3ec2fffe1cf72b57bf7a82e64fe2" }, "downloads": -1, "filename": "ptdc-1.2.9-py3-none-any.whl", "has_sig": false, "md5_digest": "bceca71ce29fa307b3ae634240d13a64", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 11984, "upload_time": "2019-05-13T23:21:40", "url": "https://files.pythonhosted.org/packages/bf/66/9f6bceb0c7198edb62d479a4b7247b17786ad08abd1b2860748d1b0d60d7/ptdc-1.2.9-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "37a003e416c4a77ffe597de1fcb08f20", "sha256": "b8133fac9c329288ee36286eb797834031a96f4034426746105c84b15521440c" }, "downloads": -1, "filename": "ptdc-1.2.9.tar.gz", "has_sig": false, "md5_digest": "37a003e416c4a77ffe597de1fcb08f20", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12116, "upload_time": "2019-05-13T23:21:42", "url": "https://files.pythonhosted.org/packages/53/36/9686af1cb2f9f22bc58af4f054c90704db02b52aa04f990fb08edd372d45/ptdc-1.2.9.tar.gz" } ], "1.3.5": [ { "comment_text": "", "digests": { "md5": "a9b7d759ecafa17255073a3fb7f3dff3", "sha256": "4f57e5058d284e85ba759597516d502d9f427225d0f4485f33b1fb2d0727a6d6" }, "downloads": -1, "filename": "ptdc-1.3.5-py3-none-any.whl", "has_sig": false, "md5_digest": "a9b7d759ecafa17255073a3fb7f3dff3", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12527, "upload_time": "2019-05-28T09:34:15", "url": "https://files.pythonhosted.org/packages/f2/c6/b2507873542af8db43ccb7e710681578bd08b4ba5b032a49689c63c568f6/ptdc-1.3.5-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "e0663a49c447ebae7c2817104ac46d37", "sha256": "d0fd1ea5f5eba4ab1328454cadda986efae5f671494148351b3126172769f366" }, "downloads": -1, "filename": "ptdc-1.3.5.tar.gz", "has_sig": false, "md5_digest": "e0663a49c447ebae7c2817104ac46d37", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12655, "upload_time": "2019-05-28T09:34:18", "url": "https://files.pythonhosted.org/packages/e8/2b/458e44907bece3952dee8610a60e426c06b9674364304d0767cb6515f0c3/ptdc-1.3.5.tar.gz" } ], "1.3.6": [ { "comment_text": "", "digests": { "md5": "57008360e052f26776909ac8b3a1301f", "sha256": "3989fb71f47f010d3666a45e82f1b61188fa6e7a776ab41f4be41ac2810c58e6" }, "downloads": -1, "filename": "ptdc-1.3.6-py3-none-any.whl", "has_sig": false, "md5_digest": "57008360e052f26776909ac8b3a1301f", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12509, "upload_time": "2019-05-28T19:25:40", "url": "https://files.pythonhosted.org/packages/9b/11/97f701a573e265ea369aca35b9d3645e84ebb778f3b225439c81e76b247a/ptdc-1.3.6-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "64cafd80694f2b41707899bab7d89902", "sha256": "8b260fa671a22cb6da9926c22bf8a534f55ca9c49554b545f448e7d19606ff29" }, "downloads": -1, "filename": "ptdc-1.3.6.tar.gz", "has_sig": false, "md5_digest": "64cafd80694f2b41707899bab7d89902", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12647, "upload_time": "2019-05-28T19:25:42", "url": "https://files.pythonhosted.org/packages/fa/cd/fbaca49ce420fbde077676f3622e07a1523a28fd522aaf91af2e9455c88f/ptdc-1.3.6.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "57008360e052f26776909ac8b3a1301f", "sha256": "3989fb71f47f010d3666a45e82f1b61188fa6e7a776ab41f4be41ac2810c58e6" }, "downloads": -1, "filename": "ptdc-1.3.6-py3-none-any.whl", "has_sig": false, "md5_digest": "57008360e052f26776909ac8b3a1301f", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": null, "size": 12509, "upload_time": "2019-05-28T19:25:40", "url": "https://files.pythonhosted.org/packages/9b/11/97f701a573e265ea369aca35b9d3645e84ebb778f3b225439c81e76b247a/ptdc-1.3.6-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "64cafd80694f2b41707899bab7d89902", "sha256": "8b260fa671a22cb6da9926c22bf8a534f55ca9c49554b545f448e7d19606ff29" }, "downloads": -1, "filename": "ptdc-1.3.6.tar.gz", "has_sig": false, "md5_digest": "64cafd80694f2b41707899bab7d89902", "packagetype": "sdist", "python_version": "source", "requires_python": null, "size": 12647, "upload_time": "2019-05-28T19:25:42", "url": "https://files.pythonhosted.org/packages/fa/cd/fbaca49ce420fbde077676f3622e07a1523a28fd522aaf91af2e9455c88f/ptdc-1.3.6.tar.gz" } ] }