{ "info": { "author": "Research-IT support", "author_email": "p.zahedi@uu.nl", "bugtrack_url": null, "classifiers": [ "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", "Programming Language :: Python :: 3" ], "description": "# Domain Network\nA package to create a domain network of the URLs mentioned in a dataset of texts. \nIn the current version it works for tweets. It may process any kind of text in the future versions.\n\n## Installation\n\nThe easiest way to install the domain_network package is to use the following command in a terminal:\n\n``` bash\npip install domain-network\n\n```\n## Usage\n\nTo run the module using Command Line Interface (CLI) run the following:\n\n- For the whole process starting with raw tweets:\n\n``` bash\npython -m domainNetwork --input_dir [\"data/twitterAPI_lang_en/*/*.json\"] --conf_dir [\u2018config/sample_config.ini\u2019] --min_edge_weight [20] --min_node_size [20] \\\n--min_stand_alone_size [50] --urls_file_name [\"output/urls.csv\"] \\\n--network_output_file_name [\"output/network.csv\"] --netloc_output_file_name [\"output/netloc.csv\"] \\\n--netloc_origin_output_file_name [\"output/netloc_origin.csv\"] \n```\n\n- For making domain network of a pre-processed file which includes extracted netlocs: \n``` bash\npython -m domainNetwork --conf_dir [\u2018config/sample_config.ini\u2019] --min_edge_weight [20] --min_node_size [20] \\\n--min_stand_alone_size [50] --network_only true --urls_file_name [\"data/urls.csv\"] \\\n--network_output_file_name [\"output/network.csv\"] --netloc_output_file_name [\"output/netloc.csv\"] \\\n--netloc_origin_output_file_name [\"output/netloc_origin.csv\"] \n```\n### Parameters:\n\n--input_dir : Directory of tweet files\n\n--conf_dir : File path of the config file. Read Config file section for more details.\n\n--min_edge_weight : Min number of users that mentioned both source and target of the edge in their tweets.\n\n--min_node_size : Min number of times that a web page is mentioned in total, for connected nodes.\n\n--min_stand_alone_size: Min number of times that a web page is mentioned in total, for stand-alone nodes.\n\n--network_only : If you want to use a preprocessed file which includes the netlocs\n\n--urls_file_name : File path of preprocessed tweets with netlocs. Can be output/input file in the above mentioned situations.\n\n--network_output_file_name: File path of the generated network, in .csv format.\n\n--netloc_output_file_name : File path of the list of web sites, after filtering, in .csv format.\n\n--netloc_origin_output_file_name : File path of the original list of web sites, in .csv format.\n\n### Output\nThe main output of this package is network.csv which includes source, target and the weight.\nOutput file can be given to a visualization tool, e.g. networkx in python for the visualization\n\n", "description_content_type": "text/markdown", "docs_url": null, "download_url": "", "downloads": { "last_day": -1, "last_month": -1, "last_week": -1 }, "home_page": "https://git.science.uu.nl/research-it-support/domain_network", "keywords": "", "license": "", "maintainer": "", "maintainer_email": "", "name": "domain-network", "package_url": "https://pypi.org/project/domain-network/", "platform": "", "project_url": "https://pypi.org/project/domain-network/", "project_urls": { "Homepage": "https://git.science.uu.nl/research-it-support/domain_network" }, "release_url": "https://pypi.org/project/domain-network/0.0.9/", "requires_dist": [ "numpy", "pandas" ], "requires_python": ">=3.6", "summary": "Makes a network out of a URLs in a dataset of tweets", "version": "0.0.9" }, "last_serial": 5859024, "releases": { "0.0.1": [ { "comment_text": "", "digests": { "md5": "4a00e0ef5949a5b8c3e5860a45ad876e", "sha256": "bbbc35e763f16ca124c17e0806649f5e337c77d98a5d5fecebb5012815e6b192" }, "downloads": -1, "filename": "domain_network-0.0.1-py3-none-any.whl", "has_sig": false, "md5_digest": "4a00e0ef5949a5b8c3e5860a45ad876e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 9865, "upload_time": "2019-09-07T01:45:41", "url": "https://files.pythonhosted.org/packages/a1/54/51ff9ef061d2677973dfab8cf422a7cd2172826503ef4b7a4f532c29f822/domain_network-0.0.1-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "5929f6683f94cd6f2173bf49f8c87199", "sha256": "0e7b1e9761e3c85b8f71db4ca472766da7c6cf394b6b104501c82ad18acc15df" }, "downloads": -1, "filename": "domain_network-0.0.1.tar.gz", "has_sig": false, "md5_digest": "5929f6683f94cd6f2173bf49f8c87199", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 5898, "upload_time": "2019-09-07T01:45:42", "url": "https://files.pythonhosted.org/packages/67/1e/786261ffefcb8d78eef1d9d5302e91b3e9f68091d5371928845c30a877ba/domain_network-0.0.1.tar.gz" } ], "0.0.7": [ { "comment_text": "", "digests": { "md5": "823d2fd543fbda88b962c2695c093eaa", "sha256": "ab5ddc11d3aaf3b9d8696b4363027955751c3a1999dc016ca7852053dc2c40d3" }, "downloads": -1, "filename": "domain_network-0.0.7-py3-none-any.whl", "has_sig": false, "md5_digest": "823d2fd543fbda88b962c2695c093eaa", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 9550, "upload_time": "2019-09-07T01:36:40", "url": "https://files.pythonhosted.org/packages/80/b0/6f3bc691b181edfa005c98d0c7246b3055e041138409b9385b1800ebb226/domain_network-0.0.7-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "9e9a250dc0a01c99bb73676f74022cd6", "sha256": "dad8bb523dcd7c7d4596d59dc6230748672a43773216bd95ac95b61a755816b4" }, "downloads": -1, "filename": "domain_network-0.0.7.tar.gz", "has_sig": false, "md5_digest": "9e9a250dc0a01c99bb73676f74022cd6", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 5615, "upload_time": "2019-09-07T01:36:43", "url": "https://files.pythonhosted.org/packages/eb/9a/7fc247032f918786bd8810854154f15a6d9f2e7f0d021d203833db07a077/domain_network-0.0.7.tar.gz" } ], "0.0.8": [ { "comment_text": "", "digests": { "md5": "0821180c967f06693fd5939dc626a29e", "sha256": "c5cba6db68aaff395a89a64aa1aad06a8d232d2ff619ec41f4505b19ee7893b0" }, "downloads": -1, "filename": "domain_network-0.0.8-py3-none-any.whl", "has_sig": false, "md5_digest": "0821180c967f06693fd5939dc626a29e", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 9865, "upload_time": "2019-09-07T01:50:55", "url": "https://files.pythonhosted.org/packages/53/02/3e9cd7828753bfa8e3d465e210f551945294b79f80bde22890ee87a974a7/domain_network-0.0.8-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "8a6d8e4e1c9a893cb8ed59205f8eb325", "sha256": "5e5b709e01d02e2ba3b43755aaf74a91512363e93fec1ec2e8194d74a1ce8680" }, "downloads": -1, "filename": "domain_network-0.0.8.tar.gz", "has_sig": false, "md5_digest": "8a6d8e4e1c9a893cb8ed59205f8eb325", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 5896, "upload_time": "2019-09-07T01:50:57", "url": "https://files.pythonhosted.org/packages/3b/b9/a0cbb504a779219b208d8ec4e69e9d305d5215a38d34fc369092a34b2165/domain_network-0.0.8.tar.gz" } ], "0.0.9": [ { "comment_text": "", "digests": { "md5": "14361e88256392385bc308491a902da5", "sha256": "7143dca242c13da02a84739e13c74531ef41a46e36f4cff1f336ab5ab4034a6e" }, "downloads": -1, "filename": "domain_network-0.0.9-py3-none-any.whl", "has_sig": false, "md5_digest": "14361e88256392385bc308491a902da5", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 10107, "upload_time": "2019-09-19T22:21:09", "url": "https://files.pythonhosted.org/packages/30/23/4157a35076e034c74280dfd36b2b2d10d224d6aa1be2a4bf4cc65589cec9/domain_network-0.0.9-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "d7d38ab156a0c22fa2fe26508b4eca5e", "sha256": "644e6a79488c3d6911b0fe4d36cb468664257019b28af9690eb422721935f906" }, "downloads": -1, "filename": "domain_network-0.0.9.tar.gz", "has_sig": false, "md5_digest": "d7d38ab156a0c22fa2fe26508b4eca5e", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 6182, "upload_time": "2019-09-19T22:21:13", "url": "https://files.pythonhosted.org/packages/2c/09/2049cc68afe3ead005de7bf314b31f5262f84e7c8738d076862ca1e4a543/domain_network-0.0.9.tar.gz" } ] }, "urls": [ { "comment_text": "", "digests": { "md5": "14361e88256392385bc308491a902da5", "sha256": "7143dca242c13da02a84739e13c74531ef41a46e36f4cff1f336ab5ab4034a6e" }, "downloads": -1, "filename": "domain_network-0.0.9-py3-none-any.whl", "has_sig": false, "md5_digest": "14361e88256392385bc308491a902da5", "packagetype": "bdist_wheel", "python_version": "py3", "requires_python": ">=3.6", "size": 10107, "upload_time": "2019-09-19T22:21:09", "url": "https://files.pythonhosted.org/packages/30/23/4157a35076e034c74280dfd36b2b2d10d224d6aa1be2a4bf4cc65589cec9/domain_network-0.0.9-py3-none-any.whl" }, { "comment_text": "", "digests": { "md5": "d7d38ab156a0c22fa2fe26508b4eca5e", "sha256": "644e6a79488c3d6911b0fe4d36cb468664257019b28af9690eb422721935f906" }, "downloads": -1, "filename": "domain_network-0.0.9.tar.gz", "has_sig": false, "md5_digest": "d7d38ab156a0c22fa2fe26508b4eca5e", "packagetype": "sdist", "python_version": "source", "requires_python": ">=3.6", "size": 6182, "upload_time": "2019-09-19T22:21:13", "url": "https://files.pythonhosted.org/packages/2c/09/2049cc68afe3ead005de7bf314b31f5262f84e7c8738d076862ca1e4a543/domain_network-0.0.9.tar.gz" } ] }