Social Network Analysis

Agar dapat dijalan dibackground dan tetap berjalan meskipun kita exit dari ssh, dapat menggunakan nohup : 

scrapy crawl TweetScraper -a query=TKA CHINA since:2020-05-10 until:2020-05-16

Data hasil scraping disimpan ke database [5], hanya untuk memprosesnya, untuk mempermudah, kita dapat menggunakan Pentaho Data Integration [6]. 

Jika ada masalah ketika memproses data ke database dengan Pentaho, bisa membaca [7][8]. 

Untuk analisa dan visualisasi dengan Gephi dapat membaca [10], hanya saja, dataset yg disebutkan disini, sudah tidak dapat diakses lagi. 

Jika ingin menggunakan Gephi - Twitter Streaming Importer dapat menonton [11].

Referensi

1. TweetScraper,  https://github.com/jonbakerfish/TweetScraper
2. Python Tutorial: Understanding Twitter JSON, https://www.youtube.com/watch?v=qrruEhHqwqY
3. Text Mining, Networks and Visualization: Plebiscito Tweets, https://juanitorduz.github.io/text-mining-networks-and-visualization-plebiscito-tweets/
4. Building a network graph from Twitter data, https://towardsdatascience.com/building-a-network-graph-from-twitter-data-a5e7b8672e3
5. Building Twitter Conversation Graph, https://medium.com/analytics-vidhya/building-twitter-conversation-graph-5830bee5a7eb
6. JSON-Input, https://pentaho.home.blog/2019/04/21/json-input/
7. Incorrect string value: '\xF0\x9F\x8E\xB6\xF0\x9F…' MySQL , https://stackoverflow.com/questions/20411440/incorrect-string-value-xf0-x9f-x8e-xb6-xf0-x9f-mysql
8. Emoji characters can't be written to Mysql database, https://www.programmersought.com/article/9501164118/
9. Social Network Analysis and Visualization in Gephi, https://www.uu.nl/sites/default/files/clue_training_gephi.pdf
10. Analyzing and visualizing your Twitter networks in Gephi , https://www.uu.nl/sites/default/files/analyzing_and_visualizing_your_twitter_networks_in_gephi.pdf
11. Lab 11 Collect and Visualize #Twitter Social Network in #Gephi, https://www.youtube.com/watch?v=yYd8nSQRpis
12. How to work with bigger datasets in Gephi, https://www.databulle.com/blog/random/gephi-ram.html
13. Social Feed Manager, Helping researchers and archivists build social media collections, https://gwu-libraries.github.io/sfm-ui/