Agar dapat dijalan dibackground dan tetap berjalan meskipun kita exit dari ssh, dapat menggunakan nohup :
scrapy crawl TweetScraper -a query=TKA CHINA since:2020-05-10 until:2020-05-16
Data hasil scraping disimpan ke database [5], hanya untuk memprosesnya, untuk mempermudah, kita dapat menggunakan Pentaho Data Integration [6].
Jika ada masalah ketika memproses data ke database dengan Pentaho, bisa membaca [7][8].
Untuk analisa dan visualisasi dengan Gephi dapat membaca [10], hanya saja, dataset yg disebutkan disini, sudah tidak dapat diakses lagi.
Jika ingin menggunakan Gephi - Twitter Streaming Importer dapat menonton [11].
Referensi
- TweetScraper, https://github.com/jonbakerfish/TweetScraper
- Python Tutorial: Understanding Twitter JSON, https://www.youtube.com/watch?v=qrruEhHqwqY
- Text Mining, Networks and Visualization: Plebiscito Tweets, https://juanitorduz.github.io/text-mining-networks-and-visualization-plebiscito-tweets/
- Building a network graph from Twitter data, https://towardsdatascience.com/building-a-network-graph-from-twitter-data-a5e7b8672e3
- Building Twitter Conversation Graph, https://medium.com/analytics-vidhya/building-twitter-conversation-graph-5830bee5a7eb
- JSON-Input, https://pentaho.home.blog/2019/04/21/json-input/
- Incorrect string value: '\xF0\x9F\x8E\xB6\xF0\x9F…' MySQL , https://stackoverflow.com/questions/20411440/incorrect-string-value-xf0-x9f-x8e-xb6-xf0-x9f-mysql
- Emoji characters can't be written to Mysql database, https://www.programmersought.com/article/9501164118/
- Social Network Analysis and Visualization in Gephi, https://www.uu.nl/sites/default/files/clue_training_gephi.pdf
- Analyzing and visualizing your Twitter networks in Gephi , https://www.uu.nl/sites/default/files/analyzing_and_visualizing_your_twitter_networks_in_gephi.pdf
- Lab 11 Collect and Visualize #Twitter Social Network in #Gephi, https://www.youtube.com/watch?v=yYd8nSQRpis
- How to work with bigger datasets in Gephi, https://www.databulle.com/blog/random/gephi-ram.html
- Social Feed Manager, Helping researchers and archivists build social media collections, https://gwu-libraries.github.io/sfm-ui/
