Datathon – HackNews – Solution – Antiganda (Propaganda Detection)

Posted Leave a commentPosted in NLP

Abstract¶This notebook tries to classify news articles in 2 classes propaganda and non-propaganda. 3 types of models Naive Bayes Classifier, Linear Support Vector Classifier and Recurrent Neural Network. The Linear SVC shows the best results. yesThe neural network comes close, while the Naive Bayes Classifier predicts only one class. The following packages have been used: […]

Datathon – HackNews – Solution – Task3-Antiganda

Posted 3 CommentsPosted in NLP

Edit: link to github is here: https://github.com/mboyanov/propaganda-deteciton AntigandaNet¶ This will be a deep learning attempt to tackle Task 3 – identifying the exact occurrences of manipulation or propaganda in a string of text. Tools: The deep learning library used is fast.ai and pytorch. Tokenization is achieved via spacy. Other tools include pandas and numpy. For […]

404 Telenor Social Media Not Found

Posted 1 CommentPosted in SNA, Team solutions

Social networks are characterized by the links between the nodes. We employed six different link analysis algorithms to rank the nodes in the network by their importance. For the task of leader detection, the best link analysis algorithm proved to be the vanilla PageRank. Out of the top 2000 nodes, 1725 are leaders, achieving a precision of 0.8625 and a recall ot 0.8792.
We also explored an alternative solution based on embeddings. We trained a Skipgram model where we set the context of a given node to its neighbourhood. To avoid the assumption for word order made by the model we repeated and reshuffled longer neighbourhoods. These embeddings were then used to train a softmax classifier, achieving a macro-f1 score of 0.6667.
We futher provide a visualization tool which can be used to explore the graph manually.