Datathon – HackNews – Solution – LEEREAK
To be added
Hack the News Datathon 2019
Monthly Challenge – Ontotext case – Solution – Door
ontotext_monthly_challenge
Datathon – HackNews – Solution – TruthFinders
Team Members Tariq Alhindi ([email protected]) Christopher Hidey ([email protected]) Tuhin Chakrabarty ([email protected]) Business Understanding Automatic Detection of propaganda is essential to build tools that can assist people to navigate the web with more awareness of deliberate or indeliberate messages of what they read. Data Understanding 50000 articles for task 1 21000 sentences for task 2 Data Preparation […]
Datathon – HackNews – Solution – marmot
dina zaychik, dzay, [email protected] Sergey Sedov, Sianur, [email protected] Task 1. The hypothesis is that propaganda/non-propaganda on article level could be detected using distributional semantics features. That’s why we performed thorough preprocessing, removing urls, hashtags, unusual symbols, unusual articles beginnings, non-English first paragraphs (using langid open package), short texts. After that we trained fasttext supervised model (the […]
Datathon – HackNews – Solution – StepUp
Team has considered following properties of data for coming up with the solution:
Repetition of text.
Length of words
Lexical analysis of words
frequency of words
trigrams and bigrams of words
Sentiments conveyed by the
Word lemmatization
The main modeling which included in
LSTM – Long short term memory with embedding from fasttext.
Datathon – HackNews – Solution – schlaflos
Using Bidirectional LSTMs and trainable embeddings initialized with GloVe for propaganda detection at the article level
Datathon – HackNews – Solution – DR
This work proposes the solution of HackTheNewsHackathon tasks. As the main problem binary classification for two classes “propaganda” and “non-propaganda” was chosen. This problem would be solved using open-source library DeepPavlov using ensemble of several different models, including sklearn models, shallow-and-wide convolutional model, attention bidirectional LSTM and GRU models and capsule networks.
Datathon – HackNews – Solution – Team: UoM-NLP
Business Understanding Fake news is a massive problem for the multiple industries and government that needs to be addressed in a more automated format. Providing an automated method to examine text and classify it as fake or propaganda can help reduce the effect of fake news. It is easier said than done though as even […]
Datathon – HackNews – Solution – Insight Hunters
In order to do the following we have to undergo the process of text cleaning, understanding the text. We had to find a way in order to split the data and form a data frame which consists of the following columns.News_TextNews_NumberNews_TypeThe data has lots of fillers which had to be removed and some rows where news_numbers and type were missing. In order to clean the data we had to remove the fillers using the NLTK stop words filtration. Later on we tokenized the data using the word_tokenizer from the nltk package.The next important step was to lemmatize/stem the data to remove the tense from the words and normalize the words. Even though it was a time consumption process the results were promising.XGBoost has capability to handle the imbalanced dataset by using the parameter Scale_Pos_weight. we can do threshold probability throttling to increase the sensitivity by sacrificing the reasonable specificity.Evaluation:- This process is kind of tricky for the train data set provided, as the data was highly imbalanced, the dependent feature/variable had imbalanced classes
Datathon – HackNews – Solution – TEXT_MINERS
Propaganda is a form of communication that is aimed at influencing the attitude of a community toward some cause or position. It often presents facts selectively to encourage a particular synthesis. The disinformation damages the reputation of respectable news outlets, organisations and very bad for business indeed. The objective of the Hackathon is to be able to detect the Propaganda and Non-propaganda news as well as to develop a model that can help with the venture. The other objectives of this work includes detecting phrases which are propagandist and also finding out the type of propaganda it is. The algorithms that we will be taking help from are Passive Aggressive, Multiple Layer Perceptron Network, Logistic Regression, AdaBoost, Decision Tree, Random Forest, KNN, SVM and Naive Bayes to detect the potentially propagandistic and non-propagandistic sentences in a news article. For the evaluation, we are calculating F1 Score to measure the class imbalance in the testing dataset. We have used the best model for detecting propagandist and non-propagandist articles, phrases and also type of propaganda.
Datathon-HackNews-Solution-indianhunters
News is the lifeline of the human society , it underlines all the important events and influences public opinion like no other tool , but with the recent advent of electronic media and the sheer amount of new being churned out and the current political climate it’s hard to figure out what’s genuine news and what’s propaganda , this is where intelligent systems which can classify news articles , text fragments as propagandistic or non-propagandistic comes into play , this Datathon is focussed on developing such a system using various algorithms and methods to predict such a scenario the levels of challenges are:
A System that is able to classify a news article whether it is propaganda or not.
A System that is able to classify whether a sentence in a article is propaganda or not.
A System that is intelligently able to classify the propaganda technique used in the new piece.