Datathon – HackNews – Solution – LEEREAK
To be added
To be added
ontotext_monthly_challenge
Introduction to NLP
Natural Language Processing (NLP) is the field of computer science that is concerned with developing algorithms for analysis of human languages. Artificial Intelligence approaches( eg. Machine Learning) have been used for solving many tasks of NLP such as parsing, POS tagging, Named Entity Recognition, word sense disambiguation, document classification, machine translation, textual entailment, question answering, summarization, etc. Natural languages are notoriously difficult to understand and model by machines mostly because of ambiguity (eg. humor, sarcasm, puns), lack of clear structure, diversity (eg. models for English are not directly applicable to Chinese). Even so, in recent years we’re witnessing rapid progress in the field of NLP, due to deep learning models, which are becoming more and more complex and able to capture subtleties of human languages.
Fighting Propaganda task1 task1_predictions
Team Members Tariq Alhindi ([email protected]) Christopher Hidey ([email protected]) Tuhin Chakrabarty ([email protected]) Business Understanding Automatic Detection of propaganda is essential to build […]
dina zaychik, dzay, [email protected] Sergey Sedov, Sianur, [email protected] Task 1. The hypothesis is that propaganda/non-propaganda on article level could be detected using distributional […]
Team has considered following properties of data for coming up with the solution:
Repetition of text.
Length of words
Lexical analysis of words
frequency of words
trigrams and bigrams of words
Sentiments conveyed by the
Word lemmatization
The main modeling which included in
LSTM – Long short term memory with embedding from fasttext.
Using Bidirectional LSTMs and trainable embeddings initialized with GloVe for propaganda detection at the article level
Task 1 Part 1 Task 1 Part 2
This work proposes the solution of HackTheNewsHackathon tasks. As the main problem binary classification for two classes “propaganda” and “non-propaganda” was chosen. This problem would be solved using open-source library DeepPavlov using ensemble of several different models, including sklearn models, shallow-and-wide convolutional model, attention bidirectional LSTM and GRU models and capsule networks.
Business Understanding Fake news is a massive problem for the multiple industries and government that needs to be addressed in a more […]