Datathons Solutions

Datathon – Sofia Air 2.0 – Solution – Wonder Gang: Articles on Particles

22
votes

Techonnology and methods used:

R – tidyverse, lubridate, snakecase, sp, raster, spData, sf, leaflet, mapview, ggplot2, shiny, maps, devtools, geojsonio, rgdal, leaflet.esri, leaflet.extras

Python – s3fs, pandas, numpy, matplotlib, plotly

1. Business Understanding

Air pollution beyond the norms is a common problem in many locations. Examining the causes behind and being able to predict it would help control and reduce pollution, facilitate solving environmental issues and providing a better life to citizens.

Air pollution seems to be recurring problem in our city – Sofia. This matter can be affected by climate, topography and anthropogenic factors as well. Our aim with this project is to explain how different human activities affect the pollution and our health.

2. Data Understanding

The provided datasets consist of static data and dynamic data for 20 day in November 2016. Data is constructed as following:

  • Weather Stability data – Data on the state of the upper atmosphere from radiosonde probes of Sofia
  • Topological data – containg GPS coordinates for different points in Sofia.
  • Official meteorological data for 20 days for Sofia city
  • Industrial pollutants – 71 industrial emission devices; their location, height and annual debit of PM10.
  • Construction sites – 389 construction sights; location and types of construction
  • Household pollutants – 39944 households and questionnaire data determining what source of heating the households use.
  • Data from official measurement stations –  data from 4 stations located in Nadezhda, Hipodruma, Druzhba, Pavlovo for 20 days in November 2016.
  • Lots of Miscellaneous tables (from the Methodology of the case) which we use to calculate the pollution based on the Dispersion model.

3. Data Preparation

Firstly, we decided to determine how the Dispersion model should apply to separate pollutants. In order to do so, we should use the Weather stability and wind speed from the meteorological data. Those factors helped us to determine how the pollution from separate emission devices will spread in the atmosphere of our city. Based on Weather stability we calculated  the vertical temperature gradient in the upper atmosphere above Sofia for each of the 20 days. This helped us to determine that the Pasquill stability class of the atmosphere is type E (Slightly Stable) for the whole period.

Next step was to calculate sigmas – sigma y  and sigma z, which represent the vertical and horizontal spread of the plum rise for each pollutant.

In order to visualize how different emission devices spread the pollution we choose a radial approach. We plot separate circles with different concentration of particles around the industrial pollutants.  Those are plotted on a interactive map (.html) which you can find in our GitHub repo.

A snapshot of initial pollution with all parameters:

A snapshot of initial pollution with pollution spread in a radius of 1000 meters:

A snapshot of initial pollution with pollution spread in a radius of 10000 meters:

A snapshot of predicted pollution for 1 day ahead:

4. Modeling

To start modelling we measured the distances between industrial pollutants and official measuring stations. The data was used to define how concentration of different particles from industrial stations affects the PM10 concentrations measured in Sofia.

We succeeded to define what is the correlation between Industrial emission stations and to project what the pollution will be in the succeeding five days.

Our estimations for the industrial pollution:

Official measurement station pollution:

Due to some technical issues and inability to post our code and viz in the article you can find our work in the repo below:

Here you can find a repo with our code on R and Python.

 

The work continues!!! Check our progress in the repo.

DataPrep

https://dss-www-production.s3.amazonaws.com/uploads/2019/04/Initial_Pollution.html
https://dss-www-production.s3.amazonaws.com/uploads/2019/04/Pollution_2016.11.21.html

sofia_air_2

 

 

 

 

Share this

26 thoughts on “Datathon – Sofia Air 2.0 – Solution – Wonder Gang: Articles on Particles

  1. 0
    votes

    Great job! Really good map (with the blur visualization it rocks). Your paper shows a great combo of R and Python in one task. Keep working and calculate the other factors.

    1. 0
      votes

      GET RICH WITH BLANK ATM CARD … Whatsapp: +18033921735

      I want to testify about Dark Web blank atm cards which can withdraw money from any atm machines around the world. I was very poor before and have no job. I saw so many testimony about how Dark Web Cyber hackers send them the atm blank card and use it to collect money in any atm machine and become rich. {[email protected]} I email them also and they sent me the blank atm card. I have use it to get 500,000 dollars. withdraw the maximum of 5,000 USD daily. Dark Web is giving out the card just to help the poor. Hack and take money directly from any atm machine vault with the use of atm programmed card which runs in automatic mode.

      You can also contact them for the service below

      * Western Union/MoneyGram Transfer

      * Bank Transfer

      * PayPal / Skrill Transfer

      * Crypto Mining

      * CashApp Transfer

      * Bitcoin Loans

      * Recover Stolen/Missing Crypto/Funds/Assets

      Email: [email protected]

      Text & Call or WhatsApp: +18033921735

      Website: https://darkwebonlinehackers.com

  2. 0
    votes

    I do like of approach of “blurring” over map for pollution spreading. It would be even better (I know you didn’t had time) to take into account surounding buildings and how they impact pollution spread to get more custom “shape” of spread instead of combination of circles but this visually tells amazing story. Keep good work of “story” presentation of other factors as well.

    1. 0
      votes

      Thank you for your comment. Actually, we were thinkinkg to use topogrphic data to improve the shape of the spread visualization. Looking at the surrounding objects is definetly a good idea!

  3. 0
    votes

    Have you bowed down before the here and powerful Oz? No, I’m not referring to the fictional wizard from Dorothy’s magical land. I’m talking about mass-marketed medical guru and Oprah protégé, Dr. Oz. And while he may be powerful, the scientific community is not convinced that his recommendations are all that great.

  4. 0
    votes

    Hello everyone,

    I want to testify about Luis Carlos who help me invest my bitcoin and made me who i am today, i never believe in bitcoin investment till i met Luis Carlos, I saw so many testimony about Luis Carlos helping people to invest their bitcoin, So i decide to contact him and invested $500 and after 7 days i receive my profit of $5,000 on my bitcoin wallet, Ever since i have been investing with them and i always receive my profit without any delay, so if you want to invest your bitcoin, Luis Carlos is the best trader you can invest with and getting your profit is guarantee, So if you want to invest just contact them and they will guide you on how start your investment . Email: [email protected] or WhatsApp : +14234516435

  5. 0
    votes

    Are you looking for a profitable investment where you can start with a little amount and earn a reasonable profit within a short period of time?. I never believed in any online investment because I was scared and never wanted to be cheated, until I saw a review about Mr Pablo Martinez. He’s a Forex/Crypto trading account manager who can help you manage your trading account with his trading strategies and winning signals. I started with an investment of $500 and earned a profit of $6,650 within 7 days. I now earn quite a lot on a weekly basis and I owe everything to Mr Pablo Martinez. Thank you Mr Pablo Martinez for turning my financial life around, and I will keep recommending your good works. If you want to invest in Stock, Binary options and Forex/Crypto trading, kindly contact Mr Pablo Martinez and you’ll be glad you did. There are no hidden charges.

    Contact Mr Pablo Martinez through

    E-mail: [email protected]

    WhatsApp: +44 7520 636249

    Facebook: https://www.facebook.com/PM-Fast-Trade-104912912155335/

  6. 0
    votes

    BITCOIN RECOVERY IS REAL!!!

    ( MorrisGray830 At gmail Dot Com, is the man for the job )
    This man is dedicated to his work and you can trust him more than yourself. I contacted him a year and a half Ago and he didn’t succeed. when i got ripped of $491,000 worth of bitcoins by scammers, I tried several recovery programs with no success too. I kept on. And now after so much time Mr Morris Gray contacted me with a success, and the reward he took was small because obviously he is doing this because he wants to help idiots like me who fell for crypto scam, and love his job. Of course he could have taken all the coins and not tell me , I was not syncing this wallet for a year, but he didn’t.
    He is the MAN guys , He is! If you have been a victim of crypto scam before you can trust Morris Gray 10000000%. I thought there were no such good genuine guys anymore on earth, but Mr Morris Gray brought my trust to humanity again. GOD bless you sir…you can reach him via ( MORRIS GRAY 830 at Gmaill dot com ) or Whatsapp +1 (607)698-0239..

  7. 0
    votes

    GET RICH WITH BLANK ATM CARD … Whatsapp: +18033921735

    I want to testify about Dark Web blank atm cards which can withdraw money from any atm machines around the world. I was very poor before and have no job. I saw so many testimony about how Dark Web Cyber hackers send them the atm blank card and use it to collect money in any atm machine and become rich.([email protected]) I email them also and they sent me the blank atm card. I have use it to get 250,000 dollars. withdraw the maximum of 5,000 USD daily. Dark Web is giving out the card just to help the poor. Hack and take money directly from any atm machine vault with the use of atm programmed card which runs in automatic mode.

    You can also contact them for the service below

    * Western Union/MoneyGram Transfer

    * Bank Transfer

    * PayPal / Skrill Transfer

    * Crypto Mining

    * CashApp Transfer

    Email: [email protected]

    Text & Call or WhatsApp: +18033921735

  8. 1
    votes

    GET RICH WITH BLANK ATM CARD … Whatsapp: +18033921735

    I want to testify about Dark Web blank atm cards which can withdraw money from any atm machines around the world. I was very poor before and have no job. I saw so many testimony about how Dark Web Cyber hackers send them the atm blank card and use it to collect money in any atm machine and become rich.([email protected]) I email them also and they sent me the blank atm card. I have use it to get 250,000 dollars. withdraw the maximum of 5,000 USD daily. Dark Web is giving out the card just to help the poor. Hack and take money directly from any atm machine vault with the use of atm programmed card which runs in automatic mode.

    You can also contact them for the service below

    * Western Union/MoneyGram Transfer

    * Bank Transfer

    * PayPal / Skrill Transfer

    * Crypto Mining

    * CashApp Transfer

    Email: [email protected]

    Text & Call or WhatsApp: +18033921735

    WEBSITE: https://darkwebcycberhackers.com

  9. 0
    votes

    GET RICH WITH BLANK ATM CARD … Whatsapp: +18033921735

    I want to testify about Dark Web blank atm cards which can withdraw money from any atm machines around the world. I was very poor before and have no job. I saw so many testimony about how Dark Web Cyber hackers send them the atm blank card and use it to collect money in any atm machine and become rich. {[email protected]} I email them also and they sent me the blank atm card. I have use it to get 500,000 dollars. withdraw the maximum of 5,000 USD daily. Dark Web is giving out the card just to help the poor. Hack and take money directly from any atm machine vault with the use of atm programmed card which runs in automatic mode.

    You can also contact them for the service below

    * Western Union/MoneyGram Transfer

    * Bank Transfer

    * PayPal / Skrill Transfer

    * Crypto Mining

    * CashApp Transfer

    * Bitcoin Loans

    * Recover Stolen/Missing Crypto/Funds/Assets

    Email: [email protected]

    Text & Call or WhatsApp: +18033921735

    Website: https://darkwebonlinehackers.com

Leave a Reply