Datathons Solutions

Datathon – Sofia Air 2.0 – Solution – Wonder Gang: Articles on Particles

Posted izabellataskova, kameliak, anie, ana-maria, izabellataskova
22
votes

Techonnology and methods used:

R – tidyverse, lubridate, snakecase, sp, raster, spData, sf, leaflet, mapview, ggplot2, shiny, maps, devtools, geojsonio, rgdal, leaflet.esri, leaflet.extras

Python – s3fs, pandas, numpy, matplotlib, plotly

1. Business Understanding

Air pollution beyond the norms is a common problem in many locations. Examining the causes behind and being able to predict it would help control and reduce pollution, facilitate solving environmental issues and providing a better life to citizens.

Air pollution seems to be recurring problem in our city – Sofia. This matter can be affected by climate, topography and anthropogenic factors as well. Our aim with this project is to explain how different human activities affect the pollution and our health.

2. Data Understanding

The provided datasets consist of static data and dynamic data for 20 day in November 2016. Data is constructed as following:

  • Weather Stability data – Data on the state of the upper atmosphere from radiosonde probes of Sofia
  • Topological data – containg GPS coordinates for different points in Sofia.
  • Official meteorological data for 20 days for Sofia city
  • Industrial pollutants – 71 industrial emission devices; their location, height and annual debit of PM10.
  • Construction sites – 389 construction sights; location and types of construction
  • Household pollutants – 39944 households and questionnaire data determining what source of heating the households use.
  • Data from official measurement stations –  data from 4 stations located in Nadezhda, Hipodruma, Druzhba, Pavlovo for 20 days in November 2016.
  • Lots of Miscellaneous tables (from the Methodology of the case) which we use to calculate the pollution based on the Dispersion model.

3. Data Preparation

Firstly, we decided to determine how the Dispersion model should apply to separate pollutants. In order to do so, we should use the Weather stability and wind speed from the meteorological data. Those factors helped us to determine how the pollution from separate emission devices will spread in the atmosphere of our city. Based on Weather stability we calculated  the vertical temperature gradient in the upper atmosphere above Sofia for each of the 20 days. This helped us to determine that the Pasquill stability class of the atmosphere is type E (Slightly Stable) for the whole period.

Next step was to calculate sigmas – sigma y  and sigma z, which represent the vertical and horizontal spread of the plum rise for each pollutant.

In order to visualize how different emission devices spread the pollution we choose a radial approach. We plot separate circles with different concentration of particles around the industrial pollutants.  Those are plotted on a interactive map (.html) which you can find in our GitHub repo.

A snapshot of initial pollution with all parameters:

A snapshot of initial pollution with pollution spread in a radius of 1000 meters:

A snapshot of initial pollution with pollution spread in a radius of 10000 meters:

A snapshot of predicted pollution for 1 day ahead:

4. Modeling

To start modelling we measured the distances between industrial pollutants and official measuring stations. The data was used to define how concentration of different particles from industrial stations affects the PM10 concentrations measured in Sofia.

We succeeded to define what is the correlation between Industrial emission stations and to project what the pollution will be in the succeeding five days.

Our estimations for the industrial pollution:

Official measurement station pollution:

Due to some technical issues and inability to post our code and viz in the article you can find our work in the repo below:

Here you can find a repo with our code on R and Python.

 

The work continues!!! Check our progress in the repo.

DataPrep

https://dss-www-production.s3.amazonaws.com/uploads/2019/04/Initial_Pollution.html
https://dss-www-production.s3.amazonaws.com/uploads/2019/04/Pollution_2016.11.21.html

sofia_air_2

 

 

 

 

Share this

28 thoughts on “Datathon – Sofia Air 2.0 – Solution – Wonder Gang: Articles on Particles”

  1. 0
    votes

    Great job! Really good map (with the blur visualization it rocks). Your paper shows a great combo of R and Python in one task. Keep working and calculate the other factors.

    3. 0
      votes

      I needed help removing a judgment for a car that was included in my bankruptcy. It disappeared for about 5 years and later for some reason I can’t tell it popped up again. I read somewhere that clevercreditfix1@ gmail. Com and how good he is at what he does, then I decided to contact Clever Credit, I must confess; I got the best. He was professional and easy to work with. It made the whole experience quite enjoyable, the judgment is gone as well as BK. I have an excellent credit score now.

  2. 0
    votes

    I do like of approach of “blurring” over map for pollution spreading. It would be even better (I know you didn’t had time) to take into account surounding buildings and how they impact pollution spread to get more custom “shape” of spread instead of combination of circles but this visually tells amazing story. Keep good work of “story” presentation of other factors as well.

    1. 0
      votes

      Thank you for your comment. Actually, we were thinkinkg to use topogrphic data to improve the shape of the spread visualization. Looking at the surrounding objects is definetly a good idea!

  18. 0
    votes

    I am very happy, I am here to share my testimonies with the general public about what this man called Dr Adodo has just done for me , this man has just brought back my lost Ex husband to me with his great spell, i was married to this man called Steven we were together for a long time and we loved our self’s but when i was unable to give he a child for 2 years he left me and told me he can’t continue anymore then i was now looking for ways to get him back until a friend of mine told me about this man and gave his contact email ([email protected]) then you won’t believe this when i contacted this man on my problems he prepared this spell cast and bring my lost husband back, and after a month i miss my month and go for a test and the result stated am pregnant am happy today am a mother of a baby girl, thank you once again the great Dr Adodo for what you have done for me, if you are out there passing through this same kind of problems you can contact he today on his mail ( [email protected]) on his Whatspp +18144484537 and he will also help you as well …

  21. 0
    votes

    I needed help removing a judgment for a car that was included in my bankruptcy. It disappeared for about 5 years and later for some reason I can’t tell it popped up again. I read somewhere that clevercreditfix1@ gmail. Com and how good he is at what he does, then I decided to contact Clever Credit, I must confess; I got the best. He was professional and easy to work with. It made the whole experience quite enjoyable, the judgment is gone as well as BK. I have an excellent credit score now.

  23. 0
    votes

    There’s a popular educational trend overseas these days – online courses! Perhaps the initial purpose of online courses was to enrich students’ knowledge, but due to the overwhelming academic pressure faced by many students, they find it challenging to juggle online courses alongside their regular coursework. However, they also don’t want their GPA to be affected. As a result, many clever students have come up with the idea of “online course proxy.” But when looking for online course proxy services at https://www.northessay.com/product, it’s crucial to keep your eyes wide open and stay vigilant. Only through careful comparison can you find a legitimate proxy service that suits your needs.

Leave a Reply