The Deployment of a LoRaWAN-Based IoT Air Quality Sensor Network for Public Good

Logo

A University of Virginia School of Data Science research project aiming to implement a network of air quality sensors in collaboration with the local community as a means to analyze and facilitate discussion about the air we breathe.

View the Project on GitHub thejimster82/CvilleAQ

IoT For Public Good

View the full paper on IEEExplore

This link will be updated when the official paper is published

Overview


As a part of the 2019-2020 Masters of Science in Data Science (MSDS) program at the University of Virginia (UVA) School of Data Science (SDS), all students complete a capstone project. Our project was in collaboration with the UVA Link Lab and a local non-profit, Smart Cville. Our overarching goal was to implement an air quality sensor network throughout Charlottesville that would provide citizens with access to open data about their air. Together, we established 4 major goals:

  1. Expand the LoRa network throughout Charlottesville
  2. Design an air quality sensor kit
  3. Provide open access to our collected data
  4. Analyze our collected data

The LoRa Network


TTN Gateway LoRa is a spread-spectrum modulation technique that allows low density data to be transmitted over long distances using low power. Our collaborators had already begun implementing the LoRa network throughout Charlottesville by distributing The Things Network (TTN) Gateways. These provide up to 10km radius of LoRa coverage and connect to standard WiFi or ethernet to transport packets to the internet.

LoRa Gateway Distribution LoRa Gateway Distribution in Charlottesville 04/2020

Sensor Kit Assembly


Hardware

Adafruit Feather M0 RFM95 LoRa Radio

Adafruit Feather M0 RFM95 LoRa Radio

This MCU comes in a small form-factor, allows us to provide both 3.3v and 5v source voltage to our sensors, and includes an on-board LoRa Radio. While more expensive than more custom options, it greatly simplifies our design.

Plantower PMS7003

Plantower PMS7003

The PMS7003 is a state-of-the-art particulate matter (PM) sensor, sensing PM 1.0, 2.5, and 10. Its small form-factor, low power-consumption, and high accuracy make it a great choice for our sensor kits. It does not come with US-standard pins so you will need an adapter to standardize the pins.

Sensirion SCD30

Sensirion SCD30

The SCD30 is an indoor NDIR CO2 sensor with an onboard temperature and humidity sensor. It provides high accuracy readings but consumes more power than is ideal for these applications. Future iterations should focus on reducing the power consumption of this part or replace it with an alternative.

The full parts list for our pilot prototype can be found here.

Firmware

Our firmware code is freely available on Github along with the requisite libraries. The ttn-credentials.h file will need to be filled out with the credentials for the TTN application to which you wish to send data. The application must also be set up to decode the packets sent by the sensor kits, this code can be copied from Decoder.js in our repo.

Circuit Diagram

Circuit Diagram

Housing Assembly

Our pilot prototype was assembled using plastic containers which we do not recommend for future users. We recommend to use one of our 3D-printed enclosures instead, they include in-built supports for both the PMS7003 and the SCD30. In the event that you must use a plastic container, we recommend at least printing the supports for the sensors as it makes attaching them to the container much easier.

Pilot prototype construction Pilot prototype construction with research assistant Keerthi Radhakrishnan

Pilot prototype deployed Pilot prototypes test deployment

Revision 1 assembled Revision 1 assembled

Open Data


All of the data collected for this project can be downloaded and visualized at the following locations:

Grafana

Grafana provides realtime timeseries plots of our data and allows csv downloads. You can access the full site here.

Realtime Map

Our realtime map lets you see the air quality right now at locations around Charlottesville. You can view it here.

API

Our API is currently in the works and will make our data machine-readable.

Analysis


Find the code for the below analyses in the notebooks folder of our Github repo. For these analyses, we used data collected from our 10-sensor network between 02/03/2020 and 04/15/2020, totalling 46309 rows with 9 columns: co2, pm25, pm10, temp, humidity, latitude, longitude, dev_id, and fdt(datetime).

Data Cleaning

Our sensors operate only within certain bounds (these can be found on their respective datasheets) and we know Charlottesville’s weather well enough to rule out specific conditions. Beyond this, we knew that sensors that were malfunctioning would report consistent values or linearly-varying values over long periods of time. Using these two considerations, we were able to construct a simple data-cleaning strategy that removes data that is out-of-bounds and that is behaving linearly for an extended period of time. After performing the data removal we were able to visualize which kit had issues with which metrics through a heatmap, shown below. From this we can see that most of our kits had issues with the PMS7003, and a few had issues with the SCD30. This type of visual might allow us to detect particularly problematic kits in the future and to go into the debugging process with some level of insight as to where the problem lies. We found that ~25% of our incoming readings were invalid and ~50% our rows included at least one invalid reading. Our further analyses remove all rows with any invalid metrics.

invalid data heatmap

Percent invalid data by metric and by kit, ‘rows’ indicates percent of rows that included at least one invalid metric

Calibration

Our sensor kits were not placed close enough to reference-grade instruments to perform collocation testing. However, all PMS7003 units are pre-calibrated and it has been shown that this procedure succeeds in keeping their readings close to reference instrumentation. Furthermore, it has been shown that the coefficient of variation between units is below 10%. We took the EPA’s reported PM2.5 data from Charlottesville and compared it to our sensor values and saw that, in aggregate, the difference between their readings fit a normal distribution with mean ~4.3ug/m3 and standard deviation ~2.1ug/m3. We did not adjust our readings for our further analyses as assigning blame for the discrepancies to each individual kit was not possible because our kits and the reference instrument were not collocated.

PMS7003 Calibration Test

Difference in EPA-reported PM2.5 and kit-aggregated PM2.5 averaged per-day

PMS7003 Calibration Density

Density plot of difference in EPA and kit readings with fitted normal distribution

Anomaly Detection

After cleaning our data we used an isolation forest on our five metrics: CO2, PM2.5, PM10, temperature, and humidity, to detect which kits were generating the most anomalous behavior. We saw that our eighth kit was generating the most anomalies. After further analysis, we found that this kit was located very close to the train-tracks that run through Charlottesville which could easily cause it to generate behavior very different from our other kits. This kind of analysis might be another method of detecting sensor kits that are behaving oddly, especially in a greatly expanded network where combing through all of the data could take a very long time. In contrast to the earlier data cleaning step, this procedure is not to detect faulty behavior but, instead, notable behavior.

Anomaly count per sensor kit

Anomaly count per sensor kit

Distance Correlation

Having sensors spread throughout an area, we would expect their readings to be more similar when they are closer together. We can test this assumption by finding the correlation between the set of readings from each kit with each other kit and plotting it against the distance between those kits. This is pictured below for PM10 (similar results were found for PM2.5 and CO2) and, as you can see, our assumption is not verified. We believe that this is because air quality variations can be highly localized, especially in an urban environment. We believe that this indicates that a higher density of air quality sensing kits is necessary in order to capture all of the meaningful information within the environment. This could be tested in future research to determine a standardized average distance for placing air quality sensors in an urban environment.

PM10 Distance Correlation Plot

PM10 Distance Correlation Plot, R2=0.004

Heatmaps

The largest result of our analysis was a comparison of the air quality in Charlottesville before and after the announcement by UVA that classes would move online. We used this as a breakpoint for the beginning of social distancing in Charlottesville. Using data from our sensors we were able to visualize the decrease in CO2 levels across Charlottesville.

Mean CO2 Change Before and After March 11th Mean CO2 (ppm) Change Before and After March 11th

Along with heatmaps for the change in CO2, we were able to generate general heatmaps to show the average values of various metrics across the city. One of our future goals is to implement a realtime-version of this analysis and host it so Charlottesville citizens can have easy access to a simple visual of the air quality across the city.

Average PM2.5 February 03 to April 15 2020 Average PM2.5 (ug/m3) February 03 to April 15 2020

Community Events


Over the course of our project we met with various members of the community to discuss ideas for the design, implementation, and future goals of this project and other similar projects in the Charlottesville community. These discussions were generally organized by our sponsor at Smart Cville, Lucas Ames. He was an indispensable part of the team and really made connecting with the community possible.

Meeting with C3 and LEAP Environment Groups Meeting with C3 and LEAP Environmental Groups

Civic Hack Night with the UVA Architecture School and SDS Civic Hack Night with the UVA Architecture School and SDS

Open Source Environmental Sensing Info Session Community Climate Collaborative (C3) Director of Climate Policy Caetano de Campos Lopes inspecting our pilot prototype sensor kit at an Open Source Environmental Sensing Info Session

Related Projects


Air Quality Egg

Safecast Air

Publiclab

Smart Citizen

AirCasting

HackAIR

Luftdaten

PurpleAir

The Air Quality Data Commons

The Team


Researchers

James Howerton

Jimmy Howerton

UVA School of Data Science

email: jh3df@virginia.edu

LinkedIn

Resume

Ben Schenck

Ben Schenck

UVA School of Data Science

email: bls7cc@virginia.edu

LinkedIn

Mentors

Jon Kropko

Jon Kropko

UVA School of Data Science

Luis Felipe Rosado Murillo

Luis Felipe Rosado Murillo

UVA School of Data Science

Sponsors

Lucas Ames

Lucas Ames

Smart Cville

Jon Goodall

Jon Goodall

UVA Link Lab