Small logo of ETH main building ETH Zurich : Computer Science : Pervasive Computing : Distributed Systems : Education : Student Projects : Abstract

Efficient Data Storage & Retrieval of Electricity Consumption Data (B)

Status: Abgeschlossen

Background

This student project is a part of our our ongoing project Innovative Services based on Smart Meters, in which we collaborate with two Swiss energy providers. Within the last year, we instrumented multiple test households with different sensors, measuring values such as the electricity consumption of each household, occupancy, or consumption of individual appliances. The underlying technology has been developed in previous student projects: "Smart meters in the field - A sensor framework for a real world deployment" and "Integrating submeters to individually monitor appliances".

Challenge

In the context of the projects, we collect massive amounts of data in real time on our server. In total, this accounts for roughly 150MB of data per day, which must be stored, analyzed, and retrieved in real time. Our system relies on a MySQL database, which is easy to set up and interact with. However, to achieve scalability for future deployments, we are actively investigating NoSQL databases, which are based on key-value storage of data records.

Objectives

The goal of this project is to realize a smart energy data storage system based on the data we collected (and are still collecting) in our test households. This contains the following steps:
  • Definition of a data model (i.e., definition of proper keys, granularities of data records, ...)
  • Selection of a proper database management system (e.g., Apache Cassandra)
  • Transfer of the data currently stored in our relational database
  • Performance tests of typical queries
The exact scope is defined depending it is a Bachelor thesis, Master thesis, or Lab project. Please let me know if you have questions regarding this project.

Image source: https://smoothspan.files.wordpress.com/2011/07/nosql-databases.png

Student/Bearbeitet von: Steven van Damme
Contact/Ansprechpartner: Christian Beckel

ETH ZurichDistributed Systems Group
Last updated March 18 2015 09:55:57 PM MET cb