Full Content is available to subscribers

Subscribe/Learn More  >

Data Management for a Large-Scale Smart Grid Demonstration Project in Austin, Texas

[+] Author Affiliations
Kazunori Nagasawa, Charles R. Upshaw, Joshua D. Rhodes, Michael E. Webber

The University of Texas at Austin, Austin, TX

Chris L. Holcomb

Pecan Street Inc., Austin, TX

David A. Walling

Texas Advanced Computing Center, Austin, TX

Paper No. ES2012-91198, pp. 1027-1031; 5 pages
  • ASME 2012 6th International Conference on Energy Sustainability collocated with the ASME 2012 10th International Conference on Fuel Cell Science, Engineering and Technology
  • ASME 2012 6th International Conference on Energy Sustainability, Parts A and B
  • San Diego, California, USA, July 23–26, 2012
  • Conference Sponsors: Advanced Energy Systems Division, Solar Energy Division
  • ISBN: 978-0-7918-4481-6
  • Copyright © 2012 by ASME


This paper presents a data management scheme for the Pecan Street smart grid demonstration project in Austin, Texas. In this project, highly granular data with 15-second resolution on resource generation and consumption, including total consumption of electricity, water, and natural gas and solar generation, are collected for more than 100 homes. Furthermore, this testbed, see Figure 1, of homes represents the nation’s highest density of rooftop solar PV and electric vehicles, and includes a substantial subset of homes that are highly instrumented with meters on up to 6 sub-circuits in addition to the whole-home meter. Consequently, this demonstration project generates a one-of-a-kind dataset with excellent temporal and geographic fidelity.

One consequence of this extensive dataset is that there are hundreds of parallel data streams that need to be remotely (wirelessly) collected, filtered, processed, managed, stored and analyzed to be useful for researchers. Cumulatively, they represent 100s of gigabytes of data after just a few months of collection, which represents a formidable barrier to conducting research.

In partnership with the Texas Advanced Computing Center (TACC), which is an NSF-sponsored cluster of supercomputers at UT-Austin, a data collection and management scheme has been developed. For storing the data, we have built a single column oriented database that so far has shown tremendous performance benefits. This paper shows the data schema, an example of MySQL query, and a developed program for rapid and automated data extraction, analysis and display. We expect that the findings of this work will be beneficial to researchers interested in grid-scale data management.

Copyright © 2012 by ASME
Topics: Smart grids



Interactive Graphics


Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In