Home >Articles >RESNET Proposed American Consensus Standard on Method of Test for the Evaluation of Model Calibration Methods Released for Public Review and Comment

RESNET Proposed American Consensus Standard on Method of Test for the Evaluation of Model Calibration Methods Released for Public Review and Comment

Jun 23, 2016

RESNET is proposing an ANSI standard, the BSR/RESNET 1201-201X PDS-02 “Method of Test for the Evaluation of Model Calibration Methods”.  The propose standard specifies a method of test for evaluating calibration methods that are used to reconcile building energy models with measured energy consumption data.

The proposed standard presents an analytical test for evaluating model calibration techniques. The basic concepts for this method are:

  • A building energy simulation program is used to generate pre- and post-retrofit energy consumption data as a synthetic surrogate for data that could be measured in a real building (typically obtained from utility bills).
  • The same simulation program that generates the surrogate measured consumption data is used in conjunction with a calibration technique to produce calibrated and non-calibrated energy consumption data.
  • The calibration technique is evaluated by comparing the calibrated and non-calibrated consumption data to the surrogate measured consumption data along with other metrics.

The test method will be useful in several ways including:

  • Testing a single calibration method to see how well it works under a variety of test conditions
  • Testing several calibration methods to determine under what test conditions each is best
  • Investigating how much, and what kind, of informational content is needed in the synthetic data to achieve good calibrations with different calibration methods (eg. monthly vs daily vs hourly data and availability of different types of submetered or disaggregated data)
  • Testing with various amounts and kinds of “noise” in the synthetic data
  • Diagnostic testing

The proposed test method allows users of the standard to construct their own test cases and specifications.  However, to avoid the work of creating new test cases, a set of tests and specifications is available from several studies known as the National Renewable Energy Laboratory (NREL) BESTEST-EX reports (Judkoff et. al. 2010, 2011a, 2011b.

The draft standard can be downloaded at Standard Method of Test for the Evaluation of Building Energy Analysis Model Calibration Methods

The draft standard is the result of years of work and analysis conducted by a task force chaired by Ron Judkoff of the NREL.  Members of the task force were:

  • Philip Fairey, Florida Solar Energy Center
  • Bruce Harley, Bruce Harley Energy Consulting, LLC
  • Ethan MacCormick, PSD Consulting
  • Ben Polly, National Renewable Energy Laboratory
  • Dave Robers, National Renewable Energy Laboratory

The RESNET Standard Development Committee 300 has voted to submit this proposed amendment to the RESNET standard amendment public review and comment process. Interested parties are encouraged to comment on the proposed amendment.

Comments will only be accepted on the proposed underlined and strike out propose amended language.

Public comments on the proposed amendment will be accepted from June 24th until August 18, 2016.

To submit your comments click on Standard Method of Test for the Evaluation of Building Energy Analysis Model Calibration Methods Comment Online Form

Comments are posted real time and you will be able to review comments that were submitted by clicking on Comments Submitted on Evaluation of Model of Test for the Evaluation of Model Calibration Methods Standard

Only comments made through the online system will be accepted.

After the comment period, the RESNET Standard Development Committee 300 will consider and document its consideration of each of the comments submitted and make appropriate changes. The revised proposed amendments will then be submitted to the RESNET Standards Management Board for adoption.