According to the Institute for Market Transformation, household energy use is lower than it was in the 1980's, even as household buy and use more electronic devices.
Why? Building energy codes have driven an increase in the energy efficiency of homes. Houses today are 44% more efficient. This infographic explains where that efficiency is coming from.