Human behaviour is an important factor to consider in making an accurate assessment of the thermal exchanges between a building and its surroundings. The actions of a building's users, such as opening windows or doors, resetting the default temperatures of heating or cooling systems, or turning on electrical lights or appliances, can have a significant effect on energy consumption and the subsequent sensation of comfort. Basing our work on schemes for classifying these actions, in this study we determine which ones are to have precedence over the others. The effects of these actions can then be computed based on energy transfer equations for different types of buildings. An analysis of the changes caused by users to thermal parameters shows that different design solutions lead to different sensitivities. The stability of the thermal transfer in the building is analysed in part. From the results, it seems reasonable to limit what actions users can carry out by making appropriate design choices. The system is thus "robust" in its response to users' actions while it continues to provide them with the feeling that they are in control. This work emphasises the importance of the concept of "robustness" of energy efficiency and comfort in building design. Robust design here refers to the design process as a whole, carried out in such a way that it is difficult for users to make inappropriate decisions. This is accomplished by permanently sealing windows, or installing mechanisms to control lighting, heating, cooling or ventilation systems.