A modelling structure for different architectures of Hybrid Electric Vehicles (HEVs) is presented in this paper. This structure includes physical powertrain components and their controllers, hybrid supervisory controller, and the driver model. The physical powertrain component models are developed in Dymola, whilst the component controllers, hybrid supervisory controllers, and the driver model are developed in MATLAB/Simulink. The structure makes it possible to compare different hybrid vehicle architectures directly with the capability to study the influence of real-world driver behaviour on energy usage. Three types of HEV architectures, including Mild Parallel, Series, and Power Split, are illustrated to show the feasibility of this modelling technique.