This paper proposes a novel method, which is coined as ARBBPNN, for biometric-oriented face detection, based on autoregressive model with Bayes backpropagation neural network (BBPNN). Firstly, the given input colour key face image is modelled to HSV and YCbCr models. A hybrid model, called HS–YCbCr, is formulated based on the HSV and YCbCr models. The submodel, H , is divided into various sliding windows of size, 3 × 3. The model parameters are estimated for the window using the BBPNN. Based on the model coefficients, autocorrelation coefficients (ACCs) are computed. An autocorrelation test tests the significance of the ACCs. If the ACC passes the test, then it is inferred that the small image region, viz. the window, represents the texture and it is treated as the texture feature. Otherwise, it is regarded as structure, which is treated as the shape feature. The texture and shape features are formulated as feature vectors (FV) separately, and they are combined into a single FV. This process is performed for all colour submodels. The FVs of the submodels are combined into a single holistic vector, which is treated as the FV of the key face image. The key FV has twenty feature elements. The similarity of the key and target face images is examined, based on the key and target FVs, by deploying multivariate parametric statistical tests. If the FVs of the key and target images pass the tests, then it is concluded that the key and target face images are the same; otherwise, they are regarded as different. The GT, FSW, Pointing’04, and BioID datasets are considered for the experiments. In addition to the above datasets, we have constructed a dataset with face images collected from Google, and many images captured through a digital camera. It is also subjected to the experiment. The obtained recognition results show that the proposed ARBBPNN method outperforms the existing methods.