In this paper we introduced a system structure based on the nonzero order joint transform correlator and used Lagrange multipliers to design a reference function to carry out the color face image recognition.Additionally, we used some different facial expressions as test images and added random noise in test images to investigate the system’s resistibility against the noise.