This paper presents an illumination invariant Local Binary Pattern (LBP) operator for image matching. LBP operator characterizes the local variation around a pixel by comparing the pixel value to the values of its neighboring pixels. Instead of applying LBP operator on the color component directly, our method performs the LBP operation on the color differences in each color channel. Based on the dichromatic reflection model, the proposed color texture operator is invariant with respect to lighting geometry, highlights, and illumination color. Experimental results show robust image matching using the new color texture operator on objects that are illuminated under different illumination conditions.