Because competitive pressure in the hotel industry continues to increase, hotels have to develop service innovation (i.e., exploration) and service improvement (i.e., exploitation) capacities to become ambidextrous for continually creating customer value. In this study, a theory of the effect of customer orientation on service innovation and service improvement, which facilitates service quality and results in better market performance, was developed and investigated. By analyzing the data provided by senior executives and department managers from 126 hotels in Taiwan, both service innovation and service improvement were revealed to partially mediate the relationship between customer orientation and market performance. The results imply that customer orientation affects the market performance of a hotel through the development of service capabilities, and that customer orientation can transform a hotel into an ambidextrous hotel by concurrently developing service innovation and service improvement capacities.