We played around with the color recognition for a while after we finished with it, and it worked pretty good, but the template matching we used at the beginning of the project seems to be working best for now.