Cable remotes don't typically work with HDMI switchers.  They usually have a database of codes built into them for things like DVD players and TVs.

that said, it would be helpful to know what the brand/model is of the HDMI switcher.