You will have no problem with X-10. The ground is, in most new homes, not even hooked up to the switchs, only the outlets. X-10 switches don’t have a place to hook up the ground anyway.