Americans of all political stripes are concerned about affordability. Some politicians would like to change the subject.