Electronic products with multiple functionalities and simple interfaces are increasingly being introduced to daily life, and they often cause unpleasant experiences, especially for older adults. To elucidate how aging affects people’s perceptions of possible operations of physical controls, three kinds of semantic clues (i.e., shapes, text, and icons) drawn from two critical concepts of product semantics, affordances and informatives, were evaluated in a lab-controlled experiment. Both older adults (aged over 65) and younger adults (university students aged 18 to 26) were asked to answer two operational evaluation questions for 48 different physical controls. The results showed that aging affected the perception of all three semantic clues: (1) younger adults had a keener sense of shape variation while older adults did not; (2) younger adults were more likely to respond to the arrow sign; (3) older adults prioritized textual labels over icons and younger adults did the opposite. This study revealed the fact that older adults process shapes, text, and icons differently than younger adults. These empirical data could help product designers convey messages more effectively, particularly when designing products for both older adults and general population groups.