Minerals and gems are classified by their physical properties, including hardness, luster, color, density, and magnetism.