Higher-Order Topological Insulators and Semimetals on the Breathing Kagome and Pyrochlore Lattices.