Fragile Topology in Line-Graph Lattices with 2, 3, or 4 Gapped Flat Bands