Topological quantum computation with gapped boundaries and boundary defects