Time-delay cosmography: increased leverage with angular diameter distances