Towers of semi-simple algebras