Improved speaker adaptation using multiple reference speakers