Probing the universe at redshift 10 and beyond