Theoretical analysis of crack front instability in mode I+III