Broken S3 flavor symmetry of leptons and quarks: Mass spectra and flavor mixing patterns