Multicolor Optical Imaging of Infrared-Warm Seyfert Galaxies. V. Morphologies and Interactions: Challenging the Orientation Model