A method to synthesize Fe3O4 core/Au shell submicrometer structures with very rough surfaces on the nanoscale is reported. The Fe3O4 particles were first modified with uniform polymers through the layer-by-layer technique and then adsorbed a lot of gold nanoseeds for further Au shell formation. The shell was composed of a large number of irregular nanoscale Au particles arranged randomly, and there were well-defined boundaries between these Au nanoparticles. The Fe3O4 core/Au shell particles showed strong plasmon resonance absorption in the near-infrared range, and can be separated quickly from solution by an external magnet. This kind of very rough Fe3O4 core/Au shell multicomponent was used in the adsorption of 4-aminothiophenol and as a substrate for detection by surface-enhanced Raman spectroscopy.