Phonons are considered as a most important origin of scattering and dissipation for electronic coherence in nanostructures. The generation of coherent acoustic phonons with femtosecond laser pulses opens the possibility to control phonon dynamics in amplitude and phase. We demonstrate a new experimental technique based on two synchronized femtosecond lasers with GHz repetition rate to study the dynamics of coherently generated acoustic phonons in semiconductor heterostructures with high sensitivity. High-speed synchronous optical sampling (ASOPS) enables to scan a time-delay of 1 ns with 100 fs time resolution with a frequency in the kHz range without a moving part in the set-up. We investigate the dynamics of coherent zone-folded acoustic phonons in semiconductor superlattices (GaAs/AlAs and GaSb/InAs) and of coherent vibration of metallic nanostructures of non-spherical shape using ASOPS.