Harmonic modes as variables to approximately account for receptor flexibility in ligand–receptor docking simulations: Application to DNA minor groove ligand complex

An approach to approximately account for receptor flexibility in ligand–receptor docking simulations is described and applied to a DNA/Hoechst 33258 analogue complex. Harmonic modes corresponding to eigenvectors with small eigenvalues of the Hessian matrix of the potential energy function were used as independent variables to describe receptor flexibility. For the DNA minor groove ligand case most of the conformational difference between an energy minimized free DNA and ligand‐bound structure could be assigned to 5–40 harmonic receptor modes with small eigenvalues. During docking, deformations of the DNA receptor structure in the subset of harmonic modes were limited using a simple penalty function that avoided the summation over all intrareceptor atom pairs. Significant improvement of the sterical fit between ligand and receptor was found upon relaxation of the DNA in the subset of harmonic modes after docking of the ligand at the position found in the known crystal structure. In addition, the harmonic mode relaxation resulted in DNA structures that were more similar to the energy minimized ligand‐bound form. Although harmonic mode relaxation also leads to improved sterical fit for other ligand placements, the placement as observed in the crystal structure could still be identified as the site with the most favorable sterical interactions. Because relaxation in the harmonic modes is orders of magnitude faster than conventional energy minimization using all atom coordinates as independent variables, the approach might be useful as a preselection tool to recognize ligand binding sites accessible only upon small conformational changes of the receptor. The harmonic mode relaxed structures can only be considered as approximate structures because deformation of the receptor in the harmonic modes can lead to small perturbations of the stereochemical geometry of the molecule. Energy minimization of preselected ligand–DNA docking candidates in all atom coordinates is required to reduce these deviations. ©1999 John Wiley & Sons, Inc. J Comput Chem 20: 287–300, 1999