Variational calculations of correlated wavefunctions and energies for ground, low-lying as well as highly excited discrete states in many-electron atoms using a new atomic structure theory including electron correlation