Quantification of tissue optical properties with optical coherence tomography (OCT) has proven to be useful in evaluating structural characteristics and pathological changes. Previous studies primarily used an exponential model to analyze low numerical aperture (NA) OCT measurements and obtain the total attenuation coefficient for biological tissue. In this study, we develop a systematic method that includes the confocal parameter for modeling the depth profiles of high NA OCT, when the confocal parameter cannot be ignored. This approach enables us to quantify tissue optical properties with higher lateral resolution. The model parameter predictions for the scattering coefficients were tested with calibrated microsphere phantoms. The application of the model to human brain tissue demonstrates that the scattering and back-scattering coefficients each provide unique information, allowing us to differentially identify laminar structures in primary visual cortex and distinguish various nuclei in the midbrain. The combination of the two optical properties greatly enhances the power of OCT to distinguish intricate structures in the human brain beyond what is achievable with measured OCT intensity information alone, and therefore has the potential to enable objective evaluation of normal brain structure as well as pathological conditions in brain diseases. These results represent a promising step for enabling the quantification of tissue optical properties from high NA OCT.