Elucidation of complexity and prediction of interactions in microbial communities