Markov chains, Markov Processes, Queuing Theory and Application to Communication Networks