Relieving urban traffic congestion has always been an urgent caU in a dynamic traffic network. This research aims to control the traffic flow within a traffic network consists of two signalized intersections with traffic ramp. The massive traffic network problem is dealt through dynamic Q-Iearning (Dyna-Q) actuated traffic signalisation. where the traffic phases will be monitored as immediate actions can be accomplished during congestion to minimise the number of vehicles in queue. The simulation results show the total vehicles passed through the network with proposed algorithm are 2.9 - 19.0 % more than the existing pre-timed traffic signalisation due to its flexibility in changing the traffic signal timing plan according to the traffic conditions and necessity.