The aim of our research was to analyse the implementation of a Real Time Judging System (RTJS) . In this research, 6 volunteer international level judges evaluated male parallel bars routines from Šalamun’s memorial 2009 (World cup series B artistic gymnastics competition). The computer assisted system with a keyboard interface was used to record and display deductions from individual judges in real time. For validity assessment, the mean absolute and rank deviations of judges’ execution scores, Kendall’s W and ANOVA statistics were calculated. For consistency and reliability assessment, item-total correlations, Cronbach’s alpha coefficient, intra-class correlations and Armor’s theta were calculated. The overall results in terms of consistency (Cronbach’s alpha mostly above 0.96) and reliability (Armor’s theta 0.95, intra-class correlation for single and average measures 0.77 and 0.95, respectively) were satisfactory. As compared to results of judging analysis from a previous high level competition at Universiade 2009 higher indices of individual judge bias were found. In conclusion, RTJS shows promise as an efficient system to increase the transparency and informative value of judging while maintaining the same level of reliability.