DNN-Based Image Classification for Software GUI Testing

Since visual design of Graphical User Interface (GUI) is one of the indispensable parts of every software and to some extent, it determines whether the software is attractive. And with the increasing amount of GUI designs, it is usually impractical to deal with a variety of designs manually with limited staff. Therefore, a solution for that program is needed. This work designs and implements an automatic GUI testing system based on Deep Neural Network (DNN) and cloud service. The system includes screenshot capturing and uploading module, web server, DNN models, etc. It provides accurate and efficient GUI automatic testing technology.