Machine Learning Based User Interface Generation

Every product development starts with idea conceptualization and design. The ideators and designers first choice is sketching the idea to conceptualize the product. After a few iterations of product design, mockups/prototypes are passed to developers who have the job of converting these designs into a functional product by grasping the design concepts and using their coding skills. Utilizing the advancements in deep learning and computer vision technologies, gap between designers and developers is bridged by simplifying the product development process. This will also help people with little or no knowledge of web development to bring their design ideas into reality. The service will consist of two stages firstly accepting images of web mockups including hand-drawn sketches and identifying the various HTML components in the sketch using Convolutional Neural Networks and tag them appropriately, secondly, the identified components will be converted to structured JSON files which will be converted to code based on HTML5, Flexbox and Bootstrap.