This research proposes an interactive three-dimensional (3-D) application which can be used for modelling and manipulating interior architectural environments. This incorporates the concept of Virtual Reality [1] (VR) giving the user a real world experience. Virtual Reality is a trending technology which is gaining popularity due to the user experience it gives and its effectiveness. The proposed system consists of 4 major components. The user can add objects to the environment either using a description given in natural language or by giving a hand drawn sketch of the objects to be added. Natural Language Processing (NLP) techniques will be used to extract object details from the user description and Image Processing techniques will be used to extract object details from the hand drawn sketch. The user can control the 3D environment either by using hand gestures or voice commands. The hand gestures will be captured using a web camera and the voice commands will be captured using a microphone and Natural Language Processing (NLP) techniques will be used in order to extract the user's command. The 3-D application will be developed using VRML [2] (Virtual Reality Markup Language) which is a language for describing three-dimensional (3-D) image sequences and possible user interactions to go with them. Using the application developed using VRML, the user can interact with the virtual environment by viewing, navigation, moving and rotating objects within the environment thus it gives the user a feeling as actually living in the environment.
[1]
Ruvan Weerasinghe,et al.
Continuous Sinhala Speech Recognizer
,
2011
.
[2]
I. S. Mackenzie,et al.
Virtual Environments and Advanced Interface Design
,
1995
.
[3]
N.D. Georganas,et al.
A dynamic gesture interface for virtual environments based on hidden Markov models
,
2005,
IEEE International Workshop on Haptic Audio Visual Environments and their Applications.
[4]
Luisa Mich,et al.
A Linguistic Approach to the Development of Object Oriented Systems using the NL System LOLITA
,
1994,
ISOOMS.
[5]
Qing Chen,et al.
Dynamic Gesture Recognition
,
2005,
2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.
[6]
Ying Wu,et al.
Hand modeling, analysis and recognition
,
2001,
IEEE Signal Process. Mag..
[7]
Alistair Cockburn.
Using natural language as a metaphoric base for OO
,
1992,
OOPSLA '92.
[8]
George A. Miller,et al.
WordNet: A Lexical Database for English
,
1995,
HLT.
[9]
Richard Sproat,et al.
WordsEye: an automatic text-to-scene conversion system
,
2001,
SIGGRAPH.