Lighting control system using an Actor - Critic type learning algorithm

A novel lighting control system using the Actor- Critic algorithm was developed, in which users can set the brightness of the system through sensory operation, such as “much brighter” or “slightly darker”. During development, this system must learn two states, i.e., the demands of the user and the brightness around the user. The Actor - Critic algorithm was applied for this purpose, and a simplified algorithm was developed. The effectiveness and usefulness of the proposed algorithm are discussed here through numerical simulations.

[1]  K. Tsukada,et al.  Ubi-Finger : Gesture Input Device for Mobile Use , 2002 .

[2]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[3]  Liz C. Throop.  Field of play: sensual interface , 2003, DPPI '03.

[4]  Jun Morimoto,et al.  Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning , 2000, Robotics Auton. Syst..

[5]  S. A. Soman,et al.  Application of Actor-Critic Learning Algorithm for Optimal Bidding Problem of a Genco , 2002, IEEE Power Engineering Review.

[6]  D. H. Kelly.  Visual response to time-dependent stimuli. I. Amplitude sensitivity measurements. , 1961, Journal of the Optical Society of America.

[7]  M. Miki,et al.  Intelligent Lighting System using Visible-Light Communication Technology , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[8]  Tomoyuki Hiroyasu,et al.  Distributed optimization algorithm for lighting color control using chroma sensors , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[9]  M. Miki.  INTELLIGENT LIGHTING CONTROL USING CORRELATION COEFFICIENT BETWEEN LUMINANCE AND ILLUMINANCE , 2005 .

[10]  Jonathan J. Cadiz,et al.  "Let There Be Light": Examining Interfaces for Homes of the Future , 2001, INTERACT.

[12]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[14]  Philip Ball,et al.  Let there be light! , 2003, Nature materials.

[15]  S. S. Stevens.  On the psychophysical law. , 1957, Psychological review.

[16]  Tomoaki Shikakura,et al.  Perception of Lighting Fluctuation in Office Lighting Environment , 2003 .

[17]  S. A. Soman,et al.  Application of actor-critic learning algorithm for optimal bidding problem of a Genco , 2002 .

[18]  Andreas Krause,et al.  Intelligent light control using sensor networks , 2005, SenSys '05.