Shalabh Bhatnagar

发表

Optimal Multilevel Feedback Policies for ABR Flow Control using Two Timescale SPSA

Michael C. Fu, Shalabh Bhatnagar, Steven I. Marcus, 1999 .

A Generalized Minimax Q-Learning Algorithm for Two-Player Zero-Sum Stochastic Games

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, IEEE Transactions on Automatic Control.

Scalable Performance Tuning of Hadoop MapReduce: A Noisy Gradient Approach

K. Gopinath, Sandeep Kumar, Shalabh Bhatnagar, 2016, 2017 IEEE 10th International Conference on Cloud Computing (CLOUD).

Toward Off-Policy Learning Control with Function Approximation

Shalabh Bhatnagar, Richard S. Sutton, Csaba Szepesvári, 2010, ICML.

Pattern Synthesis for Nonparametric Pattern Recognition

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2009, Encyclopedia of Data Warehousing and Mining.

Generalized Speedy Q-Learning

Shalabh Bhatnagar, Chandramouli Kamanchi, Indu John, 2019, IEEE Control Systems Letters.

Auto-scaling Resources for Cloud Applications using Reinforcement learning

Shalabh Bhatnagar, Indu John, Aiswarya Sreekantan, 2019, 2019 Grace Hopper Celebration India (GHCI).

Two Timescale Stochastic Approximation with Controlled Markov noise

Shalabh Bhatnagar, Prasenjit Karmakar, S. Bhatnagar, 2015, Math. Oper. Res..

An algorithm for dynamic optimal bandwidth allocation in communication networks

Shalabh Bhatnagar, Diksha Sharma, Shyam Chakraborty, 2006 .

Multiscale Stochastic Approximation for Parametric Optimization of Hidden Markov Models

Vivek S. Borkar, Shalabh Bhatnagar, S. Bhatnagar, 1997, Probability in the Engineering and Informational Sciences.

Gelfand-Yaglom-Perez theorem for generalized relative entropy functionals

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2007, Inf. Sci..

Stochastic Approximation Methods: Applications to RED Flow Control in TCP/IP Networks

Shalabh Bhatnagar, S. Bhatnagar, 2009 .

SPSA based feature relevance estimation for video retrieval

S. V. Basavaraja, Shalabh Bhatnagar, V. Sridhar, 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation

Shalabh Bhatnagar, Doina Precup, Richard S. Sutton, 2009, NIPS.

A simulation-based algorithm for optimal pricing policy under demand uncertainty

Shalabh Bhatnagar, Sindhu Padakandla, Saswata Chakravarty, 2014, Int. Trans. Oper. Res..

An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes

Shalabh Bhatnagar, 2010, Syst. Control. Lett..

Cauchy annealing schedule: an annealing schedule for Boltzmann selection scheme in evolutionary algorithms

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

An Optimal Weighted-Average Congestion Based Pricing Scheme for Enhanced QoS

Shalabh Bhatnagar, N. Hemachandra, Koteswara Rao Vemu, 2007, ICDCIT.

Algorithms for Nash Equilibria in General-Sum Stochastic Games pdf

Shalabh Bhatnagar, H. L. Prasad, A. PrashanthL., 2014, ArXiv.

Fusion of multiple approximate nearest neighbor classifiers for fast and efficient classification

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2004, Inf. Fusion.

Stochastic Approximation Algorithms

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2013 .

LSPI-CAS: Least-Squares Policy Iteration for Compact Action Set MDPs

Shalabh Bhatnagar, Mohammed Shahid Abdulla, 2018 .

Decentralized learning for traffic signal control

Shalabh Bhatnagar, J. PrabuchandranK., N HemanthKumarA., 2015, 2015 7th International Conference on Communication Systems and Networks (COMSNETS).

Stochastic approximation algorithms for constrained optimization via simulation

Shalabh Bhatnagar, N. Hemachandra, Vivek Kumar Mishra, 2011, TOMC.

Revisiting the Cross Entropy Method with Applications in Stochastic Global Optimization and Reinforcement Learning

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2016, ECAI.

Integration of V2V-AEB System with Wearable Cardiac Monitoring System and Reduction of V2V-AEB System Time Constraints

Shalabh Bhatnagar, S. Bhatnagar, 2017 .

Reinforcement learning with average cost for adaptive control of traffic lights at intersections

Shalabh Bhatnagar, A. PrashanthL., S. Bhatnagar, 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization

Shalabh Bhatnagar, S. Bhatnagar, 2005, TOMC.

On a convergent off -policy temporal difference learning algorithm in on-line learning environment pdf

Shalabh Bhatnagar, Raj Kumar Maity, Prasenjit Karmakar, 2016, ArXiv.

IEEE Transactions on Automation Science and Engineering

Leyuan Shi, Giuseppe Carlo Calafiore, Jing Xiao, 2009, IEEE Transactions on Automation Science and Engineering.

A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes

Vivek S. Borkar, Shalabh Bhatnagar, S. Bhatnagar, 1995, Math. Oper. Res..

Approximate Dynamic Programming with (min; +) linear function approximation for Markov decision processes

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, S. Bhatnagar, 2014, 53rd IEEE Conference on Decision and Control.

An efficient and optimized bluetooth scheduling algorithm for scatternets

Shalabh Bhatnagar, Vijay Prakash Chaturvedi, V. Rakesh, 2008, 2008 2nd International Symposium on Advanced Networks and Telecommunication Systems.

Stochastic Recursive Algorithms for Optimization

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2012 .

A stability criterion for two timescale stochastic approximation schemes

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, S. Bhatnagar, 2017, Autom..

Efficient Budget Allocation and Task Assignment in Crowdsourcing

Shalabh Bhatnagar, Indu John, S. Bhatnagar, 2019, COMAD/CODS.

An Incremental Fast Policy Search Using a Single Sample Path

Shalabh Bhatnagar, Ajin George Joseph, 2017, PReMI.

Information theoretic justification of Boltzmann selection and its generalization to Tsallis case

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2005, 2005 IEEE Congress on Evolutionary Computation.

A proof of convergence of the B-RED and P-RED algorithms for random early detection

Shalabh Bhatnagar, Rajesh Kumar Patro, R. K. Patro, 2009, IEEE Communications Letters.

Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences

Michael C. Fu, Shalabh Bhatnagar, I-Jeng Wang, 2003, TOMC.

RLWS: A Reinforcement Learning based GPU Warp Scheduler pdf

R. Govindarajan, Shalabh Bhatnagar, Shivaram Kalyanakrishnan, 2017, ArXiv.

Stochastic Approximation Trackers for Model-Based Search

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

Multiscale Q-learning with linear function approximation

Shalabh Bhatnagar, K. Lakshmanan, S. Bhatnagar, 2016, Discret. Event Dyn. Syst..

Learning Stable Manoeuvres in Quadruped Robots from Expert Demonstrations

Ashish Joglekar, Shalabh Bhatnagar, Shishir Kolathaya, 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

An efficient algorithm for scheduling in bluetooth piconets and scatternets

Shalabh Bhatnagar, G. Ramana Reddy, Vijay Prakash Chaturvedi, 2010, Wirel. Networks.

Natural actor-critic algorithms

Shalabh Bhatnagar, Mark Lee, Richard S. Sutton, 2009, Autom..

Adaptive sleep-wake control using reinforcement learning in sensor networks

Shalabh Bhatnagar, Abhranil Chatterjee, A. PrashanthL., 2014, 2014 Sixth International Conference on Communication Systems and Networks (COMSNETS).

Uniqueness of Nonextensive entropy under Renyi's Recipe pdf

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2005, ArXiv.

Newton-based stochastic optimization using q-Gaussian smoothed functional algorithms pdf

Shalabh Bhatnagar, Ambedkar Dukkipati, Debarghya Ghoshdastidar, 2013, Autom..

Simulation optimization via gradient-based stochastic search

Xi Chen, Shalabh Bhatnagar, Enlu Zhou, 2014, Proceedings of the Winter Simulation Conference 2014.

Predictive and Prescriptive Analytics for Performance Optimization: Framework and a Case Study on a Large-Scale Enterprise System

Shalabh Bhatnagar, Indu John, Ravikumar Karumanchi, 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

Discrete Parameter Optimization

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2013 .

Stability of Stochastic Approximations With “Controlled Markov” Noise and Temporal Difference Learning

Shalabh Bhatnagar, Arunselvan Ramaswamy, S. Bhatnagar, 2015, IEEE Transactions on Automatic Control.

Adaptive Smoothed Functional Algorithms for Optimal Staffing Levels in Service Systems

Shalabh Bhatnagar, L A Prashanth, Nirmit Desai, 2013 .

Incremental Natural Actor-Critic Algorithms

Shalabh Bhatnagar, Mark Lee, Richard S. Sutton, 2007, NIPS.

Stochastic Algorithms for Discrete Parameter Simulation Optimization

Shalabh Bhatnagar, N. Hemachandra, Vivek Kumar Mishra, 2011, IEEE Transactions on Automation Science and Engineering.

New algorithms of the Q-learning type

Shalabh Bhatnagar, K. Mohan Babu, S. Bhatnagar, 2008, Autom..

An online prediction algorithm for reinforcement learning with linear function approximation using cross entropy method

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2018, Machine Learning.

A bi-convex optimization problem to compute Nash equilibrium in n-player games and an algorithm pdf

Shalabh Bhatnagar, Vinayaka Yaji, S. Bhatnagar, 2015, ArXiv.

Hindsight Experience Replay with Kronecker Product Approximate Curvature pdf

Shalabh Bhatnagar, Abhik Singla, M DhuruvaPriyanG, 2020, ArXiv.

Stochastic Recursive Inclusions in two timescales with non-additive iterate dependent Markov noise

Shalabh Bhatnagar, Vinayaka Yaji, S. Bhatnagar, 2016, Math. Oper. Res..

A Cross Entropy based Stochastic Approximation Algorithm for Reinforcement Learning with Linear Function Approximation pdf

Shalabh Bhatnagar, Ajin George Joseph, 2016, ArXiv.

A model based search method for prediction in model-free Markov decision process

Shalabh Bhatnagar, Ajin George Joseph, 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

Attention Actor-Critic algorithm for Multi-Agent Constrained Co-operative Reinforcement Learning pdf

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, P. Parnika, 2021, AAMAS.

On Measure Theoretic definitions of Generalized Information Measures and Maximum Entropy Prescriptions pdf

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2006, ArXiv.

Actor-Critic Algorithms for Constrained Multi-agent Reinforcement Learning pdf

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, J. PrabuchandranK., 2019, AAMAS.

Link route pricing for enhanced QoS

Shalabh Bhatnagar, N. Hemachandra, Koteswara Rao Vemu, 2007, 2007 46th IEEE Conference on Decision and Control.

Bounds for off-policy prediction in reinforcement learning

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

Two-timescale Q-learning Algorithms with an Application to Routing in Networks

Shalabh Bhatnagar, K. Mohan Babu, 2007 .

A Cross Entropy based Optimization Algorithm with Global Convergence Guarantees pdf

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2018, ArXiv.

Generalized Evolutionary Algorithm based on Tsallis Statistics

M. Narasimha Murty, Shalabh Bhatnagar, Ambedkar Dukkipati, 2004, ArXiv.

Multiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization

Vivek S. Borkar, Shalabh Bhatnagar, S. Bhatnagar, 2003, Simul..

A probabilistic constrained nonlinear optimization framework to optimize RED parameters

Shalabh Bhatnagar, Rajesh Kumar Patro, R. K. Patro, 2009, Perform. Evaluation.

Hierarchical Average Reward Policy Gradient Algorithms (Student Abstract)

Shalabh Bhatnagar, Matthew Riemer, Akshay Dharmavaram, 2020, AAAI.

An efficient ad recommendation system for TV programs

Shalabh Bhatnagar, Sudha Velusamy, Sridhar Varadarajan, 2008, Multimedia Systems.

A note on the function approximation error bound for risk-sensitive reinforcement learning pdf

Shalabh Bhatnagar, Prasenjit Karmakar, S. Bhatnagar, 2016, ArXiv.

Simultaneous Perturbation Newton Algorithms for Simulation Optimization

Shalabh Bhatnagar, A. PrashanthL., S. Bhatnagar, 2015, J. Optim. Theory Appl..

A Linearly Relaxed Approximate Linear Program for Markov Decision Processes

Shalabh Bhatnagar, Csaba Szepesvári, Chandrashekar Lakshminarayanan, 2017, IEEE Transactions on Automatic Control.

Optimal multi-layered congestion based pricing schemes for enhanced QoS

Shalabh Bhatnagar, N. Hemachandra, Koteswara Rao Vemu, 2012, Comput. Networks.

Reinforcement Learning With Function Approximation for Traffic Signal Control

Shalabh Bhatnagar, A. PrashanthL., S. Bhatnagar, 2011, IEEE Transactions on Intelligent Transportation Systems.

Mechanisms for hostile agents with capacity constraints

Shalabh Bhatnagar, Nirmit Desai, A. PrashanthL., 2013, AAMAS.

An Online Sample-Based Method for Mode Estimation Using ODE Analysis of Stochastic Approximation Algorithms

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, IEEE Control Systems Letters.

Overlap pattern synthesis with an efficient nearest neighbor classifier

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2005, Pattern Recognit..

Approximate Policy Iteration for Semiconductor Fab-Level Decision Making - a Case Study

Shalabh Bhatnagar, Steven I. Marcus, Michael C. Fu, 2000 .

A time aggregation approach to Markov decision processes

Zhiyuan Ren, Michael C. Fu, Shalabh Bhatnagar, 2002, Autom..

SPSA Algorithms with Measurement Reuse

Shalabh Bhatnagar, Mohammed Shahid Abdulla, S. Bhatnagar, 2006, Proceedings of the 2006 Winter Simulation Conference.

Lock-in probability of stochastic approximation with controlled Markov noise

Vivek S. Borkar, Shalabh Bhatnagar, Prasenjit Karmakar, 2016 .

A pattern synthesis technique with an efficient nearest neighbor classifier for binary pattern recognition

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

Feature Search in the Grassmanian in Online Reinforcement Learning

Vivek S. Borkar, Shalabh Bhatnagar, J. PrabuchandranK., 2013, IEEE Journal of Selected Topics in Signal Processing.

Rate-based ABR flow control using two timescale SPSA

Michael C. Fu, Shalabh Bhatnagar, Steven I. Marcus, 1999, Optics East.

Analyzing Approximate Value Iteration Algorithms

Shalabh Bhatnagar, Arunselvan Ramaswamy, 2017 .

Solution of Mdps Using Simulation-Based Value Iteration

Shalabh Bhatnagar, Mohammed Shahid Abdulla, S. Bhatnagar, 2005, AIAI.

Reinforcement Learning in Non-Stationary Environments

Shalabh Bhatnagar, Sindhu Padakandla, Prabuchandran K. J., 2019, ArXiv.

Adaptive system optimization using (simultaneous) random directions stochastic approximation pdf

Shalabh Bhatnagar, A. PrashanthL., S. Bhatnagar, 2015, ArXiv.

Network flow-control using asynchronous stochastic approximation

Shalabh Bhatnagar, Mohammed Shahid Abdulla, 2007, 2007 46th IEEE Conference on Decision and Control.

Efficient Adaptive Resource Provisioning for Cloud Applications using Reinforcement Learning

Shalabh Bhatnagar, Indu John, Aiswarya Sreekantan, 2019, 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W).

LMS-2: Towards an algorithm that is as cheap as LMS and almost as efficient as RLS

Shalabh Bhatnagar, Csaba Szepesvári, Hengshuai Yao, 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks

Shalabh Bhatnagar, Abhranil Chatterjee, A. PrashanthL., 2013, Wirel. Networks.

On the function approximation error for risk-sensitive reinforcement learning

Shalabh Bhatnagar, Prasenjit Karmakar, S. Bhatnagar, 2016 .

A constrained optimization perspective on actor-critic algorithms and application to network routing pdf

Shalabh Bhatnagar, A. PrashanthL., H. L. Prasad, 2016, Syst. Control. Lett..

Actor-Critic Algorithms with Online Feature Adaptation

Vivek S. Borkar, Shalabh Bhatnagar, J. PrabuchandranK., 2016, ACM Trans. Model. Comput. Simul..

On the lock-in probability estimate of stochastic approximation with controlled Markov noise

Vivek S. Borkar, Shalabh Bhatnagar, Prasenjit Karmakar, 2016 .

Trajectory based Deep Policy Search for Quadrupedal Walking

Ashish Joglekar, Shalabh Bhatnagar, Shishir Kolathaya, 2019, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

q-Gaussian based Smoothed Functional algorithms for stochastic optimization

Shalabh Bhatnagar, Ambedkar Dukkipati, Debarghya Ghoshdastidar, 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

Brief paper Actor-critic algorithms for hierarchical Markov decision processes

Shalabh Bhatnagar, J. Ranjan Panigrahi, S. Bhatnagar, 2006 .

Fuzzy Clustering Based Ad Recommendation for TV Programs

Shalabh Bhatnagar, Sudha Velusamy, Sridhar Varadarajan, 2007, EuroITV.

A Stochastic Approximation Algorithm for Quantile Estimation

Shalabh Bhatnagar, Ajin George Joseph, 2015, ICONIP.

Adaptive mean queue size and its rate of change: queue management with random dropping

Shalabh Bhatnagar, Karmeshu, Sanjeev Patel, 2016, Telecommun. Syst..

Road Traffic Control

Shalabh Bhatnagar, H. L. Prasad, L A Prashanth, 2013 .

A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events

Vivek S. Borkar, Shalabh Bhatnagar, Madhukar Akarapu, 2006, J. Mach. Learn. Res..

An Actor-Critic Algorithm for Finite Horizon Markov Decision Processes

Shalabh Bhatnagar, Mohammed Shahid Abdulla, 2006 .

Markov decision processes for integrating life cycle dynamics into fab-level decision making

Shalabh Bhatnagar, Steven I. Marcus, Michael C. Fu, 1999 .

Gradient-Based Adaptive Stochastic Search for Simulation Optimization Over Continuous Space

Shalabh Bhatnagar, Enlu Zhou, S. Bhatnagar, 2018, INFORMS J. Comput..

A Markov Decision Process Framework for Predictable Job Completion Times on Crowdsourcing Platforms

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, Chithralekha Balamurugan, 2014, HCOMP.

Stochastic Optimization for Adaptive Labor Staffing in Service Systems

Shalabh Bhatnagar, Nirmit Desai, A. PrashanthL., 2011, ICSOC.

Energy Sharing for Multiple Sensor Nodes With Finite Buffers

Shalabh Bhatnagar, Sindhu Padakandla, J. PrabuchandranK., 2015, IEEE Transactions on Communications.

Generalized Deterministic Perturbations For Stochastic Gradient Search

Shalabh Bhatnagar, J. PrabuchandranK., Sai Koti Reddy Danda, 2017, 2018 IEEE Conference on Decision and Control (CDC).

Scalable focussed entity resolution

Shalabh Bhatnagar, N. RanganathB., S. Bhatnagar, 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

A randomized algorithm for continuous optimization

Shalabh Bhatnagar, Ajin George Joseph, 2016, 2016 Winter Simulation Conference (WSC).

Approximate Dynamic Programming based on Projection onto the (min, +) subsemimodule pdf

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, S. Bhatnagar, 2014, ArXiv.

Ant Colony Optimization Algorithms for Shortest Path Problems

Shalabh Bhatnagar, Sudha Rani Kolavali, S. Bhatnagar, 2009, NET-COOP.

Reinforcement Learning for Sleep-Wake Scheduling in Sensor Networks pdf

Shalabh Bhatnagar, Abhranil Chatterjee, A. PrashanthL., 2013, ArXiv.

A stochastic approximation approach to active queue management

Shalabh Bhatnagar, Karmeshu, Sanjeev Patel, 2018, Telecommun. Syst..

Novel First Order Bayesian Optimization with an Application to Reinforcement Learning

Shalabh Bhatnagar, Chandramouli Kamanchi, K J Prabuchandran, 2020, Applied Intelligence.

General-sum stochastic games: Verifiability conditions for Nash equilibria

Shalabh Bhatnagar, H. L. Prasad, S. Bhatnagar, 2012, Autom..

Shaping Proto-Value Functions via Rewards pdf

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, Raj Kumar Maity, 2015, ArXiv.

A Generalized Reduced Linear Program for Markov Decision Processes

Shalabh Bhatnagar, Chandrashekar Lakshminarayanan, 2015, AAAI.

Multi-agent reinforcement learning for traffic signal control

Shalabh Bhatnagar, J. PrabuchandranK., N HemanthKumarA., 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

Adaptive System Optimization Using Random Directions Stochastic Approximation

Shalabh Bhatnagar, Michael Fu, Prashanth L. A., 2015, IEEE Transactions on Automatic Control.

Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization

Shalabh Bhatnagar, S. Bhatnagar, 2007, TOMC.

The Borkar-Meyn theorem for asynchronous stochastic approximations

Shalabh Bhatnagar, S. Bhatnagar, 2011, Syst. Control. Lett..

A unified decision making framework for supply and demand management in microgrid networks

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Krishnasuri Narayanam, 2018, 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

Adaptive Smoothed Functional based Algorithms for Labor Cost Optimization in Service Systems

Shalabh Bhatnagar, L A Prashanth, Nirmit Desai, 2012 .

Multi-Step Dyna Planning for Policy Evaluation and Control

Shalabh Bhatnagar, Richard S. Sutton, Csaba Szepesvári, 2009, NIPS.

Second Order Value Iteration in Reinforcement Learning pdf

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, ArXiv.

Actor-critic algorithms for hierarchical Markov decision processes

Shalabh Bhatnagar, J. Ranjan Panigrahi, S. Bhatnagar, 2006, Autom..

Necessary and sufficient conditions for optimality in constrained general sum stochastic games

Shalabh Bhatnagar, Vinayaka Yaji, S. Bhatnagar, 2015, Syst. Control. Lett..

Smoothed Functional Algorithms for Stochastic Optimization Using q-Gaussian Distributions pdf

Shalabh Bhatnagar, Ambedkar Dukkipati, Debarghya Ghoshdastidar, 2012, TOMC.

Optimal structured feedback policies for ABR flow control using two-timescale SPSA

Michael C. Fu, Shalabh Bhatnagar, Steven I. Marcus, 2001, TNET.

Design, Development and Experimental Realization of A Quadrupedal Research Platform: Stoch

Bharadwaj S. Amrutur, Shalabh Bhatnagar, Shishir Kolathaya, 2019, 2019 5th International Conference on Control, Automation and Robotics (ICCAR).

Optimized Policies for the Retransmission Probabilities in Slotted Aloha

Shalabh Bhatnagar, Anshuk Chakraborty, 2010, Simul..

Robust Quadrupedal Locomotion on Sloped Terrains: A Linear Policy Approach pdf

Ashish Joglekar, Bharadwaj S. Amrutur, Shalabh Bhatnagar, 2020, CoRL.

Stochastic recursive inclusions with non-additive iterate-dependent Markov noise

Shalabh Bhatnagar, Vinayaka Yaji, 2016, ArXiv.

A Generalization of the Borkar-Meyn Theorem for Stochastic Recursive Inclusions pdf

Shalabh Bhatnagar, Arunselvan Ramaswamy, S. Bhatnagar, 2015, Math. Oper. Res..

Optimal Dynamic Allocation of Servers to Tasks using Simultaneous Perturbation Stochastic Algorithm

Shalabh Bhatnagar, Shreya Thusoo, S. Bhatnagar, 2014 .

Pattern Synthesis for Large-Scale Pattern Recognition

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2005 .

Optimal parameter trajectory estimation in parameterized SDEs: An algorithmic procedure

Shalabh Bhatnagar, Karmeshu, Vivek Kumar Mishra, 2009, TOMC.

Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge

Shalabh Bhatnagar, Sindhu Padakandla, Abhik Singla, 2018, IEEE Transactions on Intelligent Transportation Systems.

Hierarchical Average Reward Policy Gradient Algorithms pdf

Shalabh Bhatnagar, Matthew Riemer, Akshay Dharmavaram, 2019, ArXiv.

Stochastic Game Frameworks for Efficient Energy Management in Microgrid Networks

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, 2020, 2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe).

Properties of Kullback-Leibler cross-entropy minimization in nonextensive framework

Shalabh Bhatnagar, Ambedkar Dukkipati, Narasimha Murty Musti, 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

Multi-step linear Dyna-style planning

Shalabh Bhatnagar, Hengshuai Yao, Dongcui Diao, 2009, NIPS 2009.

Two-Timescale Algorithms for Learning Nash Equilibria in General-Sum Stochastic Games

Shalabh Bhatnagar, A. PrashanthL., H. L. Prasad, 2015, AAMAS.

A Discrete Parameter Stochastic Approximation Algorithm for Simulation Optimization

Shalabh Bhatnagar, Hemant J. Kowshik, S. Bhatnagar, 2005, Simul..

Q-Learning Based Energy Management Policies for a Single Sensor Node with Finite Buffer

Shalabh Bhatnagar, J. PrabuchandranK., Sunil Kumar Meena, 2013, IEEE Wireless Communications Letters.

Optimal control of a feedback queue via stochastic approximation

Shalabh Bhatnagar, Vinod Sharma, 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

Solution of Two-Player Zero-Sum Game by Successive Relaxation pdf

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, ArXiv.

Learning-Based Resource Allocation in Industrial IoT Systems

Shalabh Bhatnagar, Sindhu Padakandla, Shilpa Rao, 2020, 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications.

An optimal RIO with statistical delay assurances

Shalabh Bhatnagar, R. K. Patro, 2008 .

Deterministic Perturbations For Simultaneous Perturbation Methods Using Circulant Matrices pdf

Shalabh Bhatnagar, Sai Koti Reddy Danda, K Chandramouli, 2017, ArXiv.

Threshold Tuning Using Stochastic Optimization for Graded Signal Control

Shalabh Bhatnagar, A. PrashanthL., S. Bhatnagar, 2012, IEEE Transactions on Vehicular Technology.

Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization

Shalabh Bhatnagar, K. Lakshmanan, S. Bhatnagar, 2016, Computational Optimization and Applications.

A reinforcement learning approach to hybrid control design pdf

Shalabh Bhatnagar, Atreyee Kundu, Meet Gandhi, 2020, ArXiv.

Learning Active Spine Behaviors for Dynamic and Efficient Locomotion in Quadruped Robots

Shalabh Bhatnagar, Shishir Kolathaya, Bharadwaj Amrutur, 2019, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

Optimal Threshold Policies for Admission Control in Communication Networks via Discrete Parameter Stochastic Approximation

Shalabh Bhatnagar, I. Bala Bhaskar Reddy, S. Bhatnagar, 2005, Telecommun. Syst..

Universal Option Models

Shalabh Bhatnagar, Richard S. Sutton, Csaba Szepesvári, 2014, NIPS.

Stochastic recursive inclusions with two timescales pdf

Shalabh Bhatnagar, Arunselvan Ramaswamy, S. Bhatnagar, 2015, ArXiv.

Analysis of Stochastic Approximation Schemes With Set-Valued Maps in the Absence of a Stability Guarantee and Their Stabilization

Shalabh Bhatnagar, Vinayaka G. Yaji, S. Bhatnagar, 2017, IEEE Transactions on Automatic Control.

Partition based pattern synthesis technique with efficient algorithms for nearest neighbor classification

M. Narasimha Murty, Shalabh Bhatnagar, P. Viswanath, 2006, Pattern Recognit. Lett..

An incremental off-policy search in a model-free Markov decision process using a single sample path

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2018, Machine Learning.

An efficient and optimized bluetooth scheduling algorithm for scatternets

Shalabh Bhatnagar, G. R. Reddy, 2008 .

A Convergent Off-Policy Temporal Difference Algorithm

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, ECAI.

Conditions for Stability and Convergence of Set-Valued Stochastic Approximations: Applications to Approximate Value and Fixed point Iterations with Noise pdf

Shalabh Bhatnagar, Arunselvan Ramaswamy, S. Bhatnagar, 2017, ArXiv.

Two Timescale SPSA Algorithms for Rate-Based ABR Flow Control

Shalabh Bhatnagar, Steven I. Marcus, Michael C. Fu, 2000 .

Robust optimization of Random Early Detection

Shalabh Bhatnagar, Rahul Vaidya, 2006, Telecommun. Syst..

An optimal fuel-injection policy for performance enhancement in internal combustion engines

Shalabh Bhatnagar, V H Gupta, 1997 .

An Adaptive and Incremental Approach to Quantile Estimation

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

Natural actorcritic algorithms.

Shalabh Bhatnagar, Richard S. Sutton, Mohammad Ghavamzadeh, 2009 .

Improved Hessian estimation for adaptive random directions stochastic approximation

Shalabh Bhatnagar, A. PrashanthL., Sai Koti Reddy Danda, 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

Random Directions Stochastic Approximation With Deterministic Perturbations

Shalabh Bhatnagar, Steven I. Marcus, Michael Fu, 2018, IEEE Transactions on Automatic Control.

Incremental natural-gradient actor-critic algorithms

Shalabh Bhatnagar, Mark Lee, Richard S. Sutton, 2007 .

An actor critic algorithm based on Grassmanian search

Vivek S. Borkar, Shalabh Bhatnagar, J. PrabuchandranK., 2014, 53rd IEEE Conference on Decision and Control.

Realizing Learned Quadruped Locomotion Behaviors through Kinematic Motion Primitives

Bharadwaj S. Amrutur, Shalabh Bhatnagar, Shishir Kolathaya, 2018, 2019 International Conference on Robotics and Automation (ICRA).

Deterministic Algorithms for Local Search

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2013 .

Multi-Agent Q-Learning for Minimizing Demand-Supply Power Deficit in Microgrids pdf

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, 2017, ArXiv.

Smoothed Functional and Quasi-Newton Algorithms for Routing in Multi-stage Queueing Network with Constraints

Shalabh Bhatnagar, K. Lakshmanan, S. Bhatnagar, 2011, ICDCIT.

A Novel RF Energy Harvesting Module Integrated on a Single Substrate

Shalabh Bhatnagar, Ghanshyam Singh, Monika Mathur, 2017, 1712.04320.

Fast gradient-descent methods for temporal-difference learning with linear function approximation

Shalabh Bhatnagar, Doina Precup, Richard S. Sutton, 2009, ICML '09.

An Online Actor–Critic Algorithm with Function Approximation for Constrained Markov Decision Processes

Shalabh Bhatnagar, K. Lakshmanan, S. Bhatnagar, 2012, J. Optim. Theory Appl..

Shaping Proto-Value Functions Using Rewards

Shalabh Bhatnagar, Sindhu Padakandla, Chandrashekar Lakshminarayanan, 2016, ECAI.

Analysis of Gradient Descent Methods With Nondiminishing Bounded Errors

Shalabh Bhatnagar, Arunselvan Ramaswamy, S. Bhatnagar, 2016, IEEE Transactions on Automatic Control.

Successive Over Relaxation Q-Learning

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2019, IEEE Control. Syst. Lett..

Gait Library Synthesis for Quadruped Robots via Augmented Random Search pdf

Ashish Joglekar, Shalabh Bhatnagar, Shishir Kolathaya, 2019, ArXiv.

An Optimized SDE Model for Slotted Aloha

Shalabh Bhatnagar, Karmeshu, Vivek Kumar Mishra, 2011, IEEE Transactions on Communications.

Deep Reinforcement Learning with Successive Over-Relaxation and its Application in Autoscaling Cloud Resources

Shalabh Bhatnagar, Indu John, 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

An Incremental Algorithm for Estimating Extreme Quantiles

Shalabh Bhatnagar, Ajin George Joseph, S. Bhatnagar, 2019, 2019 Sixth Indian Control Conference (ICC).

Simulation-Based Optimization Algorithms for Finite-Horizon Markov Decision Processes

Shalabh Bhatnagar, Mohammed Shahid Abdulla, S. Bhatnagar, 2008, Simul..

Novel Sensor Scheduling Scheme for Intruder Tracking in Energy Efficient Sensor Networks

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Prabuchandran K.J., 2017, IEEE Wireless Communications Letters.

Optimal Parameterized Policies for Resource Allocation in Communication Networks

Shalabh Bhatnagar, Diksha Sharma, 2006 .

Discrete parameter simulation optimization algorithms with applications to admission control with dependent service times

Shalabh Bhatnagar, N. Hemachandra, Vivek Kumar Mishra, 2007, 2007 46th IEEE Conference on Decision and Control.

A Study of Gradient Descent Schemes for General-Sum Stochastic Games pdf

Shalabh Bhatnagar, H. L. Prasad, S. Bhatnagar, 2015, ArXiv.

Algorithms for Constrained Optimization

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2013 .

Reinforcement Learning Based Algorithms for Average Cost Markov Decision Processes

Shalabh Bhatnagar, Mohammed Shahid Abdulla, M. S. Abdulla, 2007, Discret. Event Dyn. Syst..

A novel Q-learning algorithm with function approximation for constrained Markov decision processes

Shalabh Bhatnagar, K. Lakshmanan, S. Bhatnagar, 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

Asynchronous stochastic approximations with asymptotically biased errors and deep multi-agent learning

Daniel E. Quevedo, Shalabh Bhatnagar, Arunselvan Ramaswamy, 2018 .

Simultaneous perturbation methods for adaptive labor staffing in service systems

Shalabh Bhatnagar, Nirmit Desai, A. PrashanthL., 2013, Simul..

A simultaneous perturbation stochastic approximation-based actor-critic algorithm for Markov decision processes

Shalabh Bhatnagar, Shishir Kumar, S. Bhatnagar, 2004, IEEE Transactions on Automatic Control.

Dynamic Mirror Descent based Model Predictive Control for Accelerating Robot Learning pdf

Shalabh Bhatnagar, Shishir Kolathaya, Aditya Sagi, 2021, ArXiv.

Generalized Second Order Value Iteration in Markov Decision Processes

Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, Chandramouli Kamanchi, 2021, IEEE Transactions on Automatic Control.

Neural Network Compatible Off-Policy Natural Actor-Critic Algorithm pdf

Prateek Jain, Shalabh Bhatnagar, Raghuram Bharadwaj Diddigi, 2021, ArXiv.

Gradient Temporal Difference with Momentum: Stability and Convergence pdf

Shalabh Bhatnagar, Rohan Deb, S. Bhatnagar, 2021, AAAI.

On tight bounds for function approximation error in risk-sensitive reinforcement learning

Shalabh Bhatnagar, Prasenjit Karmakar, S. Bhatnagar, 2021, Syst. Control. Lett..

Dynamics of stochastic approximation with Markov iterate-dependent noise with the stability of the iterates not ensured

Shalabh Bhatnagar, Prasenjit Karmakar, S. Bhatnagar, 2016 .

Schedule Based Temporal Difference Algorithms pdf

Shalabh Bhatnagar, Meet Gandhi, Rohan Deb, 2021, ArXiv.

N-Timescale Stochastic Approximation: Stability and Convergence pdf

Shalabh Bhatnagar, Rohan Deb, S. Bhatnagar, 2021, ArXiv.

Reinforcement Learning for Task Specifications with Action-Constraints pdf

Shalabh Bhatnagar, Arun Raman, Keerthan Shagrithaya, 2022, ArXiv.

Finite Horizon Q-learning: Stability, Convergence and Simulations pdf

Shalabh Bhatnagar, VP Vivek, S. Bhatnagar, 2021, ArXiv.

Analyzing Approximate Value Iteration Algorithms

Shalabh Bhatnagar, Arunselvan Ramaswamy, 2021, Mathematics of Operations Research.

Robust Quadrupedal Locomotion on Sloped Terrains: A Linear Policy Approach pdf

Ashish Joglekar, Bharadwaj S. Amrutur, Shalabh Bhatnagar, 2020, CoRL.

Kiefer-Wolfowitz Algorithm

Shalabh Bhatnagar, L A Prashanth, H. L. Prasad, 2013 .

Asymptotic and non-asymptotic convergence properties of stochastic approximation with controlled Markov noise without ensuring stability

Vivek S. Borkar, Shalabh Bhatnagar, Prasenjit Karmakar, 2016 .