V. Borkar

D. Manjunath, Vivek S. Borkar, Parijat Dube, 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

Controlled Markov chains with constraints

V. Borkar, 1990 .

Network pricing for QoS: A 'Regulation' approach

D. Manjunath, Vivek S. Borkar, Dinesh Garg, 2005 .

Dynamic programming for ergodic control with partial observations

V. Borkar, 2003 .

Convex Analytic Methods in Markov Decision Processes

Vivek S. Borkar, V. Borkar, 2002 .

Controlled diffusions with constraints

M. K. Ghosh, V. Borkar, 1990 .

Occupation measures for controlled Markov processes: characterization and optimality

V. Borkar, A. Bhatt, 1996 .

Average Cost Dynamic Programming Equations For Controlled Markov Chains With Partial Observations

Vivek S. Borkar, V. Borkar, 2000, SIAM J. Control. Optim..

Risk-Constrained Markov Decision Processes

Vivek S. Borkar, Rahul Jain, V. Borkar, 2010, IEEE Trans. Autom. Control..

A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions"

Vivek S. Borkar, Ari Arapostathis, A. Arapostathis, 2017, SIAM J. Control. Optim..

A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝd

Vivek S. Borkar, Ari Arapostathis, Anup Biswas, 2019, SIAM J. Control. Optim..

Controlled equilibrium selection in stochastically perturbed dynamics

A. Arapostathis, V. Borkar, A. Biswas, 2015, The Annals of Probability.

Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula

A. Arapostathis, V. Borkar, K. S. Kumar, 2013, 1312.5834.

Dynamics of individual specialization and global diversification in communities

Vivek S. Borkar, Govindan Rangarajan, Sanjay Jain, 1998 .

Ergodic Control of Diffusion Processes: Preface

Vivek S. Borkar, Ari Arapostathis, Mrinal K. Ghosh, 2011 .

Common randomness and distributed control: A counterexample

Vivek S. Borkar, Venkat Anantharam, V. Borkar, 2007, Systems & control letters (Print).

A stochastic Kaczmarz algorithm for network tomography

D. Manjunath, Vivek S. Borkar, Gugan Thoppe, 2012, Autom..

Singular Perturbations in Ergodic Control of Diffusions

Vivek S. Borkar, Vladimir Gaitsgory, V. Borkar, 2007, SIAM J. Control. Optim..

Asynchronous Gossip for Averaging and Spectral Ranking

Vivek S. Borkar, Rajesh Sundaresan, Rahul M. Makhijani, 2013, IEEE Journal of Selected Topics in Signal Processing.

Metastability in Stochastic Replicator Dynamics

Vivek S. Borkar, Konstantin Avrachenkov, V. Borkar, 2018, Dynamic Games and Applications.

Asymptotics of the invariant measure in mean field models with jumps

V. Borkar, R. Sundaresan, 2012 .

A New Markov Selection Procedure for Degenerate Diffusions

V. Borkar, K. Suresh Kumar, 2010 .

Asymptotics of the invariant measure in mean field models with jumps

Vivek S. Borkar, Rajesh Sundaresan, V. Borkar, 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

Small noise asymptotics for invariant densities for a class of diffusions: A control theoretic view

V. Borkar, A. Biswas, 2009, 1107.2277.

Distributed Stochastic Approximation with Local Projections

Vivek S. Borkar, Suhail Mohmad Shah, V. Borkar, 2017, SIAM J. Optim..

A dynamic programming framework for optimal home scheduling

Vivek S. Borkar, Anupama Kowli, Joel Jose, 2017, 2017 IEEE Innovative Smart Grid Technologies - Asia (ISGT-Asia).

Submodularity in Team Formation Problem

Vivek S. Borkar, Dinesh Garg, Avradeep Bhowmik, 2014, SDM.

Some Game-Theoretic Problems in Wireless Ad-Hoc Networks

Eitan Altman, Vivek S. Borkar, Refik Molva, 2004, EuroNGI Workshop.

Application of nonlinear filtering to credit risk

Vivek S. Borkar, Govindan Rangarajan, Mrinal K. Ghosh, 2010, Oper. Res. Lett..

McKean–Vlasov Limit in Portfolio Optimization

V. Borkar, K. S. Kumar, K. Suresh Kumar, 2010 .

Reinforcement learning, particle filters and the EM algorithm

Vivek S. Borkar, Ankushkumar Jain, V. Borkar, 2014, 2014 Information Theory and Applications Workshop (ITA).

Relative Value Iteration for Stochastic Differential Games pdf

Vivek S. Borkar, Ari Arapostathis, K. Suresh Kumar, 2012, ArXiv.

Stochastic differential games: Occupation measure based approach

M. K. Ghosh, V. Borkar, 1996 .

Ergodic Control of Diffusion Processes

V. Borkar, 2012 .

Blackwell's approachability in stackelberg stochastic games: A learning version

Vivek S. Borkar, Rahul Jain, Dileep M. Kalathil, 2014, 53rd IEEE Conference on Decision and Control.

Design and Implementation of SeTiA: Secure Multi Auction System II: Architecture and Implementation Issues

Vivek S. Borkar, R. K. Shyamasundar, M. S. Dave, 2005 .

Distributed self-tuning of sensor networks

Vivek S. Borkar, Anurag Kumar, Aditya Karnik, 2006, Wirel. Networks.

Linear and dynamic programming approaches to degenerate risk-sensitive reward processes

Vivek S. Borkar, V. Borkar, 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

Risk-Sensitive Control with Near Monotone Cost

V. Borkar, A. Biswas, K. Suresh Kumar, 2010 .

Dynamic Programming for Ergodic Control of Markov Chains under Partial Observations: A Correction

Vivek S. Borkar, V. Borkar, 2007, SIAM J. Control. Optim..

A further remark on dynamic programming for partially observed Markov processes

V. Borkar, A. Budhiraja, 2004 .

Optimal sequential vector quantization of Markov sources

V. Borkar, S. Mitter, S. Tatikonda, 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

Ergodic Control for Constrained Diffusions: Characterization Using HJB Equations

Vivek S. Borkar, Amarjit Budhiraja, V. Borkar, 2004, SIAM J. Control. Optim..

Directed graphs, Hamiltonicity and doubly stochastic matrices

Vivek S. Borkar, Jerzy A. Filar, Vladimir Ejov, 2004, Random Struct. Algorithms.

Stochastic approximation with 'controlled Markov' noise

Vivek S. Borkar, V. Borkar, 2006, Systems & control letters (Print).

Stochastic approximation algorithms: Overview and recent trends

Vivek S. Borkar, B Bharath, V. Borkar, 1999 .

Distributed computation of fixed points of ∞-nonexpansive maps

V. Borkar, 1996 .

Correction to "Recursive self-tuning control of finite Markov chains" (Applicationes Math. 24 (2) (1996), 169-188)

V. Borkar, 1997 .

Stochastic differential games: Occupation measure based approach

M. K. Ghosh, V. Borkar, 1992 .

Stochastic approximation with ‘bad’ noise

Vivek S. Borkar, Venkat Anantharam, V. Borkar, 2011, 2011 Information Theory and Applications Workshop.

Recent trends in Markov decision processes

Vivek S. Borkar, Mrinal K. Ghosh, M. K. Ghosh, 2013 .

On the Milito-Cruz adaptive control scheme for Markov chains

V. Borkar, 1993 .

Gradient Estimation with Simultaneous Perturbation and Compressive Sensing

Vivek S. Borkar, Neeraja Sahasrabudhe, Vikranth Reddy Dwaracherla, 2015, J. Mach. Learn. Res..

Stochastic approximation algorithms for rumor source inference on graphs

Vivek S. Borkar, Nikhil Karamchandani, Anand Kalvit, 2019, Perform. Evaluation.

Models for Performance Analysis and Control of Networks

Alberto Blanc, Eitan Altman, Evsey Morozov, 2006 .

Average cost optimal control under weak hypotheses: Relative value iterations pdf

Vivek S. Borkar, Ari Arapostathis, A. Arapostathis, 2019, ArXiv.

Adaptive control of Markov chains

V. Borkar, P. Varaiya, 1979 .

IMPROVED TEMPORAL DIFFERENCE METHODS WITH LINEAR FUNCTION APPROXIMATION1

D. Bertsekas, V. Borkar, A. Nedić, 2003 .

DIMENSIONAL LINEAR SYSTEMS

V. Borkar, A. Bagchi, 1981 .

ADAPTIVE FEATURE PURSUIT: ONLINE ADAPTATION OF FEATURES IN REINFORCEMENT LEARNING

S. Bhatnagar, V. Borkar, 2011 .

Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents

Akhil Shetty, Bhumesh Kumar, Vivek Borkar, 2018, Mathematics of Control, Signals, and Systems.

Fast rumor source identification via random walks

Vivek S. Borkar, Dinesh Garg, Alankar Jain, 2016, Social Network Analysis and Mining.

Managing interprocessor delays in distributed recursive algorithms

Vivek S. Borkar, Vv Phansalkar, V. Borkar, 1994 .

Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space

Vivek S. Borkar, Ankur A. Kulkarni, V. Borkar, 2009, Autom..

Index Policies for Real-Time Multicast Scheduling for Wireless Broadcast Systems

Vivek S. Borkar, Panganamala Ramana Kumar, Min Cao, 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

Edge conductance estimation using MCMC

Vivek S. Borkar, Rajesh Sundaresan, Dinesh Garg, 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

An Information Theoretic View of Stochastic Resonance

Vivek S. Borkar, Venkat Anantharam, V. Borkar, 2007, 2007 IEEE International Symposium on Information Theory.

On the Lock-in Probability of Stochastic Approximation

Vivek S. Borkar, V. Borkar, 2002, Combinatorics, Probability and Computing.

Ergodic Control of Diffusion Processes

Vivek S. Borkar, Ari Arapostathis, Mrinal K. Ghosh, 2012 .

On Extremal Solutions of Controlled Nonlinear Filtering Equations

V. Borkar, Sunil Kumar, 1995 .

Ergodic control of multidimensional diffusions 1: the existence results

M. K. Ghosh, V. Borkar, 1988 .

Ergodic control problem for one-dimensional diffusions with near-monotone cost

V. Borkar, A. Bensoussan, 1984 .

On extremal solutions to stochastic control problems

V. Borkar, 1991 .

Corrections to :20Ergodic control problem for one-dimensional diffusions with near-monotone cost”

V. Borkar, A. Bensoussan, 1986 .

Structural Properties of Optimal Transmission Policies Over a Randomly Varying Channel

Vivek S. Borkar, Abhay Karandikar, Mukul Agarwal, 2008, IEEE Transactions on Automatic Control.

Manufacturing consent

Vivek S. Borkar, Jayakrishnan Nair, Aditya Karnik, 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

On Existence of Limit Occupational Measures Set of a Controlled Stochastic Differential Equation

Vivek S. Borkar, Vladimir Gaitsgory, V. Borkar, 2005, SIAM J. Control. Optim..

Opportunistic Scheduling as Restless Bandits

Vivek S. Borkar, Gaurav S. Kasbekar, Sarath Pattathil, 2017, IEEE Transactions on Control of Network Systems.

An index policy for dynamic pricing in cloud computing under price commitments

Krishnakant V. Saboo, V. Borkar, Krishnakant Saboo, 2017 .

Weak convergence methods and singularly perturbed stochastic control and filtering problems: Harold J. Kushner

Vivek S. Borkar, V. Borkar, 1992, Autom..

A note on controlled diffusions on line with time-averaged cost

V. Borkar, 1984 .

Optimal Control of a Stochastic Hybrid System with Discounted Cost

M. K. Ghosh, V. Borkar, P. Sahay, 1999 .

HJB Equations for Ergodic Control Problems for Constrained Diffusions in Polyhedral Domains.

V. Borkar, A. Budhiraja, 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

Sample complexity for markov chain self-tuner

V. Borkar, 2000 .

On the fastest finite Markov processes

V. Borkar, L. Miclo, 2016, Journal of Mathematical Analysis and Applications.

Sequential Source Coding: An optimization viewpoint

A. Sahai, V. Borkar, S. Mitter, 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

O C ] 7 M ay 2 01 8 Linear Programming Formulation of Long Run Average Optimal Control Problem

V. Borkar, V. Gaitsgory, 2018 .

A Power Optimal Scheduling Algorithm on a Point to Point Wireless Link

V. Borkar, A. Karandikar, Nitin Salodkar, 2006 .

User Association in Dense mmWave Networks as Restless Bandits

V. Borkar, G. Kasbekar, S. Singh, 2021, IEEE Transactions on Vehicular Technology.

Random Projections and Ensemble Kalman Filter BTP Stage-II Full Report by Raaz Dwivedi Roll

V. Borkar, 2016 .

Manufacturing Consent * (invited Paper)

V. Borkar, J. Nair, Nalli Sanketh, 2011 .

Optimal sequential vector quantization of Markov sources

V. Borkar, S. Mitter, S. Tatikonda, 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

Probability CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS By

A. Arapostathis, V. Borkar, A. Biswas, 2017 .

Ergodic control of partially observed Markov chains

Vivek S. Borkar, V. Borkar, 1998 .

Erratum to “Ergodic control of partially observed Markov chains” [Systems Control Lett. 34 (1998) 185–189]☆

Vivek S. Borkar, V. Borkar, 1999 .

CAPACITY OF MARKOV CHANNELS: A STOCHASTIC CONTROL APPROACH

V. Borkar, V. Sharma, A. Kherani, 2008 .

Averaging of Singularly Perturbed Controlled Stochastic Differential Equations

Vivek S. Borkar, Vladimir Gaitsgory, V. Borkar, 2007 .

Pathwise smoothing of Markov processes with noisy observations

V. Borkar, 1982 .

PR ] 7 M ay 2 01 8 Metastability in Stochastic Replicator Dynamics

V. Borkar, K. Avrachenkov, Konstantin Avrachenkov, 2018 .

Power Optimal Opportunistic Scheduling

Abhijeet Bhorkar, Vivek S. Borkar, Abhay Karandikar, 2008 .

Lqg Control with Communication Constraints* Lqg Control with Communication Constraints

V. Borkar, 2022 .

Collective Behaviour and Diversity in Economic Communities: Some Insights from an Evolutionary Game

Vivek S. Borkar, Govindan Rangarajan, V. Borkar, 1998, adap-org/9804003.

Sparse Regression using Compressive Sensing with Input Shaping

V. Borkar, V. Dwaracherla, Neeraja Sahasrabudhe, 2018 .

Dynamic social learning under graph constraints pdf

Sharayu Moharir, Konstantin Avrachenkov, Suhail M. Shah, 2020, IEEE Transactions on Control of Network Systems.

On the lock-in probability estimate of stochastic approximation with controlled Markov noise

Vivek S. Borkar, Shalabh Bhatnagar, Prasenjit Karmakar, 2016 .

Directed graphs, Hamiltonicity and doubly stochastic matrices

V. Borkar, J. Filar, V. Ejov, 2004, Random Struct. Algorithms.

On the relative value iteration with a risk-sensitive criterion

A. Arapostathis, V. Borkar, 2019, Banach Center Publications.

Who is the fairest of them all?

Vivek S. Borkar, Rahul M. Makhijani, V. Borkar, 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

Endorsements for Communication Networking: An Analytical Approach

Vivek S. Borkar, V. Borkar, 2004 .

Accelerating MCMC by Rare Intermittent Resets

Vivek S. Borkar, Syomantak Chaudhuri, V. Borkar, 2021, VALUETOOLS.

Asymptotic and non-asymptotic convergence properties of stochastic approximation with controlled Markov noise using lock-in probability

S. Bhatnagar, V. Borkar, Prasenjit Karmakar, 2016 .

Scheduling in Wireless Networks using Whittle Index Theory

V. Borkar, G. Kasbekar, B. KarthikG.V., 2022, ArXiv.

A Concentration Bound for Lspe$(\Lambda)$

V. Borkar, Siddharth Chandak, H. Dolhare, 2021, SSRN Electronic Journal.

“Controlled” Versions of the Collatz–Wielandt and Donsker–Varadhan Formulae

A. Arapostathis, V. Borkar, Aristotle Arapostathis, 2019, Infosys Science Foundation Series.

A two timescale stochastic approximation scheme for simulation-based parametric optimization

S. Bhatnagar, V. Borkar, 1998 .

Concentration bounds for SSP Q-learning for average cost MDPs

V. Borkar, Shaan ul Haque, 2022, ArXiv.

Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents

V. Borkar, Bhumesh Kumar, A. Shetty, 2018, Math. Control. Signals Syst..

Wardrop equilibria and relaxation oscillations in queuing systems

V. Borkar, Corinne Touati, 2017 .

Concentration of Contractive Stochastic Approximation and Reinforcement Learning

V. Borkar, Siddharth Chandak, 2021, Stochastic Systems.

Collective Behaviour and Diversity in Economic Communities: Some Insights from an Evolutionary Game

V. Borkar, Sanjay Jain, G. Rangarajan, 1998, adap-org/9804003.

Dynamics of individual specialization and global diversification in communities

V. Borkar, Sanjay Jain, G. Rangarajan, 1998, Complex..

A Concentration Bound for Distributed Stochastic Approximation

V. Borkar, H. Dolhare, 2022, Allerton Conference on Communication, Control, and Computing.

Controlled diffusion processes

V. Borkar, 2005, math/0511077.

Reinforcement Learning in Non-Markovian Environments

V. Borkar, Siddharth Chandak, Parth Dodhia, 2022, SSRN Electronic Journal.

A concentration bound for contractive stochastic approximation

Vivek S. Borkar, V. Borkar, 2021, Syst. Control. Lett..

Corrigendum to “A concentration bound for contractive stochastic approximation” [Syst. Control Lett. 153 (2021) 104947]

V. Borkar, 2022, Systems & Control Letters.

A Concentration Bound for Lspe$(\Lambda)$

V. Borkar, Siddharth Chandak, H. Dolhare, 2021, SSRN Electronic Journal.

A Concentration Bound for Stochastic Approximation via Alekseev’s Formula

V. Borkar, Gugan Thoppe, 2015, Stochastic Systems.

A Concentration Bound for Lspe$(\Lambda)$

V. Borkar, Siddharth Chandak, H. Dolhare, 2021, SSRN Electronic Journal.

Nonlinear Gossip

Vivek S. Borkar, Adwaitvedant S. Mathkar, V. Borkar, 2016, SIAM J. Control. Optim..

Stochastic Processes at Generate olygonal and Related

Vivek S. Borkar, Sanjoy K. Mitter, V. Borkar, 1996 .

Small noise asymptotics for invariant densities for a class of diffusions: A control theoretic view

V. Borkar, A. Biswas, 2009, 1107.2277.

Ergodic risk-sensitive control - A survey

V. Borkar, A. Biswas, 2022, Annu. Rev. Control..

On De finetti coherence and kolmogorov probability

V. Borkar, V. Konda, S. Mitter, 2004 .

Linear Programming Formulation of Long-Run Average Optimal Control Problem

V. Borkar, V. Gaitsgory, 2018, Journal of Optimization Theory and Applications.

Metastability in Stochastic Replicator Dynamics

V. Borkar, K. Avrachenkov, 2018, Dynamic Games and Applications.

A novel ACO algorithm for optimization via reinforcement and initial bias

Vivek S. Borkar, Dibyajyoti Das, V. Borkar, 2009, Swarm Intelligence.

Parameter estimation in continuous-time stochastic processes

V. Borkar, A. Bagchi, 1982 .

Fast rumor source identification via random walks

V. Borkar, Dinesh Garg, Alankar Jain, 2016, Social Network Analysis and Mining.

A Learning Algorithm for Risk-Sensitive Cost

Vivek S. Borkar, Arnab Basu, Tirthankar Bhattacharyya, 2008, Math. Oper. Res..

A sensitivity formula for risk-sensitive cost and the actor-critic algorithm

Vivek S. Borkar, V. Borkar, 2001, Syst. Control. Lett..

Revisiting SIR in the age of COVID-19: Explicit Solutions and Control Problems

V. Borkar, D. Manjunath, 2020, SIAM J. Control. Optim..

Oja's algorithm for graph clustering and Markov spectral decomposition

Sean P. Meyn, Vivek S. Borkar, V. Borkar, 2008, VALUETOOLS.

Distributed and Asynchronous Methods for Semi-supervised Learning

Vivek S. Borkar, Konstantin Avrachenkov, Krishnakant Saboo, 2016, WAW.

Parallel and Distributed Approaches for Graph Based Semi-supervised Learning pdf

Vivek S. Borkar, Konstantin Avrachenkov, Krishnakant Saboo, 2015, ArXiv.

Logic and mathematical programming

Vivek S. Borkar, Vijay Chandru, Sanjoy K. Mitter, 1997 .

Risk sensitive dynamic programming with unbounded cost

Sean P. Meyn, V. S. Borkar, S. Balaji, 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

Randomized Kaczmarz for rank aggregation from pairwise comparisons

Vivek S. Borkar, Nikhil Karamchandani, Sharad Mirani, 2016, 2016 IEEE Information Theory Workshop (ITW).

Parameter estimation in stochastic systems: some recent results and applications

V. Borkar, 1982 .

Learning to cooperate in agent-based control of queueing networks

V. Borkar, 2022, Queueing Systems.

Whittle Index Policy for Crawling Ephemeral Content

Vivek S. Borkar, Konstantin E. Avrachenkov, V. Borkar, 2018, IEEE Transactions on Control of Network Systems.

Optimal random access in networks with two-way traffic

Eitan Altman, Vivek S. Borkar, Arzad Alam Kherani, 2004, 2004 IEEE 15th International Symposium on Personal, Indoor and Mobile Radio Communications (IEEE Cat. No.04TH8754).

Prospect-theoretic Q-learning

V. Borkar, Siddharth Chandak, 2021, Syst. Control. Lett..

On infinitesimal σ-fields generated by random processes

V. Borkar, 1993 .

Self-tuning control of diffusions without the identifiability condition

Vivek S. Borkar, V. Borkar, 1991 .

An efficient scheduling algorithm for solving load commitment problem under Time of Use Pricing with bound on Maximum Demand

Vivek S. Borkar, T. P. Imthias Ahamed, V. Borkar, 2014, 2014 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES).

Ergodic and adaptive control of nearest-neighbor motions

Vivek S. Borkar, Mrinal K. Ghosh, M. K. Ghosh, 1991, Math. Control. Signals Syst..

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning pdf

Ioannis Kontoyiannis, Shuhang Chen, Adithya M. Devraj, 2021, ArXiv.

Special Issue : Multi-Agent Dynamic Decision Making and Learning

V. Borkar, Konstantin Avrachenkov, U. J. Nair, 2023, Dynamic Games and Applications.

Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control

Sean P. Meyn, Vivek S. Borkar, V. Borkar, 2012, Autom..

Control of Markov Chains with Long-Run Average Cost Criterion

Vivek S. Borkar, V. Borkar, 1988 .

Concentration bounds for two time scale stochastic approximation

Vivek S. Borkar, Sarath Pattathil, V. Borkar, 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

Actor-Critic Algorithms with Online Feature Adaptation

Vivek S. Borkar, Shalabh Bhatnagar, J. PrabuchandranK., 2016, ACM Trans. Model. Comput. Simul..

A learning algorithm for Markov decision processes with adaptive state aggregation

John S. Baras, V. S. Borkar, V. Borkar, 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

Dynamic Social Learning Under Graph Constraints

V. Borkar, S. Shah, Sharayu Moharir, 2020, IEEE Transactions on Control of Network Systems.

Q-learning for Markov decision processes with a satisfiability criterion

Vivek S. Borkar, Suhail M. Shah, V. Borkar, 2018, Syst. Control. Lett..

Functional Central Limit Theorem for Two Timescale Stochastic Approximation

V. Borkar, Fathima Zarin Faizal, 2023, 2306.05723.

Remarks on Differential Inclusion limits of Stochastic Approximation

V. Borkar, Dhruv Shah, 2023, 2303.04558.

Actor-Critic or Critic-Actor? A Tale of Two Time Scales

S. Bhatnagar, V. Borkar, Soumyajit Guin, 2022, ArXiv.

Bounds for Tracking Error in Constant Stepsize Stochastic Approximation

V. Borkar, Bhumesh Kumar, A. Shetty, 2018 .

Event-driven stochastic approximation

V. Borkar, Neeraja Sahasrabudhe, M. Ashok Vardhan, 2016, Indian Journal of Pure and Applied Mathematics.

Distributed Reinforcement Learning via Gossip

Vivek S. Borkar, Adwaitvedant S. Mathkar, Adwaitvedant Mathkar, 2013, IEEE Transactions on Automatic Control.

Dynamic Cesaro-Wardrop equilibration in networks

Vivek S. Borkar, Panganamala Ramana Kumar, V. Borkar, 2003, IEEE Trans. Autom. Control..

Simultaneous Small Noise Limit for Singularly Perturbed Slow-Fast Coupled Diffusions

V. Borkar, K. S. Kumar, R. Sundaresan, 2018, Applied Mathematics & Optimization.

Stochastic quantization of field theory in finite and infinite volume

V. Borkar, S. Mitter, R. Chari, 1988 .

The probabilistic structure of controlled diffusion processes

V. Borkar, 1988 .

Scheduling in Wireless Networks with Spatial Reuse of Spectrum as Restless Bandits pdf

Vivek S. Borkar, Gaurav S. Kasbekar, Shantanu Choudhary, 2019, Perform. Evaluation.

Distributed Server Allocation for Content Delivery Networks pdf

Vivek S. Borkar, Gaurav S. Kasbekar, Sarath Pattathil, 2017, ArXiv.

Model-based clock synchronization protocol for wireless sensor networks pdf

Vivek S. Borkar, Panganamala Ramana Kumar, Nikolaos M. Freris, 2013, ArXiv.

On the Hamiltonicity Gap and doubly stochastic matrices

Vivek S. Borkar, Jerzy A. Filar, Vladimir Ejov, 2009, Random Struct. Algorithms.

Controlling G-AIMD by index policy

Vivek S. Borkar, Sarath Pattathil, Konstantin E. Avrachenkov, 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

Full Gradient DQN Reinforcement Learning: A Provably Convergent Scheme

V. Borkar, H. Dolhare, Konstantin Avrachenkov, 2021, Modern Trends in Controlled Stochastic Processes:.

Control of a partially observed diffusion up to an exit time

V. Borkar, 1987 .

Opportunistic Transmission over Randomly Varying Channels

Vivek S. Borkar, V. Borkar, 2009, NET-COOP.

Some Examples of Stochastic Approximation in Communications

Vivek S. Borkar, V. Borkar, 2007, NET-COOP.

From Collatz-Weilandt to Donkser-Varadhan via Krein-Rutman

Vivek S. Borkar, Ari Arapostathis, K. Suresh Kumar, 2014, 53rd IEEE Conference on Decision and Control.

Parameter identification in infinite dimensional linear systems

V. Borkar, A. Bagchi, 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning

Adithya M. Devraj, V. Borkar, S. Meyn, 2021, ArXiv.

An actor-critic algorithm for constrained Markov decision processes

Vivek S. Borkar, V. Borkar, 2005, Syst. Control. Lett..

Equation of State Calculations by Fast Computing Machines

V. Borkar, 2022, Resonance.

Opinion Shaping in Social Networks Using Reinforcement Learning pdf

Alexandre Reiffers, Vivek Borkar, V. Borkar, 2019, IEEE Transactions on Control of Network Systems.

Risk-constrained Markov decision processes

Vivek S. Borkar, Rahul Jain, V. Borkar, 2010, 49th IEEE Conference on Decision and Control (CDC).

Optimal Control of Sleep Periods for Wireless Terminals

Eitan Altman, Vivek S. Borkar, Sara Alouf, 2011, IEEE Journal on Selected Areas in Communications.

Charge-based control of DiffServ-like queues

Vivek S. Borkar, D. Manjunath, V. Borkar, 2004, Autom..

Asynchronous Stochastic Approximations

V. Borkar, C. SIAMJ., 1998 .

An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel

Abhijeet Bhorkar, Vivek S. Borkar, Abhay Karandikar, 2008, IEEE Journal on Selected Areas in Communications.

Optimal Control of Diffusion Processes

Vivek S. Borkar, V. Borkar, 1989 .

Whittle index based Q-learning for restless bandits with average reward

V. Borkar, Konstantin Avrachenkov, 2020, Autom..

QWI

V. Borkar, U. Ayesta, Francisco Robledo, 2022, SIGMETRICS Perform. Evaluation Rev..

Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet

Vivek S. Borkar, Prasanna Chaporkar, Abhay Karandikar, 2020, IEEE Transactions on Mobile Computing.

Whittle indexability in egalitarian processor sharing systems

Vivek S. Borkar, Sarath Pattathil, V. Borkar, 2017, Annals of Operations Research.

Manufacturing Consent

V. Borkar, A. Karnik, J. Nair, 2015, IEEE Transactions on Automatic Control.

Reinforcement Learning in Non-Markovian Environments

V. Borkar, Siddharth Chandak, Parth Dodhia, 2022, SSRN Electronic Journal.

Empirical Q-Value Iteration pdf

Vivek S. Borkar, Rahul Jain, Dileep M. Kalathil, 2014, Stochastic Systems.

Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs

Vivek S. Borkar, Ari Arapostathis, K. Suresh Kumar, 2013, SIAM J. Control. Optim..

MCMC Approaches to Rumor Source Inference using Pairwise Information

Vivek S. Borkar, Nikhil Karamchandani, Anand Kalvit, 2017, VALUETOOLS.

Distributed topology control of wireless networks

D. Manjunath, Vivek S. Borkar, V. Borkar, 2005, Third International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt'05).

Mathematical Programming Embeddings of Logic

Vivek S. Borkar, Vijay Chandru, Sanjoy K. Mitter, 2002, Journal of Automated Reasoning.

Problem-aware scheduling of in-network computation over multi-hop wireless networks

D. Manjunath, V. S. Borkar, R. Meshram, 2012, 2012 International Conference on Signal Processing and Communications (SPCOM).

Whittle index policy for crawling ephemeral content

Vivek S. Borkar, Konstantin Avrachenkov, V. Borkar, 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

Gossip with transmission constraints

Vivek S. Borkar, Rajesh Sundaresan, Rahul M. Makhijani, 2013, 2013 Information Theory and Applications Workshop (ITA).

9 Improved Temporal Difference Methods with Linear Function Approximation

D. Bertsekas, V. Borkar, 2008 .

A Stable On-line Algorithm for Energy Efficient Multi-user Scheduling pdf

Vivek S. Borkar, Abhay Karandikar, Nitin Salodkar, 2009, ArXiv.

A note on linear function approximation using random projections

Vivek S. Borkar, Kishor Barman, V. Borkar, 2008, Syst. Control. Lett..

WLC39-3: Power Optimal Opportunistic Scheduling

Abhijeet Bhorkar, Vivek S. Borkar, Abhay Karandikar, 2006, IEEE Globecom 2006.

Pictures at an exhibition — A Lagrange multiplier gallery

V. Borkar, 1998 .

Newton’s method

V. Borkar, 2002 .

Manufacturing Consent

V. Borkar, A. Karnik, J. Nair, 2015, IEEE Transactions on Automatic Control.

Markov chains, Hamiltonian cycles and volumes of convex bodies

Vivek S. Borkar, Jerzy A. Filar, V. Borkar, 2013, J. Glob. Optim..

Hamiltonian Cycle Problem and Markov Chains

V. Borkar, J. Filar, V. Ejov, 2012 .

Convergence analysis for an online recommendation system

Vivek S. Borkar, Anh Truong, Negar Kiyavash, 2011, IEEE Conference on Decision and Control and European Control Conference.

LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case

Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman, 2018, SIAM J. Control. Optim..

Linear Programming Formulation of Long-Run Average Optimal Control Problem

Vivek S. Borkar, Vladimir Gaitsgory, V. Borkar, 2018, J. Optim. Theory Appl..

Linear and Dynamic Programs for Risk-Sensitive Cost Minimization

Vivek S. Borkar, Ari Arapostathis, A. Arapostathis, 2021, 2021 60th IEEE Conference on Decision and Control (CDC).

A Structure-aware Online Learning Algorithm for Markov Decision Processes

Vivek S. Borkar, Prasanna Chaporkar, Abhay Karandikar, 2018, VALUETOOLS.

A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling

Vivek S. Borkar, Abhay Karandikar, Nitin Salodkar, 2010, IEEE Transactions on Mobile Computing.

A New Learning Algorithm for Optimal Stopping

Vivek S. Borkar, Tarun Prabhu, Jervis Pinto, 2009, Discret. Event Dyn. Syst..

Actor–Critic or Critic–Actor? A Tale of Two Time Scales

S. Bhatnagar, V. Borkar, Soumyajit Guin, 2022, IEEE Control Systems Letters.

Deep Reinforcement Learning for Web Crawling

V. Borkar, K. Patil, Konstantin Avrachenkov, 2021, 2021 Seventh Indian Control Conference (ICC).

Stochastic Control with Imperfect Models

Vivek S. Borkar, Arnab Basu, V. Borkar, 2008, SIAM J. Control. Optim..

Risk-sensitive control, single controller games and linear programming

V. Borkar, 2023, Journal of Dynamics and Games.

Controlled Markov Chains and Stochastic Networks

Vivek S. Borkar, V. Borkar, 1983 .

Adaptive control of Markov chains

Kevin McDonough, V. Borkar, P. Varaiya, 1979 .

Event-driven stochastic approximation

V. Borkar, Neeraja Sahasrabudhe, M. Ashok Vardhan, 2016 .

Feature Search in the Grassmanian in Online Reinforcement Learning

Vivek S. Borkar, Shalabh Bhatnagar, J. PrabuchandranK., 2013, IEEE Journal of Selected Topics in Signal Processing.

Optimal control of semilinear stochastic evolution equations

V. Borkar, T. Govindan, 1994 .

A New Distributed Time Synchronization Protocol for Multihop Wireless Networks

Vivek S. Borkar, Panganamala Ramana Kumar, Roberto Solis-Robles, 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

On the diffusion of messages in on-line social networks

Vivek S. Borkar, Aditya Karnik, Atul Saroop, 2013, Perform. Evaluation.

Epsilon-Approximation of Differential Inclusions

Pravin Varaiya, Vivek S. Borkar, Anuj Puri, 1996, Hybrid Systems.

A remark on the attainable distributions of controlled diffusions

V. Borkar, 1986 .

Stochastic differential games: Occupation measure based approach

M. K. Ghosh, V. Borkar, 1996 .

Existence of optimal controls for partially observed diffusions

V. Borkar, 1983 .