Browsing Computer Science and Automation (CSA) by Advisor "Bhatnagar, Shalabh"
Now showing items 114 of 14

Algorithms for Product Pricing and Energy Allocation in Energy Harvesting Sensor Networks
(20180509)In this thesis, we consider stochastic systems which arise in diﬀerent realworld application contexts. The ﬁrst problem we consider is based on product adoption and pricing. A monopolist selling a product has to appropriately ... 
Algorithms For Stochastic Games And Service Systems
(20140423)This thesis is organized into two parts, one for my main area of research in the field of stochastic games, and the other for my contributions in the area of service systems. We first provide an abstract for my work in ... 
Approximate Dynamic Programming and Reinforcement Learning  Algorithms, Analysis and an Application
(20180813)Problems involving optimal sequential making in uncertain dynamic systems arise in domains such as engineering, science and economics. Such problems can often be cast in the framework of Markov Decision Process (MDP). ... 
Feature Adaptation Algorithms for Reinforcement Learning with Applications to Wireless Sensor Networks And Road Traffic Control
(20170920)Many sequential decision making problems under uncertainty arising in engineering, science and economics are often modelled as Markov Decision Processes (MDPs). In the setting of MDPs, the goal is to and a state dependent ... 
A Nonlinear Stochastic Optimization Framework For RED
(20110923) 
On Generalized Measures Of Information With Maximum And Minimum Entropy Prescriptions
(20080129)KullbackLeibler relativeentropy or KLentropy of P with respect to R deﬁned as ∫xlnddPRdP , where P and R are probability measures on a measurable space (X, ), plays a basic role in the deﬁnitions of classical information ... 
Online Learning and Simulation Based Algorithms for Stochastic Optimization
(20180307)In many optimization problems, the relationship between the objective and parameters is not known. The objective function itself may be stochastic such as a longrun average over some random cost samples. In such cases ... 
Online Optimization Of RED Routers
(20110425) 
Optimization Algorithms for Deterministic, Stochastic and Reinforcement Learning Settings
(20180530)Optimization is a very important field with diverse applications in physical, social and biological sciences and in various areas of engineering. It appears widely in machine learning, information retrieval, regression, ... 
Resource Allocation for Sequential Decision Making Under Uncertainaty : Studies in Vehicular Traffic Control, Service Systems, Sensor Networks and Mechanism Design
(20171127)A fundamental question in a sequential decision making setting under uncertainty is “how to allocate resources amongst competing entities so as to maximize the rewards accumulated in the long run?”. The resources allocated ... 
Scalable Sprase Bayesian Nonparametric and Matrix Trifactorization Models for Text Mining Applications
(20180523)Hierarchical Bayesian Models and Matrix factorization methods provide an unsupervised way to learn latent components of data from the grouped or sequence data. For example, in document data, latent component cornresponds ... 
Simulation Based Algorithms For Markov Decision Process And Stochastic Optimization
(20100806)In Chapter 2, we propose several twotimescale simulationbased actorcritic algorithms for solution of infinite horizon Markov Decision Processes (MDPs) with finite statespace under the average cost criterion. On the ... 
Stochastic Approximation Algorithms with Setvalued Dynamics : Theory and Applications
(20180705)Stochastic approximation algorithms encompass a class of iterative schemes that converge to a sought value through a series of successive approximations. Such algorithms converge even when the observations are erroneous. ... 
Stochastic Newton Methods With Enhanced Hessian Estimation
(20180522)Optimization problems involving uncertainties are common in a variety of engineering disciplines such as transportation systems, manufacturing, communication networks, healthcare and finance. The large number of input ...