Title
Index policies for demand response under uncertainty
Abstract
Uncertainty is an intrinsic aspect of demand response because electrical loads are subject to many random factors and their capabilities are often not directly measurable until they have been deployed. Demand response algorithms must therefore balance utilizing well-characterized, good loads and learning about poorly characterized but potentially good loads; this is a manifestation of the classical tradeoff between exploration and exploitation. We address this tradeoff in a restless bandit framework, a generalization of the well-known multi-armed bandit problem. The formulation yields index policies, in which loads are ranked by a scalar index and those with the highest are deployed. The policy is particularly appropriate for demand response because the indices have explicit analytical expressions that may be evaluated separately for each load, making them both simple and scalable. We numerically evaluate the performance of the index policy, and discuss implications of the policies in demand response.
Year
DOI
Venue
2013
10.1109/CDC.2013.6760879
Decision and Control
Keywords
Field
DocType
Markov processes,demand side management,load (electric),power system economics,demand response algorithms,electrical loads,explicit analytical expressions,index policies,multiarmed bandit problem,random factors,restless bandit framework,scalar index,time-invariant Markov process,uncertainty
Mathematical optimization,Markov process,Expression (mathematics),Ranking,Computer science,Measure (mathematics),Scalar (physics),Demand response,Instrumental and intrinsic value,Scalability
Conference
ISSN
ISBN
Citations 
0743-1546
978-1-4673-5714-2
2
PageRank 
References 
Authors
0.77
5
2
Name
Order
Citations
PageRank
Joshua A. Taylor1157.18
Johanna L. Mathieu212021.94