An approximate dynamic programming algorithm for short-term electric vehicle fleet operation under uncertainty
Research output: Contribution to journal › Journal article › Research › peer-review
Standard
An approximate dynamic programming algorithm for short-term electric vehicle fleet operation under uncertainty. / Lee, Sangmin; Boomsma, Trine Krogh.
In: Applied Energy, Vol. 325, 119793, 2022.Research output: Contribution to journal › Journal article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - An approximate dynamic programming algorithm for short-term electric vehicle fleet operation under uncertainty
AU - Lee, Sangmin
AU - Boomsma, Trine Krogh
N1 - Publisher Copyright: © 2022 Elsevier Ltd
PY - 2022
Y1 - 2022
N2 - This paper considers the dynamic problem of optimally operating a fleet of plug-in hybrid electric vehicles in a market environment. With uncertainty in future electricity prices and driving demands, we formulate a Markov decision process and determine a cost-minimizing policy for using the engine and charging and discharging the battery. As such, the policy is based on the trade-off between the costs of gasoline and electricity and between current and future power prices. To accommodate an inhomogeneous fleet composition and overcome the computational challenges of stochastic and dynamic optimization, including large-scale state and action spaces, we adopt the methodology of approximate dynamic programming. More specifically, using simulation and value function approximation by linear regression, we apply a least squares Monte Carlo method. This methodology allows for scaling with respect to fleet size and we are able to establish convergence of our algorithm for 100 vehicles by using 5000 samples in the simulation. Our results show that the vehicles should generally discharge the battery rather than using the engine unless battery capacity is insufficient to fully cover driving demand, but the timing of battery charging should be according to power prices. When comparing our policy to the simple policy of immediate charging, we demonstrate superiority for small and medium-sized fleets, with 2%–4% cost differences.
AB - This paper considers the dynamic problem of optimally operating a fleet of plug-in hybrid electric vehicles in a market environment. With uncertainty in future electricity prices and driving demands, we formulate a Markov decision process and determine a cost-minimizing policy for using the engine and charging and discharging the battery. As such, the policy is based on the trade-off between the costs of gasoline and electricity and between current and future power prices. To accommodate an inhomogeneous fleet composition and overcome the computational challenges of stochastic and dynamic optimization, including large-scale state and action spaces, we adopt the methodology of approximate dynamic programming. More specifically, using simulation and value function approximation by linear regression, we apply a least squares Monte Carlo method. This methodology allows for scaling with respect to fleet size and we are able to establish convergence of our algorithm for 100 vehicles by using 5000 samples in the simulation. Our results show that the vehicles should generally discharge the battery rather than using the engine unless battery capacity is insufficient to fully cover driving demand, but the timing of battery charging should be according to power prices. When comparing our policy to the simple policy of immediate charging, we demonstrate superiority for small and medium-sized fleets, with 2%–4% cost differences.
KW - Approximate dynamic programming
KW - Least squares Monte Carlo
KW - Plug-in hybrid vehicles
U2 - 10.1016/j.apenergy.2022.119793
DO - 10.1016/j.apenergy.2022.119793
M3 - Journal article
AN - SCOPUS:85136164252
VL - 325
JO - Applied Energy
JF - Applied Energy
SN - 0306-2619
M1 - 119793
ER -
ID: 318532949