DSpace Repository

Restless Bandits, Linear Programming Relaxations and a Primal-Dual Heuristic

Show simple item record

dc.creator Bertsimas, Dimitris J.
dc.creator Nino-Mora, Jose
dc.date 2004-05-28T19:36:35Z
dc.date 2004-05-28T19:36:35Z
dc.date 1994-08
dc.date.accessioned 2013-10-09T02:39:23Z
dc.date.available 2013-10-09T02:39:23Z
dc.date.issued 2013-10-09
dc.identifier http://hdl.handle.net/1721.1/5378
dc.identifier.uri http://koha.mediu.edu.my:8181/xmlui/handle/1721
dc.description We propose a mathematical programming approach for the classical PSPACE - hard problem of n restless bandits in stochastic optimization. We introduce a series of n increasingly stronger linear programming relaxations, the last of which is exact and corresponds to the formulation of the problem as a Markov decision process that has exponential size, while other relaxations provide bounds and are efficiently solvable. We also propose a heuristic for solving the problem that naturally arises from the first of these relaxations and uses indices that are computed through optimal dual variables from the first relaxation. In this way we propose a policy and a suboptimality guarantee. We report computational results that suggest that the value of the proposed heuristic policy is extremely close to the optimal value. Moreover, the second order relaxation provides strong bounds for the optimal solution value.
dc.format 1668352 bytes
dc.format application/pdf
dc.language en_US
dc.publisher Massachusetts Institute of Technology, Operations Research Center
dc.relation Operations Research Center Working Paper;OR 298-94
dc.title Restless Bandits, Linear Programming Relaxations and a Primal-Dual Heuristic
dc.type Working Paper


Files in this item

Files Size Format View

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record

Search DSpace


Advanced Search

Browse

My Account