Learning vs earning trade-off with missing or censored observations: The two-armed Bayesian nonparametric beta-Stacy bandit problem

Stefano Peluso, Antonietta Mira, Pietro Muliere

Risultato della ricerca: Contributo in rivistaArticolo in rivista

1 Citazioni (Scopus)

Abstract

Existing Bayesian nonparametric methodologies for bandit problems focus on exact observations, leaving a gap in those bandit applications where censored observations are crucial. We address this gap by extending a Bayesian nonparametric two-armed bandit problem to right-censored data, where each arm is generated from a beta-Stacy process as defined by Walker and Muliere (1997). We first show some properties of the expected advantage of choosing one arm over the other, namely the monotonicity in the arm response and, limited to the case of continuous state space, the continuity in the right-censored arm response. We partially characterize optimal strategies by proving the existence of stay-with-a-winner and stay-witha-winner/switch-on-a-loser break-even points, under non-restrictive conditions that include the special cases of the simple homogeneous process and the Dirichlet process. Numerical estimations and simulations for a variety of discrete and continuous state space settings are presented to illustrate the performance and flexibility of our framework.
Lingua originaleEnglish
pagine (da-a)3368-3406
Numero di pagine39
RivistaElectronic Journal of Statistics
Volume11
DOI
Stato di pubblicazionePubblicato - 2017

Keywords

  • Bandit Problem
  • Bayesian Nonparametrics
  • Beta-Stacy Process

Fingerprint Entra nei temi di ricerca di 'Learning vs earning trade-off with missing or censored observations: The two-armed Bayesian nonparametric beta-Stacy bandit problem'. Insieme formano una fingerprint unica.

Cita questo