On Bayesian Learning from Bernoulli Observations