Do you have a moment? Bayesian inference using estimating equations via empirical likelihood
Date: 22 October 2021, Friday
Time: 4pm AEDT
Speaker: Prof Howard Bondell (University of Melbourne)
Abstract:
Bayesian inference typically relies on specification of a likelihood as a key ingredient. Recently, likelihood-free approaches have become popular to avoid specification of potentially intractable likelihoods. Alternatively, in the Frequentist context, estimating equations are a popular choice for inference corresponding to an assumption on a set of moments (or expectations) of the underlying distribution, rather than its exact form. Common examples are in the use of generalised estimating equations for marginal estimation of correlated responses, or in the use of M-estimators for robust regression avoiding the distributional assumptions on the errors. In this talk, I will discuss some of the motivation behind empirical likelihood, and how it can be used to incorporate a fully Bayesian analysis into these settings where only specification of moments is desired. This allows one to then take advantage of prior distributions that have been developed to accomplish various shrinkage tasks, both theoretically and in practice. I will further discuss computational issues that arise, particularly due to non-convexity of the support of this likelihood and the corresponding posterior, and show how this can be rectified to allow for MCMC and variational approaches to perform posterior inference.
Link: https://au.bbcollab.com/guest/fcf219c74ac743e89565a9e6e8d349a9
Time: 4pm AEDT
Speaker: Prof Howard Bondell (University of Melbourne)
Abstract:
Bayesian inference typically relies on specification of a likelihood as a key ingredient. Recently, likelihood-free approaches have become popular to avoid specification of potentially intractable likelihoods. Alternatively, in the Frequentist context, estimating equations are a popular choice for inference corresponding to an assumption on a set of moments (or expectations) of the underlying distribution, rather than its exact form. Common examples are in the use of generalised estimating equations for marginal estimation of correlated responses, or in the use of M-estimators for robust regression avoiding the distributional assumptions on the errors. In this talk, I will discuss some of the motivation behind empirical likelihood, and how it can be used to incorporate a fully Bayesian analysis into these settings where only specification of moments is desired. This allows one to then take advantage of prior distributions that have been developed to accomplish various shrinkage tasks, both theoretically and in practice. I will further discuss computational issues that arise, particularly due to non-convexity of the support of this likelihood and the corresponding posterior, and show how this can be rectified to allow for MCMC and variational approaches to perform posterior inference.
Link: https://au.bbcollab.com/guest/fcf219c74ac743e89565a9e6e8d349a9
Video: