Copula based factorization in bayesian multivariate infinite mixture models

Friday, 5 April 2013: 2:00 PM
Martin Burda, Ph.D. , Economics, University of Toronto, Toronto, ON, Canada
Artem Prokhorov, Ph.D. , Concordia University, Montreal, QC, Canada
Bayesian nonparametric models based on infinite mixtures of density kernels have been recently gaining in popularity due to their flexibility and feasibility of implementation even in complicated modeling scenarios. In economics, they have been particularly useful in estimating nonparametric distributions of latent variables. However, these models have been rarely applied in more than one dimension. Indeed, the multivariate case suffers from the curse of dimensionality, with a rapidly increasing number of parameters needed to jointly characterize each mixing component. In this paper, we propose a factorization scheme for nonparametric mixture models whereby each marginal dimension in the mixing parameter space is modeled as a separate infinite mixture and these marginal models are then joined by a nonparametric random copula function. Specifically, we consider univariate Guassian kernels for the marginals and a multivariate random Bernstein polynomial copula for the link function, under Dirichlet process priors. We show that this scheme helps alleviate the curse of dimensionality and leads to an improvement in the precision of a density estimate in finite samples, providing a viable tool for applications in higher dimensions. We derive weak posterior consistency of the copula-based mixing scheme for general kernel types under high-level conditions, and strong posterior consistency for the specific Bernstein-Gaussian model.