Total positivity in exponential families with application to binary variables

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Dokumenter

  • AOS2007

    Forlagets udgivne version, 330 KB, PDF-dokument

We study exponential families of distributions that are multivariate totally
positive of order 2 (MTP2), show that these are convex exponential families
and derive conditions for existence of the MLE. Quadratic exponential
familes of MTP2 distributions contain attractive Gaussian graphical models
and ferromagnetic Ising models as special examples. We show that these are
defined by intersecting the space of canonical parameters with a polyhedral
cone whose faces correspond to conditional independence relations. Hence
MTP2 serves as an implicit regularizer for quadratic exponential families
and leads to sparsity in the estimated graphical model. We prove that the
maximum likelihood estimator (MLE) in an MTP2 binary exponential family
exists if and only if both of the sign patterns (1,−1) and (−1, 1) are represented
in the sample for every pair of variables; in particular, this implies that
the MLE may exist with n = d observations, in stark contrast to unrestricted
binary exponential families where 2d observations are required. Finally, we
provide a novel and globally convergent algorithm for computing the MLE
for MTP2 Ising models similar to iterative proportional scaling and apply it
to the analysis of data from two psychological disorders.
OriginalsprogEngelsk
TidsskriftAnnals of Statistics
Vol/bind49
Sider (fra-til)1436-1459
ISSN0090-5364
DOI
StatusUdgivet - 2021

Antal downloads er baseret på statistik fra Google Scholar og www.ku.dk


Ingen data tilgængelig

ID: 274173810