A comparison of optimization solvers for log binomial regression including conic programming

Florian Schwendinger, Bettina Grün, Kurt Hornik

Publication: Scientific journalJournal articlepeer-review

Abstract

Relative risks are estimated to assess associations and effects due to their ease of interpretability, e.g., in epidemiological studies. Fitting log-binomial regression models allows to use the estimated regression coefficients to directly infer the relative risks. The estimation of these models, however, is complicated because of the constraints which have to be imposed on the parameter space. In this paper we systematically compare different optimization algorithms to obtain the maximum likelihood estimates for the regression coefficients in log-binomial regression. We first establish under which conditions the maximum likelihood estimates are guaranteed to be finite and unique, which allows to identify and exclude problematic cases. In simulation studies using artificial data we compare the performance of different optimizers including solvers based on the augmented Lagrangian method, interior-point methods including a conic optimizer, majorize-minimize algorithms, iteratively reweighted least squares and expectation-maximization algorithm variants. We demonstrate that conic optimizers emerge as the preferred choice due to their reliability, lack of requirement to tune hyperparameters and speed.
Original languageEnglish
Pages (from-to)1721 - 1754
JournalComputational Statistics
Volume36
Issue number3
DOIs
Publication statusPublished - 2021

Austrian Classification of Fields of Science and Technology (ÖFOS)

  • 101015 Operations research
  • 101 not use (legacy)
  • 102022 Software development
  • 101018 Statistics
  • 101019 Stochastics
  • 502009 Corporate finance

Cite this