On the estimation of variance parameters in non-standard generalised linear mixed models: application to penalised smoothing Articles uri icon

publication date

  • May 2019

start page

  • 483

end page

  • 500

issue

  • 3

volume

  • 29

international standard serial number (ISSN)

  • 0960-3174

electronic international standard serial number (EISSN)

  • 1573-1375

abstract

  • We present a novel method for the estimation of variance parameters in generalised linear mixed models. The method has its roots in Harville (J Am Stat Assoc 72(358):320-338, 1977)'s work, but it is able to deal with models that have a precision matrix for the random effect vector that is linear in the inverse of the variance parameters (i.e., the precision parameters). We call the method SOP (separation of overlapping precision matrices). SOP is based on applying the method of successive approximations to easy-to-compute estimate updates of the variance parameters. These estimate updates have an appealing form: they are the ratio of a (weighted) sum of squares to a quantity related to effective degrees of freedom. We provide the sufficient and necessary conditions for these estimates to be strictly positive. An important application field of SOP is penalised regression estimation of models where multiple quadratic penalties act on the same regression coefficients. We discuss in detail two of those models: penalised splines for locally adaptive smoothness and for hierarchical curve data. Several data examples in these settings are presented.

keywords

  • generalised linear mixed models; generalised additive models; variance parameters; smoothing parameters; reml; effective degrees of freedomm; restricted maximum-likelihood; animal-models; selection; splines; components; penalties