Back to Did the groups change differently?

Saved evidence · NLSS 2.0.1

Saved run 20260918T102559-cc7624fc62

The saved calculation record complements the authored report. It records the numerical work; it does not establish that a method or interpretation is appropriate. Original NLSS figure numbering is preserved.

Mixed Models: Tests of Fixed Effects

Analysis

  • Formula: outcome ~ time*group + (1|id)
  • Random effects: (1|id)
  • REML estimation: Yes
  • DF method: satterthwaite
  • Sum of squares type: III
  • Marginal means: time*group
  • Confidence level: 0.95
  • Optimizer: bobyqa
  • Optimizer maxfun: 100000
  • Diagnostics: Yes
  • Rounding digits: 2

Table 1

Tests of Fixed Effects

Effect Num df Den df F p
time 1.00 98.00 30.37 < .001
group 1.00 98.00 .02 = .884
time:group 1.00 98.00 24.31 < .001

Note. Type III tests of fixed effects. Method: lmerTest F Satterthwaite. Factor coding is preserved in the request; Type III hypotheses must be interpreted with that coding.



Mixed Models: Estimates of Fixed Effects

Analysis

  • Formula: outcome ~ time*group + (1|id)
  • Random effects: (1|id)
  • REML estimation: Yes
  • DF method: satterthwaite
  • Sum of squares type: III
  • Marginal means: time*group
  • Confidence level: 0.95
  • Optimizer: bobyqa
  • Optimizer maxfun: 100000
  • Diagnostics: Yes
  • Rounding digits: 2

Table 2

Fixed Effects Estimates

Effect Estimate Std. Error df t p CI lower CI upper
(Intercept) 52.51 1.47 124.42 35.79 < .001 49.60 55.41
timepre -.42 1.02 98.00 -.41 = .682 -2.44 1.60
grouptraining 3.84 2.07 124.42 1.85 = .067 -.27 7.95
timepre:grouptraining -7.11 1.44 98.00 -4.93 < .001 -9.97 -4.25

Note. Fixed effects are unstandardized (b) with standard errors. CI uses 95% confidence. df method: satterthwaite. Response: outcome [outcome]. Fit criterion: REML criterion (legacy deviance field). REML criteria must not be used to compare different fixed-effect designs. Degrees-of-freedom method: satterthwaite Confidence level used: 0.95 Random effects: (1|id). Model fit: AIC = 1416.92, BIC = 1436.71, logLik = -702.46. R²m = .06, R²c = .77. ICC = .76.

Narrative

timepre: b = -.42, SE = 1.02, t(98.00) = -.41, p = .682, CI [-2.44, 1.60].

grouptraining: b = 3.84, SE = 2.07, t(124.42) = 1.85, p = .067, CI [-.27, 7.95].

timepre:grouptraining: b = -7.11, SE = 1.44, t(98.00) = -4.93, p < .001, CI [-9.97, -4.25].



Mixed Models: Variance Components

Analysis

  • Formula: outcome ~ time*group + (1|id)
  • Random effects: (1|id)
  • REML estimation: Yes
  • DF method: satterthwaite
  • Sum of squares type: III
  • Marginal means: time*group
  • Confidence level: 0.95
  • Optimizer: bobyqa
  • Optimizer maxfun: 100000
  • Diagnostics: Yes
  • Rounding digits: 2

Table 3

Group Term Variance SD Correlation
id (Intercept) 81.61 9.03
Residual Residual 25.99 5.10

Narrative

Estimation: REML; 200 observations. Adjusted ICC = .76; unadjusted ICC = .71. R-squared and ICC use performance's model-based variance definitions, including random-slope contributions when present.


Mixed Models: Diagnostics

Analysis

  • Formula: outcome ~ time*group + (1|id)
  • Random effects: (1|id)
  • REML estimation: Yes
  • DF method: satterthwaite
  • Sum of squares type: III
  • Marginal means: time*group
  • Confidence level: 0.95
  • Optimizer: bobyqa
  • Optimizer maxfun: 100000
  • Diagnostics: Yes
  • Rounding digits: 2

Table 4

Diagnostic Status Statistic p Note
singular_fit FALSE
convergence ok
shapiro_wilk available .99 = .040 Conditional residual normality screen; does not test random-effect normality or independent residuals.

Narrative

Singularity and optimizer convergence are always reported; residual checks are enabled. Response: outcome [outcome]. Fit criterion: REML criterion (legacy deviance field). REML criteria must not be used to compare different fixed-effect designs. Degrees-of-freedom method: satterthwaite Confidence level used: 0.95


Mixed Models: Marginal Means

Analysis

  • Formula: outcome ~ time*group + (1|id)
  • Random effects: (1|id)
  • REML estimation: Yes
  • DF method: satterthwaite
  • Sum of squares type: III
  • Marginal means: time*group
  • Confidence level: 0.95
  • Optimizer: bobyqa
  • Optimizer maxfun: 100000
  • Diagnostics: Yes
  • Rounding digits: 2

Table 5

Estimated Marginal Means and Contrasts

Term Level EMM SE df t p CI low CI high Method
time*group time=post, group=control 52.51 1.47 124.42 35.79 < .001 49.60 55.41 emmeans
time*group time=pre, group=control 52.09 1.47 124.42 35.51 < .001 49.18 54.99 emmeans
time*group time=post, group=training 56.35 1.47 124.42 38.41 < .001 53.44 59.25 emmeans
time*group time=pre, group=training 48.82 1.47 124.42 33.28 < .001 45.91 51.72 emmeans

Note. CI uses 95% confidence.

Narrative

time=post, group=control: estimate = 52.51, SE = 1.47, t(124.42) = 35.79, p < .001, CI [49.60, 55.41].

time=pre, group=control: estimate = 52.09, SE = 1.47, t(124.42) = 35.51, p < .001, CI [49.18, 54.99].

time=post, group=training: estimate = 56.35, SE = 1.47, t(124.42) = 38.41, p < .001, CI [53.44, 59.25].

time=pre, group=training: estimate = 48.82, SE = 1.47, t(124.42) = 33.28, p < .001, CI [45.91, 51.72].