A practical and example filled tour of simple and multiple regression techniques (linear, logistic, and Cox PH) for estimation, adjustment and prediction.

Loading...

From the course by Johns Hopkins University

Statistical Reasoning for Public Health 2: Regression Methods

66 ratings

A practical and example filled tour of simple and multiple regression techniques (linear, logistic, and Cox PH) for estimation, adjustment and prediction.

From the lesson

Module 3B: More Multiple Regression Methods

This set of lectures extends the techniques debuted in lecture set 3 to allow for multiple predictors of a time-to-event outcome using a single, multivariable regression model.

- John McGready, PhD, MSAssociate Scientist, Biostatistics

Bloomberg School of Public Health

So in this section we'll give some examples of the use of interaction terms

and their presentation with the results stemming from them,

from published research.

And so this will give you exposure to several examples of the use of

interaction terms in research, in pu, and hence, in published analyses.

So the first one we're going to look at it is from the Journal of

American Medical Association or

JAMA' s Pediatrics journal and it's looking at maternal depression and

post-traumatic stress disorder as a predictor for child maltreatment.

So they lay this out in the abstract.

They give the importance here saying maternal post-traumatic stress disorder or

PTSD may be associated with increased risks for child maltreatment and

child exposure to traumatic events.

Exposure to multiple traumatic events is associated with

a wide range of adverse health and social outcomes in children.

So the objective of their study as stated is to examine the association of probable

maternal depression, PTSD, and PTSD and depression comorbid with the risk for

child maltreatment and parenting stress and with the number of traumatic expense,

events to which preschool children are exposed.

And they used a cross-sectional observational study design.

And they talk about using analysis variance to compare means on

certain scales measuring child maltreatment, parenting stress, and

children's exposure to traumatic events between groups defined by the presence or

absence of either PTSD, depression, both or neither.

And then they go on to talk about what we'll focus on.

They say hierarchical regression, which they're using as a synonym for

multiple regression.

Analyses were used to examine the unique and interactive effects of depression and

PTSD severity scores on these outcomes.

So what they're measuring here both is their outcome and

their predictors are based on scale.

So let's talk about how they measure PTSD and depression to start,

to get a context for what this predictor looks like.

So mother's exposure to traumatic events, PTSD symptoms and impairment were

assessed using the 49-item Posttraumatic Stress Diagnostic Scale, the PDS.

This PDS assesses exposure to traumatic events, including serious accidents,

natural disasters, non-sexual or sexual assault by a stranger or

family member, military combat or exposure to war, imprisonment, torture,

life threatening events and a category of other.

And this PDS scale parallels the Diagnostic and

Statistical Manual of Mental Disorders, diagnostic criteria for PTSD.

So these big, 49 item scale that the mothers answered questions to and

the sum of the responses that are scored for each of the items is created higher

scores on this PDS scale, indicate higher levels of PTSD.

Then they talk about how they measured maternal depression.

And maternal depressive symptoms were

assessed using the Edinburgh Postnatal Depression Scale.

The Edinburgh Postnatal Depression Scale's a 10-item scale assessing depressive,

depressive symptoms in the past week.

Items are rated on the scale from zero to three.

So each of the ten items is rated from zero to three.

A total score is computed by summing the items so

theoretically the total score for any one person could range from zero to thirty.

And then they talk about using a cutoff score of thirteen or more.

The Edinburgh Postnatal Depression Scale has demonstrated good psychometric

properties among non postnatal women relative to clinical diagnosis so

this scale is measured on a continuum, but it can be used and

dichotomized with a cutoff of 13 or more, meaning depression versus not.

So let's go on to talk about how they perform the analyses of the regressions

they referenced in the abstract, and we'll focus on one such set of results.

So I'm pulling excerpts from their methods and statistical analyses section to

put together how they're handling the regressions here.

They say subsenantly, subsequently we conducted

hierarchical multiple regression, or just multiple regression,

to examine the relationship of continuous scores reflecting the severity of PTSD and

depressive symptoms and their potential interaction with child maltreatment,

child exposure to traumatic events, and parital, parental stress.

In the first step of each model for each of these outcomes, child maltreatment,

exposure to traumatic events, and parental stress, they entered PTSD and

depression severity scores on the continuous scale as predictors.

In the second step they added the interaction between PTSD and

depression severity as a predictor.

And they talk about how they got the interaction terms.

The interaction terms were created by multiplying center predictors, and

I'll talk about that briefly to address potential problems with multi-colinearity.

What they did is instead of taking the these were both measured on on

a continuum instead of measuring multiplying the actual values,

they took each person's value and subtracted off the mean for everyone.

That really has no impact on how we interpret the results.

One thing that makes this analysis different than what we saw in

the previous sections is both variables that

are being multiplied here to create an interaction term are continuous.

So let's look at the results.

And I'm going to, so they give, for example, for

the outcome of psychological abuse, which is another scale in which

higher values are associated with higher levels of the child re,

being on the receiving end of psychological abuse from the mother.

Their first model related the average value of psychological abuse,

to the predictor's of depression, the depression scale and PTSD.

And this gives the slopes and their standard errors, and we can see that

they're both statistically significant if you created confidence intervals.

And it says, taken together each, on it's own, not, with no interaction,

the R squared value, these depression, maternal depression and PTS scales

explained roughly 20% of the variability in the child's psychological abuse scores.

This model over here which we're going to look at in more detail extends that

previous model to include any interaction term between the depression and

post-traumatic stress disorder scales.

You see when we include the interaction term the R squared increases to 0.28.

And you can also see this interaction term is statistically significant.

If you create a confidence interval for what, for it, it does not include zero.

If you take the estimate and divide it by its standard error,

it's less than negative two and would result in a P value of less than 0.05.

The other thing they did, this is common, it's not so common in the standard public

health and medical literature when we're measuring things where the individual

values are interpretable like blood pressures, cholesterol levels, et cetera.

But these scales are on a continuum, and their individual values are hard

to interpret but we do know that with regards to the scale, higher values mean

higher levels of the construct they're measuring, either depression or PTSD.

So sometimes, researchers especially in psychology and social sciences,

will also convert the slopes that measure the change and the outcome for

one unit difference in for example, the depression scale adjusted for PTSD.

They'll also present a version of the slope that where the unit is

a standard deviation in depression scores.

And these are called standardized coefficients.

So the depression score may range from zero to 30 for example and

what they are measuring here is the change in the psychological abuse

outcome score per one unit increase in depression score, adjusted for PTSD.

What they're quantifying here is per one standard deviation of

the depression scores, whatever that standard deviation is.

So it's just presenting it in different units.

But we're going to focus on the standard units presented here.

So let's look at what the model looks like in my representation,

I'm just writing this out.

They didn't give the intercepts, so I'm just going to keep that as a generic

beta-naught, and then the slope for the main term for the depression scale,

which I'll call x1, was 0.15, for the PTSD scale was 0.26, and

then X3 here is the interaction term which is simply performed by multiplying the X1,

the depression scale score times X2, the PTSD scale score.

Let's look at what this means, we haven't seen an example where both

things that were interacting are continuous and

it's not commonly done, in fact they pull back we'll see and change things up into,

in, into how they finally ultimately present the message from this analysis.

But what this means is that let's for example,

isolate the relationship between psychological abuse score and

depression after adjusting for PTSD for various levels of PTSD.

So this model, in that direction,

suggests with the interaction term that the relationship between the outcome and

the depression score is going to depend on what the PTSD score is for a group.

So for example, if we're looking at individuals who are mothers,

with a low PTSD score, relatively speaking, of three, then the estimated

association between the outcome and depression, which is x1, looks like this.

We have the .15 times x1 here and then we get another occurrence of x1.

Remember x1, x3 the interaction term is equal to X1 times X2.

X2 is PTSD so that's equal to three.

And we get another occurrence of X1.

So if we factored this out in terms of the pieces that come with X1,

we'd get 0.15 plus negative 0.02 times 3,

all taken together would be our slope for depression score.

Or this would be 0.09 for the group of mothers with PTSD scores of 3.

If we look at mothers whose PTSD score was 4,

the results would be similar but slightly different.

We'd have this part for depression score plus its appearance here again.

But we've been multiplying it by 4 because x2 the PTSD score is 4.

So when you do the parsing here, the end result of the slope when all the dust

settles for x1 is 0.15, the original part, plus the piece because the interaction of

negative .02 times 4, all times x1.

And with a little math that is equal to .07x1.

And then if we wumped up to the group with the PTSD score of 10,

well when all the dust settles, and I'll let you verify,

we get .15 plus negative 0.20 times x1 and

the slope now is negative for depression.

So what we are showing here is that the relationship or

the estimated association between psychological abuse scores and

depression is different for every different PTSD score.

Well what's the big picture there?

As PTSD scores increase, the association between psychological abuse scores and

depression decreased.

So ultimately and thankfully, because I find the results of that regression

a little bit difficult to interpret, both because the scales only have relative

meaning in terms of higher values meaning higher depression or PTSD and having

an interaction, having an association for example, between the outcome and

depression that changes for every level of PTSD is kind of hard to make sense of.

So they represent this where they ultimately dichotomize both depression and

PTSD at some cutoff for high or low.

And what they show here which I think better illustrates what's going on is

the relationship between the psychological abuse score means in children

amongst mothers with low versus high depression separately for

the low PTSD groups and the high.

And so what we see here is if we look at the low-PTSD group,

the average psychological abuse score for children, for

mothers with low PTSD and low depression's negative 0.3, and for

mothers with low PTSD but with high depression is 3.57.

So a notable increase in the mean on that scale.

This slope here they're reporting, whereas in the units of the original scales we

would report it as the difference, 3.57 minus negative 0.3 or,

I'll call it beta is equal to, so all together this would

equal 3.87 on the original psychological abuse score scale.

What that means is that children of mothers with high depression versus low

pre children of mothers with low depression have average psychological

abuse scores of 3.87 units greater in the group of mothers with low PTSD.

What they're showing here this beta, is this thing standardized in terms

of the number of standard deviations in the psychological abuse scale.

So a narrow representation high depression is

associated with a half standard deviation increase on average in

the psychological abuse scores amongst mothers with low PTSD.

And they star this, I actually covered it with my ink here,

they star this which they say is they give a super descriptive name.

This, this slope is significant.

Higher maternal depression is statistically significantly associated

with higher average psychological abuse in children for mothers with low PTSD.

For the group with high PTSD, there's an actual downward shift in the average

psychological abuse score when going to high depression, looking at mothers with

high depression compared to low depression amongst those with high PTSD.

>> And this result is not significant, so this is just another way of

them saying that in low PTSD groups depression is positively and

statistically si, significantly associated with psychological abuse score for

the child where it's negatively and not statistically significantly associated

with the psychological abuse score for children born to mothers with high PTSD.

So just they, they actually write this up here but

describing what they say here, just repackaging what I said.

Figure one shows that when severity of maternal PTSD symptoms was high,

the risk for child's psychological abuse was consistently high regardless of

depression severity.

However, when the severity of maternal PTSD symptoms was low,

greater depression severity was associated with an increased risk for

child psychological abuse, or an increased score on that scale.

So, anyway, this is just one example of the use of interaction terms.

And they actually presented the results with the interaction term intact,

that doesn't always happen but

I do like the graphics they presented ultimately to summarize this.

I think that made it clearer than the original results reported from

the regression model.

Let's look at another example from the Journal of Nutrition.

This is second-hand smoke and fiber consumption.

And they do a nice job laying of laying this all out in the extract, so

I'll just read that to you.

They say either objective was the second hand smoke, SHS so ex, exposure increases

the risk for Coronary Heart Disease, by an estimated 25% to 30% via oxidative stress

and inflammatory mechanisms that may be ameliorated by dietary components.

The aim of this study was to evaluate the hypothesis my, modifying role of

nutrients, with known antioxidant and, or anti-inflammatory properties on

the relationship between secondhand smoke exposure and CHD mortality.

So they had detailed secondhand smoke exposure and

dietary information from nearly 30,000 non-smokers in

the Singapore-Chinese health study, a perspective population-based cohort.

The evaluation of whether or not dietary factors, and they list some here,

modify the relationship between SHS exposure and CHD mortality was conducted

within multi-variable Cox proportional hazard models by creating an interaction

term between the potential dietary effect modifier which were broken into quartiles.

And then they dicotomized as those being in the lowest quartile of intake versus

the second through fourth quartiles of intake an interaction with this and

the SHS exposure variable none versus living with at least one smoker.

And the results, and this says it all.

Evidence for a main effects association between SHS exposure and

risk for CHD mortality was not observed.

In a stratified analysis by levels of selected dietary nutrient intake,

fiber modified the effects of SHS exposure on risk for CHD mortality.

And then they result the P value for their interaction term from that Cox Model .02,

that there was a statistically significant difference in the association between

CHD mortality and second hand smoke exposure by fiber intake level.

The adjusted hazards ratio for SHS exposure and

CHD mortality was 1.62 with a 95% confidence interval that just

squeaks in as significant, goes from 1 to 2.63, for those with low fiber intake.

In contrast, among those with high fiber intake there was no association with SHS,

HS exposure.

So the confidence interval starts at 1 goes up to 2.63, and

certainly the estimated hazard ratio showed a substantial increase,

at least among those in the sample, so

they're saying there might be some evidence of association here, but there

was nothing, no association, no indication in the group with high fiber intake.

So what they're saying here is, in their conclusion, we provide ind,

evidence that a diet high in fiber may ameliorate the harmful effects of

SHS exposure on risk for CHD mortality.

And so, they did that, file the use of an interaction term in their Cox model.

So another study we've looked at before.

Now, we'll just bring it in the context to the interaction terms.

This is the Association of Race and

Age With Survival Among Patients Undergoing Dialysis.

And just to remind you of this,

the context of this says many studies have reported that black

individuals undergoing dialysis survive longer than those who are white.

This observation is paradoxical given racial disparities in access to and

quality to care, and it is inconsistent with observed lower survival among bl,

black patients with chronic kidney disease.

We hypothesize that age and the competing risk of transplantation, but

we're going to focus on age, modifies survival difference by race.

So this was the results from the United States Renal Data System,

an observational core study of over a million incidence end-stage renal disease

patients between 1995 and 2009.

And they say, multivariate age stratified Cox proportional hazard models were

constructed to examine death in those who received dialysis.

And we'll see what they mean by that,

is they include an interaction term with age and race.

And then they go on to report, and we'll just I'll let you, you've read

this before, but it's just here they report the results of mortality and

race separately for different age groups,

because what they found was that there was some age modified association and

their conclusions say overall among dialysis patients in the US, there was

a lower risk of death for black patients compared with their white counterparts.

That's when they looked at everyone together and came up with one

overall association for black versus white adjusted for a bunch of other factors.

However, when they actually investigated effect modification by age,

they found that commonly, survi, a side of survival advantage for

black dialysis patients applies only to older adults, and

those younger than 50 years have a higher risk of death than white patients.

So let me just show you we've looked at this before but what they did in the,

to start, they, they talk about using Cox proportional hazards regression, and they

started with getting one overall adjusted estimate between race and mortality by

adjusting for a bunch of factors, age, sex, insurance type, et cetera.

But then they ultimately go on to talk about how they looked at

age as an effect modifier, and they talk about using Cox proportional

hazards regression model adjusted for those, that previous long list of factors.

And then they said to confirm whether differences between the age groups were

statistically signficant, and what they're implying here with the rest of

the text is, to confirm whether the relationship between mortality and

race was different by age an additional model

was built on top of the one they were previously referring to

that included interaction terms for each age category and black race.

I'm just going to show you, this is quite an endeavor on their part.

It's actually, if you had the time to parse this, you would be able to do it,

but it looks a little daunting at first.

They had seven different age groups that they categorize their sampling to, and

they're all listed here.

And then, the, what they had to do since they had seven different age groups,

in order to include race and age to start, even if they weren't including

interaction, is they had, I'll call this our race variable, which is a one if

black and a zero if white, and they had six indicators for the age groups.

They had seven age groups, and the first one they used is the reference, and

then they had an indicator for each of the remaining six.

And then they had to create an interaction term between the race

variable and each of these six indicators, so there were six interaction terms

with race and age in this model, and this ultimately would allow them to estimate

seven different age specific associations between mortality and race.

But this model is even more complicated because they had a bunch of other x's and

betas that I'm not showing here for all the other things they adjusted for.

But I like what they did.

They ultimately presented the results graphically.

And we're going to look at the Cox model here.

There's another model they used which gives similar results.

But what they report here is the estimated hazard ratios and

mortality for black versus white patients in each of the age group.

And these were constructed using combinations of the log hazard ratio for

black to white plus the appropriate interaction piece for

each of the age groups.

And then the results being exponentiated.

And they show that these are all adjusted for

a bunch of other factors, they may differ between the race groups as well.

But they show that in the younger ages, for

example, 18 to 30, the relative hazard of mortality for

blacks to whites is greater than one on the order of close to 1.4.

And it's statistically significant because the confidence interval doesn't in,

cross one.

It attenuates a bit but it's still sta, statistically significantly higher for

blacks compared to whites in the 31 to 40 age group.

And then with subsequent age groups,

the risk is statistically significantly lower for blacks compared to whites.

And that's a nice way of presenting the results from that interaction model as

opposed to showing the entire model with the slopes or even and such

leaving not only to have to put things together and add but also exponentiate.

Many articles will mention that the researchers investigated the interaction,

even if no interactions were found or reported.

So just for one example of this we'll go back to our gender differences in

the salary of physician researchers.

Researchers ultimately reported one overall mean difference between males and

females adjusted for a bunch of other things.

They said as long as these other things were equivalent, academic ranks,

specialty, et cetera, between the males and females being compared, the average

estimated salary difference was the same, regardless of the values of these things.

So they did not report anything about interaction or

effect modification of the relationship between salary and

gender by other factors in their abstract, or in their final results.

But they did mention in their methods section, that hey explore pair

wise interactions between gender and the other characteristics.

So ostensibly they looked at whether the relationship between wages and

gender was modified by specialty type.

And then they looked at whether it was modified by marital status.

And then they looked at whether it was modified by years and rank etc.

And they likely did this through fitting a series of regression models, in this case

linear, with interaction terms for gender and each of those things one at a time.

All right, well hopefully this was

a nice little introduction to the use of interaction terms in the literature, and

hopefully it helps solidify some of the ideas we've laid out in this lecture unit.

Coursera provides universal access to the world’s best education,
partnering with top universities and organizations to offer courses online.