TY - JOUR

T1 - Comparing responses in repeated cross-sectional and panel studies

T2 - Results across eight weeks during the first COVID-19 lockdown in Denmark

AU - Zettler, Ingo

AU - Lilleholt, Lau

AU - Böhm, Robert

AU - Gondan, Matthias

PY - 2021/8/1

Y1 - 2021/8/1

N2 - It is often important to study people's thoughts, feelings, and behaviors over time. To this end, researchers have relied on repeated cross-sectional (RCS) studies, in which different people from the same population participate on different measurement occasions. Also, researchers have relied on panel studies, in which the same group of people participate on different measurement occasions. However, few studies have directly tested whether participants' responses in RCS studies were similar to those found in panel studies. To address this gap, we compared the responses to 33 items, 28 of which were further grouped into four aggregates (Affections, Worries, States, Health concerns), over 8 weeks during the first COVID-19 lockdown in Denmark in a RCS study (overall N = 5,993, per measurement occasion 616 ≤ n ≤ 964) with the responses in a largely equivalent panel study (993 ≤ n ≤ 2,546 across measurement occasions). The study participants were randomly drawn from the same quota-representative participant pool and responded to the same items on the same measurement occasions. Results indicated a few differences between the study samples on the first measurement occasion (i.e., selection effects between studies). Further, we found statistical support for different trajectories in 21 aggregates/items. However, visual inspection of the trajectories suggested subtle differences between the studies at large. The results thus raise awareness that the trajectories of people's thoughts, feelings, and behaviors can differ between survey methods, especially when only a few measurement occasions are considered. Nevertheless, such differences might not be substantial over time.

AB - It is often important to study people's thoughts, feelings, and behaviors over time. To this end, researchers have relied on repeated cross-sectional (RCS) studies, in which different people from the same population participate on different measurement occasions. Also, researchers have relied on panel studies, in which the same group of people participate on different measurement occasions. However, few studies have directly tested whether participants' responses in RCS studies were similar to those found in panel studies. To address this gap, we compared the responses to 33 items, 28 of which were further grouped into four aggregates (Affections, Worries, States, Health concerns), over 8 weeks during the first COVID-19 lockdown in Denmark in a RCS study (overall N = 5,993, per measurement occasion 616 ≤ n ≤ 964) with the responses in a largely equivalent panel study (993 ≤ n ≤ 2,546 across measurement occasions). The study participants were randomly drawn from the same quota-representative participant pool and responded to the same items on the same measurement occasions. Results indicated a few differences between the study samples on the first measurement occasion (i.e., selection effects between studies). Further, we found statistical support for different trajectories in 21 aggregates/items. However, visual inspection of the trajectories suggested subtle differences between the studies at large. The results thus raise awareness that the trajectories of people's thoughts, feelings, and behaviors can differ between survey methods, especially when only a few measurement occasions are considered. Nevertheless, such differences might not be substantial over time.

KW - Faculty of Social Sciences

KW - repeated cross-sectional

KW - panel

KW - cohort

KW - change

KW - COVID-19

UR - http://www.scopus.com/inward/record.url?scp=85114069548&partnerID=8YFLogxK

U2 - 10.1037/pas0001048

DO - 10.1037/pas0001048

M3 - Journal article

C2 - 34323551

AN - SCOPUS:85114069548

VL - 33

SP - 691

EP - 704

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

IS - 8

ER -