Subjects: Psychology >> Statistics in Psychology submitted time 2024-05-23
Abstract： Dyadic studies, in which two persons interacting with each other (called a dyad) are the fundamental unit of analysis, are widely used in psychological studies involving interpersonal phenomena. The integration of such studies with intensive longitudinal designs helps to further investigate the dynamics of both individual behaviors and interpersonal effects during the social interactions. However, there is a lack of appropriate statistical approaches that can adequately answer the dyadic research questions of interest based on the characteristics of intensive longitudinal data. Through simulation and empirical studies, this project will investigate the construction, extension, and applications of appropriate statistical models for intensive longitudinal data of different dyadic designs within the framework of Dynamic Structural Equation Modeling (DSEM).
Specifically, the research contents include: (1) constructing two actor-partner DSEMs with different detrending approaches and selecting the better model for intensive longitudinal data from the standard dyadic design; (2) developing an appropriate statistical model for the intensive longitudinal one-with-many data and extending it to more complex data with time trends; (3) developing an appropriate statistical model for the intensive longitudinal round-robin data and extending it to data with time trends; and (4) illustrating the application of the constructed or extended models under three intensive longitudinal dyadic designs. This project will advance the psychological research to gain a deeper and more scientific understanding of changes in individual behaviors and interpersonal effects in the context of social interactions.
Subjects: Psychology >> Social Psychology submitted time 2023-03-28 Cooperative journals: 《心理科学进展》
Abstract： Computer-based problem-solving tests can record respondents’ response processes when they explore tasks and solve problems as process data, which is richer in information than traditional outcome data and can be used to estimate latent abilities more accurately. The analysis of process data in problem solving tests consists of two main steps: feature extraction and process information modeling. There are two main approaches to extracting information from process data: top-down and bottom-up method. The top-down method refers to developing rubrics by experts to extract meaningful behavioral indicators from process data. This approach extracts behavioral indicators that are closely related to the conceptual framework, have interpretable and clear scores, and can be analyzed directly using psychometric models, as is the case with items in traditional tests. However, such indicator construction methods are laborious and may miss unknown and previously unnoticed student thought processes, resulting in a loss of information. In contrast, the bottom-up method refers to the use of data-driven approaches to extract information directly from response sequences, which can be divided into the following three categories according to their processing ideas: (1) methods that analogize response sequences to character strings and construct indicators by natural language processing techniques; (2) methods that use dimensionality reduction algorithms to construct low-dimensional numerical feature vectors of response sequences; and (3) methods that use directed graphs to characterize response sequences and use network indicators to describe response features. Such methods partially address the task specificity in establishing scoring rules by experts, and the extracted features can be used to explore the behavioral patterns characteristic of different groups, as well as to predict respondents’ future performance. However, such methods may also lose information, and the relationship between the obtained features and the measured psychological traits is unclear. After behavioral indicators have been extracted from process data, probabilistic models that model the relationship between the indicators and the latent abilities can be constructed to enable the estimation of abilities. Depending on whether the model makes use of sequential relationships between indicators and whether continuously interpretable estimates of latent abilities can be obtained, current modeling methods can be divided into the following three categories: traditional psychometric models and their extensions, stochastic process models, and measurement models that incorporate the idea of stochastic processes. Psychometric models focus on estimates of latent abilities but are limited by their assumption of local independence and cannot include sequential information between indicators in the analysis. The stochastic process model focuses on modeling the response process, retaining information about response paths, but with weaker assumptions between indicators and underlying structure, and is unable to obtain continuous and stable estimates of ability. Finally, psychometric models that incorporate the idea of stochastic processes combine the advantages of both taking the sequence of actions as the object of analysis and having experts specify indicator coefficients or scoring methods that are consistent with the direction of abilities, thus allowing continuous interpretable estimates of abilities to be obtained while using more complete process information. However, such modeling methods are mostly suitable for simple tasks with a limited set of actions thus far. There are several aspects where research on feature extraction and capability evaluation modeling of process data could be improved: (1) improving the interpretability of analysis results; (2) incorporating more information in feature extraction; (3) enabling capability evaluation modeling in more complex problem scenarios; (4) focusing on the practicality of the methods; and (5) integrating and drawing on analytical methods from different fields.
Subjects: Psychology >> Psychological Measurement submitted time 2021-12-04
Abstract： Computer-based problem-solving tests can record respondents’ response processes in real time as they explore tasks and solve problems and save them as process data. We first introduce the analysis process of process data and then present a detailed description of the new advances in feature extraction methods and capability evaluation modeling commonly used for process data analysis with respect to the problem-solving test. Future research should pay attention to improving the interpretability of analysis results, incorporating more information in feature extraction, enabling capability evaluation modeling in more complex problem scenarios, focusing on the practicality of the methods, and integrating and drawing on analytical methods from different fields.
Peer Review Status:
Awaiting Review
Hits
YES
Hits
Downloads
Comment