Subjects: Psychology >> Statistics in Psychology submitted time 2022-07-30
Abstract： Meta-analysis is a crucial tool for accumulating evidence in basic and applied research. In the open science era, meta-analysis becomes an important way for integrating open data from different sources. Meanwhile, because of the great researchers’ degree introduced by multiple-step and multiple-choices in each step of meta-analysis, the openness and transparency are crucial for reproducing results of meta-analysis. To (1) understand the transparency and openness of meta-analysis reports published in Chinese journals and (2) improve the transparency and openness of future meta-analysis by Chinese researchers, we developed a Chinese version of checklist for meta-analysis, which was based on the Preferred Reporting Items for Systematic Review and Meta-Analysis protocols (PRISMA) and the principle of openness and transparency, and then surveyed the methods and results of 68 meta-analysis papers in mainstream Chinese psychological journals in last five years. Our results revealed that openness and transparency of Chinese meta-analysis reports need to be improved, especially in the following aspects: the date/time and limitation of literature search, the details of screening and data collection, the flow chart of article screening, the details of effect size transformation, and the evaluation of individual research bias. The checklist we present, which lists almost all aspects that an open meta-analysis should include, can be used as a guide for future meta-analysis.
Subjects: Psychology >> Applied Psychology submitted time 2021-11-22
Abstract： Default–based nudge has been increasingly used in recent years to improve the public approval of social policies. However, its effectiveness has also been questioned by the public and some scholars. A meta-analysis was conducted to explore the effect of default options and the related variables that may affect its effectiveness. A total of 56 empirical research and 92 studies were included through literature retrieval. Results of the meta-analysis are as follows: (1) A considerable effect of default options was observed, (2) The moderating analysis of cultural background revealed that the nudging effect of default options under Western culture was better than that under Eastern culture, and (3) Lastly, the moderating analysis showed a significant difference of default effect between different domains and that the nudging effect of default options was greater in the money–related domain than in the health and environmental domains.
Peer Review Status:
Awaiting Review
Subjects: Psychology >> Statistics in Psychology submitted time 2021-04-25
Abstract： 在心理学研究中，以下两种情况下研究者可能需要对零效应进行评估：第一，推断某种效应不存在；第二，意外出现不显著结果，需要区分到底是效应不存在还是当前数据未能提供足够的证据。然而，常用的原假设显著性检验（Null hypothesis significance test, NHST）无法直接评估零效应。近年来，等价检验、贝叶斯估计和贝叶斯因子三种方法逐渐被用于评估零效应：在频率统计框架下，等价检验通过检验效应是否在最小感兴趣区内（Smallest effect size of interest, SESOI），通过p值来推断效应是否为零；在贝叶斯统计框架下，贝叶斯估计通过对比后验分布的最高密度区间和实际等价区的重叠情况，推断效应是否为零；而贝叶斯因子则是通过评估当前数据对原假设和备择假设的相对支持程度，推断当前数据对原假设的相对支持程度。文章通过分析两个真实的数据，展示三种方法的实际应用。三种方法各有其特点：等价检验在逻辑上是对NHST的拓展，易于从传统统计中延伸使用；贝叶斯因子的解读较符合直觉，逻辑上清晰；贝叶斯估计则具有较强的灵活性，可拓展于更多的研究问题。以上三种评估零效应的方法，可能能够帮助心理学研究者在实际研究中进行合理的统计推断和研究决策。
Peer Review Status:Awaiting Review
Subjects: Psychology >> Statistics in Psychology submitted time 2020-10-17
Abstract： P-value is the most widely used statistical index for inference in science. Unfortunately, researchers in psychological science may not be able to interpret p-value correctly, resulting in possible mistakes in statistical inference. Our specific goal was to estimate how nonsignificant results were interpreted in the empirical studies published in Chinese Journals. Frist, We randomly selected 500 empirical research papers published in 2017 and 2018 in five Chinese prominent journals (Acta Psychological Sinica, Psychological Science, Chinese Journal of Clinical Psychology, Psychological Development and Education, Psychological and Behavioral Studies). Secondly, we screened the abstracts of the selected articles and judged whether they contained negative statements. Thirdly, we categorized each negative statement into 4 categories (Correct-frequentist, Incorrect-frequentist: whole population, Incorrect-frequentist: current sample, Difficult to judge). Finally, we calculated Bayes factors based on the t values and sample size associated with the nonsignificant results to investigate whether empirical data provide enough evidence in favor of null hypothesis. Our survey revealed that: (1) 36% of these abstracts (n = 180) mentioned nonsignificant results; (2) there were 236 negative statements in the article that referred to nonsignificant results in abstracts, and 41% negative statements misinterpreted nonsignificant results; (3) 5.1% (n = 2) nonsignificant results can provide strong evidence in favor of null hypothesis (BF01 > 10). The results suggest that Chinese researchers need to enhance their understanding of nonsignificant results and use more appropriate statistical methods to extract information from non-significant results.
Peer Review Status:Awaiting Review
Subjects: Psychology >> Applied Psychology submitted time 2020-06-18
Abstract： " Time preference for health is omnipresent and important at both individual and national levels. For a long time, research in this field has been limited to following inter-temporal choice models and methods in the traditional monetary domain of time preference studies. Given the domain-specificity of time preference in the health domain, these indiscriminately theoretical models led to inconsistent measures and results in the field. In the past few decades, researchers in this field have focused on the behavioral consequences of time preference for health. Most studies reported that lower temporal discount rates and higher future time perspectives are positively related to health protection behaviors and negatively related to health risk behaviors. Researchers also found that features of both decision-making objects and decision makers are key impact factors for time preference for health. Future studies should develop theoretical models and measurements that are more suitable to the time preferences for health domain, identify the relationship between healthy behaviors and time preference, and investigate the mechanism underlying the decision-making process. Future researchers should also explore interventions for health behaviors and their application to formulation of healthcare policies. " " "
Peer Review Status:Awaiting Review
Hits
YES
Hits
Downloads
Comment