Gemignani Jessica, de la Cruz-Pavía Irene, Martinez Anna, Nallet Caroline, Pasquini Alessia, Lucarini Gaia, Cavicchiolo Francesca, Gervain Judit
University of Padua, Department of Developmental and Social Psychology, Padua, Italy.
University of Padua, Padova Neuroscience Center, Padua, Italy.
Neurophotonics. 2023 Apr;10(2):023518. doi: 10.1117/1.NPh.10.2.023518. Epub 2023 Mar 8.
Concerns about the reproducibility of experimental findings have recently emerged in many disciplines, from psychology to medicine and neuroscience. As NIRS is a relatively recent brain imaging technique, the question of reproducibility has not yet been systematically addressed.
The current study seeks to test the replicability of effects observed in NIRS experiments assessing young infants' rule-learning ability.
We conducted meta-analyses and mixed-effects modeling-based inferential statistics to determine whether effect sizes were replicable and comparable in a sample of 23 NIRS studies investigating infants' abilities to process repetition- and diversity-based regularities in linguistic and nonlinguistic auditory and visual sequences. Additionally, we tested whether effect sizes were modulated by different factors such as the age of participants or the laboratory. We obtained NIRS data from 12 published and 11 unpublished studies. The 23 studies involved a total of 487 infants, aged between 0 and 9 months, tested in four different countries (Canada, France, Italy, and USA).
Our most important finding is that study and laboratory were never significant moderators of variation in effect sizes, indicating that results replicated reliably across the different studies and labs included in the sample. We observed small-to-moderate effect sizes, similar to effect sizes found with other neuroimaging and behavioral techniques in the developmental literature. In line with existing findings, effect sizes were modulated by the participants' age and differed across the different regularities tested, with repetition-based regularities giving rise to the strongest effects; in particular, the overall magnitude of this effect in the left temporal region was 0.27 when analyzing the entire dataset.
Meta-analysis is a useful tool for assessing replicability and cross-study variability. Here, we have shown that infant NIRS studies in the language domain replicate robustly across various NIRS machines, testing sites, and developmental populations.
最近,从心理学到医学和神经科学等许多学科都出现了对实验结果可重复性的担忧。由于近红外光谱(NIRS)是一种相对较新的脑成像技术,可重复性问题尚未得到系统解决。
本研究旨在测试在评估幼儿规则学习能力的NIRS实验中观察到的效应的可重复性。
我们进行了荟萃分析和基于混合效应模型的推断统计,以确定在23项研究婴儿处理语言和非语言听觉及视觉序列中基于重复和多样性的规律能力的NIRS研究样本中,效应大小是否可重复且具有可比性。此外,我们测试了效应大小是否受不同因素(如参与者年龄或实验室)的调节。我们从12项已发表和11项未发表的研究中获取了NIRS数据。这23项研究共涉及487名年龄在0至9个月之间的婴儿,在四个不同国家(加拿大、法国、意大利和美国)进行了测试。
我们最重要的发现是,研究和实验室从未成为效应大小变化的显著调节因素,这表明在样本中纳入的不同研究和实验室中,结果能够可靠地重复。我们观察到小到中等的效应大小,与发育文献中其他神经成像和行为技术发现的效应大小相似。与现有研究结果一致,效应大小受参与者年龄的调节,并且在测试的不同规律之间存在差异,基于重复的规律产生的效应最强;特别是,在分析整个数据集时,左颞叶区域这种效应的总体大小为0.27。
荟萃分析是评估可重复性和跨研究变异性的有用工具。在此,我们表明语言领域的婴儿NIRS研究在各种NIRS机器、测试地点和发育人群中都能稳健地重复。