Subjects: Psychology >> Developmental Psychology submitted time 2023-03-28 Cooperative journals: 《心理科学进展》
Abstract： The interaction between exogenous attention and multisensory integration is a complex and controversial topic, which has been debated for a long time. In order to explain the interaction mechanism between them, here we summarized two parts based on previous researches. First, exogenous attention can modulate multisensory integration in a bottom-up manner, including three hypotheses as spatial uncertainty, sensory sensitivity and the differences in unimodal signal strength. Second, multisensory integration can also modulate exogenous attention. On one hand, stimuli from multiple sense modalities can be automatically integrated in a bottom-up manner. The integrated multisensory events can capture attention more efficiently compared to unimodal events, even under quite complex circumstances. On the other hand, integrated multisensory events exert top-down control on attentional capture via multisensory signal templates that are stored in the brain.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Inhibition of return (IOR) has been greatly explored in the visual or auditory modality. Investigations on spatial IOR even have extended to the cross-modal link between visual and auditory information processing. The present study examined the generation and variation of IOR effects when targets from the visual and auditory modalities were presented simultaneously (audiovisual targets). In addition, it explored the effect of bimodal divided attention on IOR with audiovisual targets by directing the attention to different modality to form two conditions of attention. The present study consisted of 3 experiments. In these experiments, we mainly manipulated the target modalities (including visual, auditory, and audiovisual modalities) and cue validities (including cued, neutral, uncued). Thirty-seven college students in Liaoning province were recruited in Exp. 1. The visual (V) target was white horizontal square wave grating (4° × 4°; the spatial frequency was 1 cycle/degree), the auditory (A) target (duration of 100 ms) was a 1000 Hz sinusoidal tone presented by the speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. During the experiment the fixation stimulus was presented for 800~1000 ms in the center of the monitor. Following the fixation stimulus, uninformative exogenous visual spatial cues were presented between 400~600 ms prior to the onset of targets for 100 ms at the left or right location. Then, the probability of the target (A, V, or AV) appeared for 100 ms in the center was 0.6 (No-go trials), the probability of the target may occur on left or right location was 0.2 (Go trials). The participants were instructed to pay attention to both V and A modalities, then respond to the target stimulus in the left or right location by pressing the response button as quickly and accurately as possible. Thirty-two college students were recruited in Exp. 2. The auditory stimuli were unattended and presented peripherally. Thirty-nine college students were recruited in Exp. 3. The auditory stimuli were unattended and presented centrally, the others were identical to that in Exp. 2. Based on the results of accuracy (ACC), it can be seen that the overall ACC was very high in Exp. 1. The mean ACC of AV targets was significantly higher than to either V or A targets. According to the results of reaction times (RTs), the mean RT of AV targets were significantly faster than to either V or A targets as expected, indicating the appearance of the bimodal advancement effect. For V targets, the RTs in the cued condition were slower than those in the uncued condition, demonstrated a typical IOR effect. There weren’t IOR effect elicited by AV targets when paying attention to both V and A modalities (Exp. 1). From the results of the relative amount of multisensory response enhancement (rMRE), we found a larger rMRE in the cued condition than that in the uncued condition. In Exp. 2 and Exp. 3, we found the comparable IOR with V and AV targets when the simultaneous auditory stimuli were unattended and presented peripherally or centrally. In addition, we found the comparable rMRE with V and AV targets when the simultaneous auditory stimuli were unattended and presented peripherally or centrally. These results suggested that the IOR effect elicited by AV targets was reduced when paying attention to multiple modalities. However, when auditory stimuli were unattended, there was no difference between the visual and audiovisual IOR effects. Based on the aforementioned findings, it indicated that bimodal divided attention can influence IOR with audiovisual targets.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Previous studies usually used the dynamic visual search paradigm to explore the Pip-and-Pop effect, which suggests that the Pip-and-Pop effect is influenced by multiple factors. But the impact of temporal and spatial consistency of audiovisual stimuli on the Pip-and-Pop effect is still controversial. In the present study, we applied the eye movement technology to the dynamic visual search paradigm to systematically investigate the impact of temporal and spatial consistency of audiovisual stimuli on the Pip-and-Pop effect. Based on the results of previous studies, we expected that the spatial and temporal consistency of audiovisual modulated the Pip-and-Pop effect. The more consistent the spatial location of audiovisual stimuli are, the greater the Pip-and-Pop effect will be. The more consistent the temporal audiovisual stimuli are, the greater the Pip-and-Pop effect will be. Experiment 1 was a 3 (set sizes: 36, 48, 60) � 4 (spatial consistency conditions: ipsilateral, contralateral, bilateral, no sound) within-subjects design, recruited 24 participants (5 males; age range: 19~28 years; mean age: 22.5 � 2.3 years). The visual search displays consisted of 24, 36, or 48 red (13.9 cd/m2) or green (46.4 cd/m2) line segments (0.57白0.17�) on a black (0.4 cd/m2) background. The auditory stimulus was 1000 Hz pure tone (65 dB, 60 ms, including 5 ms fade-in and 5 ms fade-out time), presented through speakers on the left and right sides behind the screen. Each trial started with a drift calibration point. The drift calibration point would not disappear until the participant gazed upon this point. This was followed by a central fixation point of 1000ms, and finally a search screen. The participants were required to find the target line segment and judge whether the target line segment was vertical or horizontal by pressing the key (Z key or M key) as quickly and accurately as possible. Experiment 2 was a 2 (set sizes: 36, 60) � 6 (temporal consistency conditions: -200 ms, -100 ms, 0 ms, 100 ms, 200 ms, no sound) within-subjects design, recruited 27 participants (5 males; age range: 18~25 years; mean age: 20.7 � 2.4 years). These temporal consistency conditions represent the tone sounded before (-200, -100 ms), simultaneous with (0 ms), or after (100, 200 ms) the visual target event. The tone could also be absent (no sound). The experimental materials and procedures of Experiment 2 were identical to those in Experiment1. Regarding the results in Experiment 1, compared with the baseline condition (no sound), the search response time was the shortest under the condition of ipsilateral, the mean fixation number was the least, and the mean saccade amplitude was the smallest, indicating that the search efficiency was the highest in the ipsilateral condition, the Pip-and-Pop effect was the largest in the ipsilateral condition. The bilateral condition was the second. The contralateral condition showed no significant difference in the above indicators compared with the no sound condition, indicating that no Pip-and-Pop effect was found in the contralateral condition. The results showed that the more consistent the spatial location of audiovisual stimuli were, the greater the Pip-and-Pop effect was. In Experiment 2, compared with the no sound condition, we found that the response time of the search was significantly shorter, the mean fixation number in search decreased, the mean saccade amplitude increased, and the mean fixation duration became longer under the conditions of 0 ms, -100 ms and 100 ms. Compared with the no sound condition, conditions -200 ms and 200 ms showed no significant difference in the above indicators. This indicated that the conditions of 0 ms, -100 ms and 100 ms produced the Pip-and-Pop effect, and the Pip-and-Pop effect was the largest under the condition of 0ms, while the Pip-and-Pop effect did not find under the condition of -200 ms and 200 ms. The results showed that the more consistent the temporal audiovisual stimuli were, the greater the Pip-and-Pop effect was. In summary, the results showed that the more consistent the audiovisual stimuli were in space and time, the larger the Pip-and-Pop effect was. Therefore, the findings in the present study suggest that the temporal and spatial consistency of audiovisual stimuli modulates the Pip-and-Pop effect. The results provide evidence that the reason for the Pip-and-Pop effect is multisensory integration.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Attention effect has been greatly explored in multisensory integration. Previous studies found that endogenous spatial attention enhanced multisensory integration, while exogenous spatial attention decreased multisensory integration. However, there is no research integrates two kinds of spatial attention into the multisensory integration. In present study, we used endogenous-exogenous spatial cue target paradigm to investigate the effect of endogenous spatial attention and exogenous spatial attention on multisensory integration.The present study consisted of 2 experiments. In these experiments, we mainly manipulated the endogenous cue validities (including cued, uncued), exogenous cue validities (including cued, uncued) and target modalities (including visual, auditory, and audiovisual modalities). Thirty-six students in Liaoning Normal University were recruited in Exp. 1. The visual (V) target was a white pentagonal asterisk block (2°×2°). The auditory (A) target was a 1 600 Hz sinusoidal tone presented by speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. At the beginning of each trial, the fixation stimulus was presented for 600~800 ms in the center of the monitor. Following the fixation stimulus, the endogenous cue was presented for 200 ms, which could predict (80%) the location of the target. Then a visual white square served as a exogenous cue was presented for 200 ms at the left or right location randomly. Before the target that appeared for 100 ms, the inter stimulus interval (ISI) lasted for 150 ms. The target (A, V, or AV) randomly appeared for 100 ms in the left or right locations. At last, the fixation stimuli appeared for 1000 ms to wait for the correspondence responses to targets. During the experiment, the participants were asked to locate targets by pressing buttons (F/J) as quickly and accurately as possible. Thirty-six college students were recruited in Exp. 2. In Exp. 2, visual stimuli included checkerboard squares (3.2°×3.2°) with gray (RGB: 147, 149, 152) in the middle and black (RGB: 0, 0, 0) in the middle; auditory stimuli included high-frequency sinusoidal tone (1400) and low-frequency sinusoidal tone (714). The visual target was one of the above two visual stimuli, and the auditory target was one of the above two auditory stimuli. The pairings of two single channel stimuli constituted audiovisual target. The Exp. 2 consisted of four audiovisual targets. Each set of audiovisual targets were balanced among the subjects.The results showed that the responses to AV targets were faster than V or A targets, indicating the appearance of the bimodal advancement effect in both experiments. In addition, we found exogenous spatial attention’s race model (probability difference) showed significant smaller at cued compared to uncued condition in both experiments, while the endogenous spatial attention reduced the extent to which the exogenous spatial attention weakened the effect of multisensory integration in Exp.2, but not in Exp. 1. From the results of the relative amount of multisensory response enhancement (rMRE), In Exp. 1, the effects of endogenous spatial attention and exogenous spatial attention on multisensory integration were marginal significant. In Exp. 2, the two kinds of spatial attention had significant interaction with multisensory integration.In summary, exogenous spatial attention decreased multisensory integration in both experiments. Endogenous spatial attention is involved in multisensory integration and has an impact on exogenous spatial attention in Exp. 2. The effects of endogenous spatial attention and exogenous spatial attention on multisensory integration in an interactive manner.
Hits
Hits
Downloads
Comment