All the latest about the activities of the Neuropsychology and Cognition Group at the University of the Balearic Islands
Congratulations to Laura Gallego and Francisco Guillem who are joining our group as undergraduate student collaborators. Laura will be participating in a research project on attention and distraction led by Fabrice Parmentier. Francisco will participate in a project on the early diagnosis of Alzheimer’s disease led by Pilar Andrés.
In a study by Vasilev, Parmentier, Angele and Kirkby just accepted for publication in the Quarterly Journal of Experimental Psychology, we investigated the effect of deviant sounds on eye movements during a reading task. Our study shows for the first time that unexpected sounds caused longer fixations on the word immediately following this sound, which we interpret as the result of a disruption of the programming of the next saccade. This work is part of a collaboration with Martin Vasilev, Berhnard Angele and Julie Kirkby from Bournemouth University.
Reference:
Vasilev, M. R., Parmentier, F. B. R., Angele, B., & Kirkby, J. A. (in press). Distraction by deviant sounds during reading An eye-movement study. Quarterly Journal of Experimental Psychology.
Abstract: Oddball studies have shown that sounds unexpectedly deviating from an otherwise repeated sequence capture attention away from the task at hand. While such distraction is typically regarded as potentially important in everyday life, previous work has so far not examined how deviant sounds affect performance on more complex daily tasks. In this study, we developed a new method to examine whether deviant sounds can disrupt reading performance by recording participants’ eye-movements. Participants read single sentences in silence and while listening to task-irrelevant sounds. In the latter condition, a 50-ms sound was played contingent on the fixation of five target words in the sentence. On most occasions, the same tone was presented (standard sound), while on rare and unexpected occasions it was replaced by white noise (deviant sound). The deviant sound resulted in significantly longer fixation durations on the target words relative to the standard sound. A time course analysis showed that the deviant sound began to affect fixation durations around 180 ms after fixation onset. Furthermore, deviance distraction was not modulated by the lexical frequency of target words. In summary, fixation durations on the target words were longer immediately after the presentation of the deviant sound, but there was no evidence that it interfered with the lexical processing of these words. The present results are in line with the recent proposition that deviant sounds yield a temporary motor suppression and suggest that deviant sounds likely inhibit the programming of the next saccade.
Enrique carried out his PhD at the University of Granada under the supervision of Dr Ángel Correa and Dr Daniel Sanabria.
English summary (taken from the thesis):
“Driver’s fatigue is one of the main causes of road accidents, as it can produce distractions and drowsiness, especially in long and monotonous roads. The ability to maintain a good performance while driving (or in any other task that requires attention) for a long period of time is called vigilance, and it can present fluctuations and a continuous decline with time on task, a phenomenon known as the vigilance decrement (Mackworth, 1948). These fluctuations are modulated by factors like motivation, sleep or circadian rhythmicity, which refers to the periodicity of several human functions, like sleep-wake cycle, hormone production or even cognitive performance (see for example (Goldstein, Hahn, Hasher, Wiprzycka, & Zelazo, 2007).
Therefore, a main goal in fatigue research is to identify these attentional fluctuations that can lead to poor performance states. One framework to attain this aim is monitoring subject’s psychophysiological variables, like the ocular movements, the body temperature or the electroencephalogram (EEG), and use them as indices of subject’s performance on the task. A system that, using these variables, could identify subject’s low attentional states and alert the driver of an imminent risk, would have important implications on safety, even more if such a system could identify these states in advance.
Within this framework, some neurophysiological models have been developed to predict a driver’s performance from records of the brain activity (Chin-Teng Lin et al., 2005). These models are, generally, subject- or task-specific and is not clear to what extent they can be transfer between subjects or tasks.
In this thesis we addressed the topic of predicting low performance states while driving. To do so, we first studied different factors that can modulate performance in a driving task; second, we studied two neurophysiologic indices of attentional state using a simple vigilance task; and third, we tested the predictive accuracy of a simple regression model when transferred between two different attentional tasks.
In Experiment 1, we studied the effect of time of day and chronotype on the vigilance decrement in a simulated driving task and in a simple reaction time task, the Psychomotor Vigilance Task (PVT; Dinges & Powell, 1985). We tested two extreme chronotype groups (morning-type and evening-type) at two different moments of day (8am vs 8pm). These two times of the day represented an optimum and sub-optimum cognitive state for each chronotype, being the morning-type in its optimum state at 8am, and the evening-type at 8pm. We also recorded the EEG throughout the driving task to analyze the power dynamics in the main frequency bands (i.e., theta, alpha and beta). Results from this study showed an interaction between the circadian factors (i.e., time of day and chronotype), but only for the evening-type group, while morning-type group showed a very stable performance at both moments of the day. This interaction appeared for both, the driving task and the PVT, but it was not reflected in the EEG, which only showed a generalized power increment with time on task for both chronotypes.
In Experiment 2 we analyzed two psychophysiological variables (EEG and skin temperature) as predictors of the attentional fluctuations while a long 45-min PVT, controlling for the effect of circadian factors by choosing only intermediate-type chronotypes and avoiding extreme hours (i.e., early in the morning or late in the evening) to run the experiment. The EEG and temperature were recorded continuously throughout the task. We examined the power dynamics of the theta, alpha and beta frequency bands from the EEG, and three different skin temperature measures, the distal temperature (recorded from the wrist, over the small superficial capillaries), the proximal temperature (recorded under the left clavicle as an estimator of the core body temperature), and the distal-proximal gradient (DPG), which is the difference between the distal and the proximal temperatures, being a more stable measure. Subsequently, these variables (the EEG frequency power and the three temperature recordings) were related to the performance in the PVT, measured as the reaction time.
Results showed evidence of a clear relationship between a slowing-down in the response time and an increment in power in theta and alpha frequency bands, in brain regions related to the attentional network. Likewise, a linear mixed-model showed that a reduction in the distal skin temperature and in the DPG resulted in an increment of the reaction time (i.e., a poorer performance). These results showed that both indices, the EEG frequency power and the skin temperature were potential predictors of subject’s performance in a vigilance task. However, while the EEG worked on a milliseconds scale, the temperature had a much slower time course, on the scale of minutes, which make the former a better choice as predictor for our next experiment.
In the Experiment 3, our main goal was to develop a model to predict performance in a driving task using some of the indices from Experiment 2, that is, the power dynamics from theta and alpha frequency bands. Also, we aimed to transfer this model between tasks, using the data from the PVT to build the model and then using it to predict performance in the driving task. Thus, in Experiment 3, subjects performed a 20-min PVT and a 60-min simulated driving task, while the EEG was recorded throughout the tasks.
The EEG analyses were similar to those used in Experiment 2, and results from the power dynamics replicated those found in Experiment 2. More precisely, the EEG analyses showed an increment of alpha and theta frequency power related to an increment in the reaction time for both tasks, the PVT and the simulated driving. Also, these frequency dynamics were located in the frontal-parietal attentional network and in the default mode network.
The data from the PVT were used to fit an individualized linear regression model, using the EEG frequency power as predictor of the reaction time. Then, this model was feed with the EEG data from the driving task to obtain estimates of the reaction time, which was finally correlated with the actual reaction time from the driving task. This correlation was positive and significant for barely a third of the subjects. It is possible that the complexity of the model was a key factor when transferring it between tasks, and a simple model as ours only works when the attentional fluctuations are not influenced by other factors unrelated to fatigue.
In sum, in this thesis we have proposed an individualized predictive model of performance in a simulated driving task built from a simpler task like the PVT. In Experiment 2 we have shown that EEG and temperature analyses can grasp the attentional state and can predict (even 2 seconds in advance in the case of the EEG) the reaction time in the PVT. Then, in Experiment 3, results showed that it is possible to transfer a simple regression model and make accurate predictions between tasks, at least for a few subjects. We have likewise shown for the first time that circadian factors play an important role on driving performance, and that this could also be related to subjects’ personality. Thus, if personality could affect the performance stability between sessions, then, although circadian factors were controlled in our last experiment, other personality or mood states could have influence the difference in outcomes between tasks. Therefore, a more complex regression model that accounts for variables related to the subject could be the key for the model to work in most of the subjects.
The approach proposed in this thesis is based on the generalization of a predicting model using a simple task. This model would allow anyone to adjust an individualized and instantaneous system for fatigue prevention, not only for driving tasks, but for many other daily tasks that require of a continuous level of alertness. These tasks are common in many jobs and in many cases, an attentional lapse can result in serious accidents, and therefore, research in such a model will have a big impact in safety.“
A new book chapter by Ophelia Deroy, Irune Fernandez-Prieto, Jordi Navarra and Charles Spence has just come out. This chapter focuses on the processing of spatial pitch and is part of a book published by Cambridge Press on spatial biases in perception and cognition.
Reference: Deroy, O., Fernandez-Prieto, I., Navarra, J., & Spence, C. (2018) Unravelling the paradox of spatial pitch. In T. L. Hubbard (Eds.), Spatial biases in perception and cognition. Cambridge, UK: Cambridge University Press.
Congratulations to Irune who, with her colleagues at Jordi Navarra's lab, has just published a study showing that passive exposure to melodies elicits spatial predictions.
Reference: Romero-Rivas, C., Vera-Constán, F., Rodríguez-Cuadrado, S., Puigcerver, L., Fernandez-Prieto, I., Navarra, J. (2018). Seeing music: The perception of melodic 'ups and downs' modulates the spatial processing of visual stimuli. Neuropsychologia, 117, 67-74. Doi: 10.1016/j.neuropsychologia.2018.05.009
[Download]
Abstract: Musical melodies have "peaks" and "valleys". Although the vertical component of pitch and music is well-known, the mechanisms underlying its mental representation still remain elusive. We show evidence regarding the importance of previous experience with melodies for crossmodal interactions to emerge. The impact of these crossmodal interactions on other perceptual and attentional processes was also studied. Melodies including two tones with different frequency (e.g., E4 and D3) were repeatedly presented during the study. These melodies could either generate strong predictions (e.g., E4-D3-E4-D3-E4-[D3]) or not (e.g., E4-D3-E4-E4-D3-[?]). After the presentation of each melody, the participants had to judge the colour of a visual stimulus that appeared in a position that was, according to the traditional vertical connotations of pitch, either congruent (e.g., high-low-high-low-[up]), incongruent (high-low-high-low-[down]) or unpredicted with respect to the melody. Behavioural and electroencephalographic responses to the visual stimuli were obtained. Congruent visual stimuli elicited faster responses at the end of the experiment than at the beginning. Additionally, incongruent visual stimuli that broke the spatial prediction generated by the melody elicited larger P3b amplitudes (reflecting 'surprise' responses). Our results suggest that the passive (but repeated) exposure to melodies elicits spatial predictions that modulate the processing of other sensory events.
