Car driving is considered a very complex activity, consisting of different concomitant tasks and subtasks, thus it is crucial to understand the impact of different factors, such as road complexity, traffic, dashboard devices, and external events on the driver's behavior and performance. For this reason, in particular situations the cognitive demand experienced by the driver could be very high, inducing an excessive experienced mental workload and consequently an increasing of error commission probability. In this regard, it has been demonstrated that human error is the main cause of the 57% of road accidents and a contributing factor in most of them. In this study, 20 young subjects have been involved in a real driving experiment, performed under different traffic conditions (rush hour and not) and along different road types (main and secondary streets). Moreover, during the driving tasks different specific events, in particular a pedestrian crossing the road and a car entering the traffic flow just ahead of the experimental subject, have been acted. A Workload Index based on the Electroencephalographic (EEG), i.e., brain activity, of the drivers has been employed to investigate the impact of the different factors on the driver's workload. Eye-Tracking (ET) technology and subjective measures have also been employed in order to have a comprehensive overview of the driver's perceived workload and to investigate the different insights obtainable from the employed methodologies. The employment of such EEG-based Workload index confirmed the significant impact of both traffic and road types on the drivers' behavior (increasing their workload), with the advantage of being under real settings. Also, it allowed to highlight the increased workload related to external events while driving, in particular with a significant effect during those situations when the traffic was low. Finally, the comparison between methodologies revealed the higher sensitivity of neurophysiological measures with respect to ET and subjective ones. In conclusion, such an EEG-based Workload index would allow to assess objectively the mental workload experienced by the driver, standing out as a powerful tool for research aimed to investigate drivers' behavior and providing additional and complementary insights with respect to traditional methodologies employed within road safety research.

In this paper, we present a method to quantify the coupling between brain regions under vigilance and enhanced mental states by utilizing partial directed coherence (PDC) and graph theory analysis (GTA). The vigilance state is induced using a modified version of stroop color-word task (SCWT) while the enhancement state is based on audio stimulation with a pure tone of 250 Hz. The audio stimulation was presented to the right and left ears simultaneously for one-hour while participants perform the SCWT. The quantification of mental states was performed by means of statistical analysis of indexes based on GTA, behavioral responses of time-on-task (TOT), and Brunel Mood Scale (BRMUS). The results show that PDC is very sensitive to vigilance decrement and shows that the brain connectivity network is significantly reduced with increasing TOT, p < 0.05. Meanwhile, during the enhanced state, the connectivity network maintains high connectivity as time passes and shows significant improvements compared to vigilance state. The audio stimulation enhances the connectivity network over the frontal and parietal regions and the right hemisphere. The increase in the connectivity network correlates with individual differences in the magnitude of the vigilance enhancement assessed by response time to stimuli. Our results provide evidence for enhancement of cognitive processing efficiency with audio stimulation. The BRMUS was used to evaluate the emotional states of vigilance task before and after using the audio stimulation. BRMUS factors, such as fatigue, depression, and anger, significantly decrease in the enhancement group compared to vigilance group. On the other hand, happy and calmness factors increased with audio stimulation, p < 0.05.

Vigilance degradation usually causes significant performance decrement. It is also considered the major factor causing the out-of-the-loop phenomenon (OOTL) occurrence. OOTL is strongly related to a high level of automation in operative contexts such as the Air Traffic Management (ATM), and it could lead to a negative impact on the Air Traffic Controllers' (ATCOs) engagement. As a consequence, being able to monitor the ATCOs' vigilance would be very important to prevent risky situations. In this context, the present study aimed to characterise and assess the vigilance level by using electroencephalographic (EEG) measures. The first study, involving 13 participants in laboratory settings allowed to find out the neurophysiological features mostly related to vigilance decrements. Those results were also confirmed under realistic ATM settings recruiting 10 professional ATCOs. The results demonstrated that (i) there was a significant performance decrement related to vigilance reduction; (ii) there were no substantial differences between the identified neurophysiological features in controlled and ecological settings, and the EEG-channel configuration defined in laboratory was able to discriminate and classify vigilance changes in ATCOs' vigilance with high accuracy (up to 84%); (iii) the derived two EEG-channel configuration was able to assess vigilance variations reporting only slight accuracy reduction.

One century after the first recording of human electroencephalographic (EEG) signals, EEG has become one of the most used neuroimaging techniques. The medical devices industry is now able to produce small and reliable EEG systems, enabling a wide variety of applications also with no-clinical aims, providing a powerful tool to neuroscientific research. However, these systems still suffer from a critical limitation, consisting in the use of wet electrodes, that are uncomfortable and require expertise to install and time from the user. In this context, dozens of different concepts of EEG dry electrodes have been recently developed, and there is the common opinion that they are reaching traditional wet electrodes quality standards. However, although many papers have tried to validate them in terms of signal quality and usability, a comprehensive comparison of different dry electrode types from multiple points of view is still missing. The present work proposes a comparison of three different dry electrode types, selected among the main solutions at present, against wet electrodes, taking into account several aspects, both in terms of signal quality and usability. In particular, the three types consisted in gold-coated single pin, multiple pins and solid-gel electrodes. The results confirmed the great standards achieved by dry electrode industry, since it was possible to obtain results comparable to wet electrodes in terms of signals spectra and mental states classification, but at the same time drastically reducing the time of montage and enhancing the comfort. In particular, multiple-pins and solid-gel electrodes overcome gold-coated single-pin-based ones in terms of comfort.

Unilateral hearing loss constitutes a field of growing interest in the scientific community. In fact, this kind of patients represent a unique and physiological way to investigate how neuroplasticity overcame unilateral deafferentation by implementing particular strategies that produce apparently next- to- normal hearing behavioural performances. This explains why such patients have been underinvestigated for a long time. Thanks to the availability of techniques able to study the cerebral activity underlying the mentioned behavioural outcomes, the aim of the present research was to elucidate whether different electroencephalographic (EEG) patterns occurred in unilateral hearing loss (UHL) children in comparison to normal hearing (NH) controls during speech-in-noise listening. Given the intrinsic lateralized nature of such patients, due to the unilateral side of hearing impairment, the experimental question was to assess whether this would reflect a different EEG pattern while performing a word in noise recognition task varying the direction of the noise source. Results showed a correlation between the period of deafness and the cortical activity asymmetry toward the hearing ear side in the frontal, parietal and occipital areas in all the experimental conditions. Concerning alpha and beta activity in the frontal and central areas highlighted that in the NH group, the lateralization was always left-sided during the Quiet condition, while it was right-sided in noise conditions; this evidence was not, however, detected also in the UHL group. In addition, focusing on the theta and alpha activity in the frontal areas (Broca area) during noise conditions, while the activity was always left-lateralized in the NH group, it was ipsilateral to the direction of the background noise in the UHL group, and of a weaker extent than in NH controls. Furthermore, in noise conditions, only the UHL group showed a higher theta activity in the temporal areas ipsilateral to the side where the background noise was directed to. Finally, in the case of bilateral noise (background noise and word signal both coming from the same two sources), the theta and alpha activity in the frontal areas (Broca area) was left-lateralized in the case of the NH group and lateralized towards the side of the better hearing ear in the case of the UHL group. Taken together, this evidence supports the establishment of a particular EEG pattern occurrence in UHL children taking place in the frontal (Broca area), temporal and parietal lobes, probably physiologically established in order to deal with different sound and noise source directions.

Understanding the neural mechanisms responsible for human social interactions is difficult, since the brain activities of two or more individuals have to be examined simultaneously and correlated with the observed social patterns. We introduce the concept of hyper-brain network, a connectivity pattern representing at once the information flow among the cortical regions of a single brain as well as the relations among the areas of two distinct brains. Graph analysis of hyper-brain networks constructed from the EEG scanning of 26 couples of individuals playing the Iterated Prisoner's Dilemma reveals the possibility to predict non-cooperative interactions during the decision-making phase. The hyper-brain networks of two-defector couples have significantly less inter-brain links and overall higher modularity--i.e., the tendency to form two separate subgraphs--than couples playing cooperative or tit-for-tat strategies. The decision to defect can be "read" in advance by evaluating the changes of connectivity pattern in the hyper-brain network.

It is well known that the evaluation of a product from the shelf considers the simultaneous cerebral and emotional evaluation of the different qualities of the product such as its colour, the eventual images shown, and the envelope's texture (hereafter all included in the term "product experience"). However, the measurement of cerebral and emotional reactions during the interaction with food products has not been investigated in depth in specialized literature. The aim of this paper was to investigate such reactions by the EEG and the autonomic activities, as elicited by the cross-sensory interaction (sight and touch) across several different products. In addition, we investigated whether (i) the brand (Major Brand or Private Label), (ii) the familiarity (Foreign or Local Brand), and (iii) the hedonic value of products (Comfort Food or Daily Food) influenced the reaction of a group of volunteers during their interaction with the products. Results showed statistically significantly higher tendency of cerebral approach (as indexed by EEG frontal alpha asymmetry) in response to comfort food during the visual exploration and the visual and tactile exploration phases. Furthermore, for the same index, a higher tendency of approach has been found toward foreign food products in comparison with local food products during the visual and tactile exploration phase. Finally, the same comparison performed on a different index (EEG frontal theta) showed higher mental effort during the interaction with foreign products during the visual exploration and the visual and tactile exploration phases. Results from the present study could deepen the knowledge on the neurophysiological response to food products characterized by different nature in terms of hedonic value familiarity; moreover, they could have implications for food marketers and finally lead to further study on how people make food choices through the interactions with their commercial envelope.

Inappropriate training assessment might have either high social costs and economic impacts, especially in high risks categories, such as Pilots, Air Traffic Controllers, or Surgeons. One of the current limitations of the standard training assessment procedures is the lack of information about the amount of cognitive resources requested by the user for the correct execution of the proposed task. In fact, even if the task is accomplished achieving the maximum performance, by the standard training assessment methods, it would not be possible to gather and evaluate information about cognitive resources available for dealing with unexpected events or emergency conditions. Therefore, a metric based on the brain activity (neurometric) able to provide the Instructor such a kind of information should be very important. As a first step in this direction, the Electroencephalogram (EEG) and the performance of 10 participants were collected along a training period of 3 weeks, while learning the execution of a new task. Specific indexes have been estimated from the behavioral and EEG signal to objectively assess the users' training progress. Furthermore, we proposed a neurometric based on a machine learning algorithm to quantify the user's training level within each session by considering the level of task execution, and both the behavioral and cognitive stabilities between consecutive sessions. The results demonstrated that the proposed methodology and neurometric could quantify and track the users' progresses, and provide the Instructor information for a more objective evaluation and better tailoring of training programs.

A COST Action is a consortium of -mainly- European scientists (but open to international cooperation) working on a common research area, with the same subject; COST provides funding to the Actions for networking and dissemination activities, thus the participating scientists must have secured research funding from other national or European sources. COST funding is in the scale of approximately 100 kEuros per year and in this vein, it is often criticized both in that it does not fund research and the core science and in that its funding is 'limited'. However, COST with its instruments is an integral pillar of the European Research Area, and it is through its mission that a variety of aspects of the research environment, fundamental to the success of the research, are catered for; these include scientific networking, collaboration/exchange/training and dissemination activities. Through fast procedures, proposals are evaluated and approved for funding in less than one year from submission date and Actions become operational immediately, managed on flexible management. In this way, COST contributes to reducing the fragmentation in European research investments, while opening the European Research Area to cooperation worldwide. COST Actions have an excellent record of building the critical mass for follow up activities in the EU FP or other similarly competitive programmes.

Real-world experience is typically multimodal. Evidence indicates that the facilitation in the detection of multisensory stimuli is modulated by the perceptual load, the amount of information involved in the processing of the stimuli. Here, we used a realistic virtual reality environment while concomitantly acquiring Electroencephalography (EEG) and Galvanic Skin Response (GSR) to investigate how multisensory signals impact target detection in two conditions, high and low perceptual load. Different multimodal stimuli (auditory and vibrotactile) were presented, alone or in combination with the visual target. Results showed that only in the high load condition, multisensory stimuli significantly improve performance, compared to visual stimulation alone. Multisensory stimulation also decreases the EEG-based workload. Instead, the perceived workload, according to the "NASA Task Load Index" questionnaire, was reduced only by the trimodal condition (i.e., visual, auditory, tactile). This trimodal stimulation was more effective in enhancing the sense of presence, that is the feeling of being in the virtual environment, compared to the bimodal or unimodal stimulation. Also, we show that in the high load task, the GSR components are higher compared to the low load condition. Finally, the multimodal stimulation (Visual-Audio-Tactile-VAT and Visual-Audio-VA) induced a significant decrease in latency, and a significant increase in the amplitude of the P300 potentials with respect to the unimodal (visual) and visual and tactile bimodal stimulation, suggesting a faster and more effective processing and detection of stimuli if auditory stimulation is included. Overall, these findings provide insights into the relationship between multisensory integration and human behavior and cognition.

Despite the plethora of studies investigating listening effort and the amount of research concerning music perception by cochlear implant (CI) users, the investigation of the influence of background noise on music processing has never been performed. Given the typical speech in noise recognition task for the listening effort assessment, the aim of the present study was to investigate the listening effort during an emotional categorization task on musical pieces with different levels of background noise. The listening effort was investigated, in addition to participants' ratings and performances, using EEG features known to be involved in such phenomenon, that is alpha activity in parietal areas and in the left inferior frontal gyrus (IFG), that includes the Broca's area. Results showed that CI users performed worse than normal hearing (NH) controls in the recognition of the emotional content of the stimuli. Furthermore, when considering the alpha activity corresponding to the listening to signal to noise ratio (SNR) 5 and SNR10 conditions subtracted of the activity while listening to the Quiet condition-ideally removing the emotional content of the music and isolating the difficulty level due to the SNRs- CI users reported higher levels of activity in the parietal alpha and in the homologous of the left IFG in the right hemisphere (F8 EEG channel), in comparison to NH. Finally, a novel suggestion of a particular sensitivity of F8 for SNR-related listening effort in music was provided.

Adaptive Automation (AA) is a promising approach to keep the task workload demand within appropriate levels in order to avoid both the under- and over-load conditions, hence enhancing the overall performance and safety of the human-machine system. The main issue on the use of AA is how to trigger the AA solutions without affecting the operative task. In this regard, passive Brain-Computer Interface (pBCI) systems are a good candidate to activate automation, since they are able to gather information about the covert behavior (e.g., mental workload) of a subject by analyzing its neurophysiological signals (i.e., brain activity), and without interfering with the ongoing operational activity. We proposed a pBCI system able to trigger AA solutions integrated in a realistic Air Traffic Management (ATM) research simulator developed and hosted at ENAC (École Nationale de l'Aviation Civile of Toulouse, France). Twelve Air Traffic Controller (ATCO) students have been involved in the experiment and they have been asked to perform ATM scenarios with and without the support of the AA solutions. Results demonstrated the effectiveness of the proposed pBCI system, since it enabled the AA mostly during the high-demanding conditions (i.e., overload situations) inducing a reduction of the mental workload under which the ATCOs were operating. On the contrary, as desired, the AA was not activated when workload level was under the threshold, to prevent too low demanding conditions that could bring the operator's workload level toward potentially dangerous conditions of underload.

Several models defining different types of cognitive human behaviour are available. For this work, we have selected the Skill, Rule and Knowledge (SRK) model proposed by Rasmussen in 1983. This model is currently broadly used in safety critical domains, such as the aviation. Nowadays, there are no tools able to assess at which level of cognitive control the operator is dealing with the considered task, that is if he/she is performing the task as an automated routine (skill level), as procedures-based activity (rule level), or as a problem-solving process (knowledge level). Several studies tried to model the SRK behaviours from a Human Factor perspective. Despite such studies, there are no evidences in which such behaviours have been evaluated from a neurophysiological point of view, for example, by considering brain activity variations across the different SRK levels. Therefore, the proposed study aimed to investigate the use of neurophysiological signals to assess the cognitive control behaviours accordingly to the SRK taxonomy. The results of the study, performed on 37 professional Air Traffic Controllers, demonstrated that specific brain features could characterize and discriminate the different SRK levels, therefore enabling an objective assessment of the degree of cognitive control behaviours in realistic settings.

We have developed a MATLAB-based toolbox, eConnectome (electrophysiological connectome), for mapping and imaging functional connectivity at both the scalp and cortical levels from the electroencephalogram (EEG), as well as from the electrocorticogram (ECoG). Graphical user interfaces were designed for interactive and intuitive use of the toolbox. Major functions of eConnectome include EEG/ECoG preprocessing, scalp spatial mapping, cortical source estimation, connectivity analysis, and visualization. Granger causality measures such as directed transfer function and adaptive directed transfer function were implemented to estimate the directional interactions of brain functional networks, over the scalp and cortical sensor spaces. Cortical current density inverse imaging was implemented using a generic realistic geometry brain-head model from scalp EEGs. Granger causality could be further estimated over the cortical source domain from the inversely reconstructed cortical source signals as derived from the scalp EEG. Users may implement other connectivity estimators in the framework of eConnectome for various applications. The toolbox package is open-source and freely available at http://econnectome.umn.edu under the GNU general public license for noncommercial and academic uses.

In this study, the cortical activity correlated with the perception and appreciation of different set of pictures was estimated by using neuroelectric brain activity and graph theory methodologies in a group of artistic educated persons. The pictures shown to the subjects consisted of original pictures of Titian's and a contemporary artist's paintings (Orig dataset) plus two sets of additional pictures. These additional datasets were obtained from the previous paintings by removing all but the colors or the shapes employed (Color and Style dataset, respectively). Results suggest that the verbal appreciation of Orig dataset when compared to Color and Style ones was mainly correlated to the neuroelectric indexes estimated during the first 10 s of observation of the pictures. Always in the first 10 s of observation: (1) Orig dataset induced more emotion and is perceived with more appreciation than the other two Color and Style datasets; (2) Style dataset is perceived with more attentional effort than the other investigated datasets. During the whole period of observation of 30 s: (1) emotion induced by Color and Style datasets increased across the time while that induced of the Orig dataset remain stable; (2) Color and Style dataset were perceived with more attentional effort than the Orig dataset. During the entire experience, there is evidence of a cortical flow of activity from the parietal and central areas toward the prefrontal and frontal areas during the observation of the images of all the datasets. This is coherent from the notion that active perception of the images with sustained cognitive attention in parietal and central areas caused the generation of the judgment about their aesthetic appreciation in frontal areas.

This paper presents the first comprehensive review on vigilance enhancement using both conventional and unconventional means, and further discusses the resulting contradictory findings. It highlights the key differences observed between the research findings and argues that variations of the experimental protocol could be a significant contributing factor towards such contradictory results. Furthermore, the paper reveals the effectiveness of unconventional means of enhancement in significant reduction of vigilance decrement compared to conventional means. Meanwhile, a discussion on the challenges of enhancement techniques is presented, with several suggested recommendations and alternative strategies to maintain an adequate level of vigilance for the task at hand. Additionally, this review provides evidence in support of the use of unconventional means of enhancement on vigilance studies, regardless of their practical challenges.

Increasing the level of automation in air traffic management is seen as a measure to increase the performance of the service to satisfy the predicted future demand. This is expected to result in new roles for the human operator: he will mainly monitor highly automated systems and seldom intervene. Therefore, air traffic controllers (ATCos) would often work in a supervisory or control mode rather than in a direct operating mode. However, it has been demonstrated how human operators in such a role are affected by human performance issues, known as Out-Of-The-Loop (OOTL) phenomenon, consisting in lack of attention, loss of situational awareness and de-skilling. A countermeasure to this phenomenon has been identified in the adaptive automation (AA), i.e., a system able to allocate the operative tasks to the machine or to the operator depending on their needs. In this context, psychophysiological measures have been highlighted as powerful tool to provide a reliable, unobtrusive and real-time assessment of the ATCo's mental state to be used as control logic for AA-based systems. In this paper, it is presented the so-called "Vigilance and Attention Controller", a system based on electroencephalography (EEG) and eye-tracking (ET) techniques, aimed to assess in real time the vigilance level of an ATCo dealing with a highly automated human-machine interface and to use this measure to adapt the level of automation of the interface itself. The system has been tested on 14 professional ATCos performing two highly realistic scenarios, one with the system disabled and one with the system enabled. The results confirmed that (i) long high automated tasks induce vigilance decreasing and OOTL-related phenomena; (ii) EEG measures are sensitive to these kinds of mental impairments; and (iii) AA was able to counteract this negative effect by keeping the ATCo more involved within the operative task. The results were confirmed by EEG and ET measures as well as by performance and subjective ones, providing a clear example of potential applications and related benefits of AA.

In several fields, the need for a joint analysis of brain activity and eye activity to investigate the association between brain mechanisms and manifest behavior has been felt. In this work, two levels of attentional demand, elicited through a conjunction search task, have been modelled in terms of eye blinks, brain activity, and brain network features. Moreover, the association between endogenous neural mechanisms underlying attentional demand and eye blinks, without imposing a time-locked structure to the analysis, has been investigated. The analysis revealed statistically significant spatial and spectral modulations of the recorded brain activity according to the different levels of attentional demand, and a significant reduction in the number of eye blinks when a higher amount of attentional investment was required. Besides, the integration of information coming from high-density electroencephalography (EEG), brain source localization, and connectivity estimation allowed us to merge spectral and causal information between brain areas, characterizing a comprehensive model of neurophysiological processes behind attentional demand. The analysis of the association between eye and brain-related parameters revealed a statistically significant high correlation (R > 0.7) of eye blink rate with anterofrontal brain activity at 8 Hz, centroparietal brain activity at 12 Hz, and a significant moderate correlation with the participation of right Intra Parietal Sulcus in alpha band (R = -0.62). Due to these findings, this work suggests the possibility of using eye blinks measured from one sensor placed on the forehead as an unobtrusive measure correlating with neural mechanisms underpinning attentional demand.

Eye blink is an important and inevitable artifact during scalp electroencephalogram (EEG) recording. The main problem in EEG signal processing is how to identify eye blink components automatically with independent component analysis (ICA). Taking into account the fact that the eye blink as an external source has a higher sum of correlation with frontal EEG channels than all other sources due to both its location and significant amplitude, in this paper, we proposed a method based on correlation index and the feature of power distribution to automatically detect eye blink components. Furthermore, we prove mathematically that the correlation between independent components and scalp EEG channels can be translating directly from the mixing matrix of ICA. This helps to simplify calculations and understand the implications of the correlation. The proposed method doesn't need to select a template or thresholds in advance, and it works without simultaneously recording an electrooculography (EOG) reference. The experimental results demonstrate that the proposed method can automatically recognize eye blink components with a high accuracy on entire datasets from 15 subjects.

Nowadays there is the hope that neuroscientific findings will contribute to the improvement of building design in order to create environments which satisfy man's demands. This can be achieved through the understanding of neurophysiological correlates of architectural perception. To this aim, the electroencephalographic (EEG) signals of 12 healthy subjects were recorded during the perception of three immersive virtual reality environments (VEs). Afterwards, participants were asked to describe their experience in terms of Familiarity, Novelty, Comfort, Pleasantness, Arousal, and Presence using a rating scale from 1 to 9. These perceptual dimensions are hypothesized to influence the pattern of cerebral spectral activity, while Presence is used to assess the realism of the virtual stimulation. Hence, the collected scores were used to analyze the Power Spectral Density (PSD) of the EEG for each behavioral dimension in the theta, alpha and mu bands by means of time-frequency analysis and topographic statistical maps. Analysis of Presence resulted in the activation of the frontal-midline theta, indicating the involvement of sensorimotor integration mechanisms when subjects expressed to feel more present in the VEs. Similar patterns also characterized the experience of familiar and comfortable VEs. In addition, pleasant VEs increased the theta power across visuomotor circuits and activated the alpha band in areas devoted to visuospatial exploration and processing of categorical spatial relations. Finally, the de-synchronization of the mu rhythm described the perception of pleasant and comfortable VEs, showing the involvement of left motor areas and embodied mechanisms for environment appreciation. Overall, these results show the possibility to measure EEG correlates of architectural perception involving the cerebral circuits of sensorimotor integration, spatial navigation, and embodiment. These observations can help testing architectural hypotheses in order to design environments matching the changing needs of humans.