| 1 |
Mapping of Language-and-Memory Networks in Patients With Temporal Lobe Epilepsy by Using the GE2REC Protocol
|
|
|
|
In: ISSN: 1662-5161 ; Frontiers in Human Neuroscience ; https://hal-cnrs.archives-ouvertes.fr/hal-03529823 ; Frontiers in Human Neuroscience, Frontiers, 2022, 15, ⟨10.3389/fnhum.2021.752138⟩ (2022)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
What’s Wrong with “What is your name?” > “Quel est votre nom?”:Teaching Responsible Use of MT through Discursive Competence and Metalanguage Awareness
|
|
|
|
In: L2 Journal, vol 14, iss 1 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Data and R codes for analyses on the spatial construal of TIME in Indonesian language and co-speech gestures ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Intraoperative Brain Mapping in Multilingual Patients: What Do We Know and Where Are We Going?
|
|
|
|
In: Brain Sciences; Volume 12; Issue 5; Pages: 560 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Brain-Inspired Audio-Visual Information Processing Using Spiking Neural Networks
|
|
Wendt, Anne. - : Auckland University of Technology, 2021
|
|
Abstract:
Artificial neural networks are one of the most popular and promising approaches to modern machine learning applications. They are based on a mathematical abstraction of the intricate processing mechanisms in the human brain, remaining sufficiently simple for efficient processing in conventional computers. Despite efforts to mimic the capabilities of the brain, however, they are limited in their contextual understanding of concepts and behaviours. With the aim to explore ways to overcome these limitations, this thesis endeavours to investigate alternatives that are closer to the original biological systems, with a focus on processing auditory and visual signals. Inspired by the functioning of human hearing and vision and by the brain’s capabilities to dynamically integrate newly perceived information with previous experiences and knowledge, this thesis presents the hypothesis that mimicking these processes more closely could lead to an enhanced analysis of such signals. The framework that was developed to investigate this hypothesis consisted of three separate but connected projects that looked into biologically inspired computational processing of auditory, visual, and combined audio-visual signals, respectively. One aim of designing the framework was to largely preserve the spectral, spatial, and temporal characteristics of the original signals through tonotopic and retinotopic mapping. For the auditory processing system, an encoding and mapping method was developed that could transform sound signals into electrical impulses (“spikes”) by simulating the human cochlea, which were then fed into a brain-shaped three-dimensional spiking neural network at the location of the auditory cortices. For the visual system, the method was developed analogously, simulating the human retina and feeding the resulting spikes into the location of the visual cortex. A key advantage of this approach was that it facilitated a straightforward brain-like combination of input signals for the analysis of audio-visual stimuli during the third project. The approach was tested on two existing benchmark datasets and on one newly created New Zealand Sign Language dataset to explore its capabilities. While the sound processing system achieved good classification results on the chosen speech recognition dataset (91%) compared to existing methods in the same domain, the video processing system, which was tested on a gesture recognition dataset, did not perform as well (51%). The classification results for the combined audio-visual processing model were between those for the individual models (76.7%), and unique spike patterns for the five classes could be observed. Even though the models created in this work did not exceed the statistical achievements of conventional machine learning methods, they demonstrated that systems inspired by biological and neural mechanisms are a promising pathway to investigate audio-visual data in computational systems. Increasing the biological plausibility of the models is expected to lead to better performance and could form a pathway to a more intuitive understanding of such data. To broaden the applicability of the model, it is suggested that future work include the addition of other sensory modalities or signals acquired through different brain recording and imaging methods and to perform further theoretical and statistical analysis of the relationship between model parameters and classification performance.
|
|
Keyword:
Gesture recognition; Machine learning; New Zealand sign language; Signal mapping; Speech recognition; Spiking neural networks
|
|
URL: http://hdl.handle.net/10292/14526
|
|
BASE
|
|
Hide details
|
|
|
| 6 |
Functional Topography of Auditory Areas Derived From the Combination of Electrophysiological Recordings and Cortical Electrical Stimulation
|
|
|
|
In: ISSN: 1662-5161 ; Frontiers in Human Neuroscience ; https://hal.archives-ouvertes.fr/hal-03351867 ; Frontiers in Human Neuroscience, Frontiers, 2021, 15, pp.702773. ⟨10.3389/fnhum.2021.702773⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Human cortical encoding of pitch in tonal and non-tonal languages.
|
|
|
|
In: Nature communications, vol 12, iss 1 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Functional maps of direct electrical stimulation-induced speech arrest and anomia: a multicentre retrospective study.
|
|
|
|
In: Brain : a journal of neurology, vol 144, iss 8 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Interactive mapping of language and memory with the GE2REC protocol
|
|
|
|
In: ISSN: 1931-7557 ; EISSN: 1931-7565 ; Brain imaging and behavior (Brain Imaging Behav) ; https://hal.univ-grenoble-alpes.fr/hal-03091631 ; Brain imaging and behavior (Brain Imaging Behav), Secaucus, NJ : Springer, In press, ⟨10.1007/s11682-020-00355-x⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Cross-dialectal diversity in Mukrī Kurdish I: phonological and phonetic variation [Online resource]
|
|
|
|
In: Journal of Linguistic Geography 9.2021 (2021) 1, 1-12
|
|
Linguistik-Repository
|
|
Show details
|
|
|
| 11 |
Die «Narrative Recherche» im kommunalen Kontext : eine diskursanalytische Case Study ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Age-related differences in the neural bases of phonological and semantic processes in the context of task-irrelevant information.
|
|
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Age-related differences in resolving semantic and phonological competition during receptive language tasks.
|
|
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Bihemispheric Navigated Transcranial Magnetic Stimulation Mapping for Action Naming Compared to Object Naming in Sentence Context
|
|
|
|
In: Brain Sciences ; Volume 11 ; Issue 9 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Preoperative Assessment of Language Dominance through Combined Resting-State and Task-Based Functional Magnetic Resonance Imaging
|
|
|
|
In: Journal of Personalized Medicine; Volume 11; Issue 12; Pages: 1342 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Raconter sa biographie langagière en la géolocalisant : le récit cartographique numérique comme outil de formation en didactique des langues secondes
|
|
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Preoperative Assessment of Language Dominance through Combined Resting-State and Task-Based Functional Magnetic Resonance Imaging ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Mapping Urban Linguistic Diversity in New York City: Motives, Methods, Tools, and Outcomes
|
|
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Defining meaningful units. Challenges in sign segmentation and segment-meaning mapping ; 1st International Workshop on Automatic Translation for Signed and Spoken Languages (AT4SSL 2021)
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
