Crossmodales Lernen: Adaptivität, Prädiktion und Interaktion (SFB)
Human-Machine Interaction – Launched in January 2016, the Transregional Collaborative Research Centre (TRR) on "Crossmodal Learning" (CML) is positioned as an interdisciplinary cooperation between the existing fields of artificial intelligence, psychology and neuroscience, focused on establishing the topic of crossmodal learning as a new discipline. Our aim is therefore to establish our collaborative centre as the primary research vehicle at the focal point of this new discipline. Based on an extensive groundwork of collaborative research between Germany and China, this centre is jointly funded by the DFG (Deutsche Forschungsgemeinschaft) and the NSFC (Natural Science Foundation of China) as a new international collaboration between the University of Hamburg, the Medical Center Hamburg Eppendorf (UKE) and the three top universities in China (Tsinghua, Beijing Normal and Peking University) as well as the Institute of Psychology of the Chinese Academy of Sciences—all located in Beijing, China.The long-term goal of our research is to develop a framework describing the neural, cognitive and computational mechanisms of crossmodal learning. This framework will allow us to pursue the following primary sub-goals of the research programme: (1) to enrich our current understanding of the multisensory processes underlying the human mind and brain, (2) to create detailed formal models that describe crossmodal learning in both humans and machines, and (3) to build artificial systems for tasks requiring a crossmodal conception of the world.The term crossmodal learning refers to the adaptive, synergistic integration of complex perceptions from multiple sensory modalities, such that the learning that occurs within any individual sensory modality can be enhanced with information from one or more other modalities. Crossmodal learning is crucial for human understanding of the world, and examples are ubiquitous, such as: learning to grasp and manipulate objects; learning to read and write; learning to understand language; etc. In all these examples, visual, auditory, somatosensory or other modalities have to be integrated.
Institution
Mathematics, Informatics and Natural Sciences
Department
Informatik
Researcher
Prof. Dr. Jianwei Zhang
Project duration
seit 2016
External partner
Tsinghua University Beijing
Funded by
DFG
Links
Other projects
- Nicht-monetäre Erträge von Bildung in den Bereichen Gesundheit, nicht-kognitive Fähigkeiten sowie gesellschaftliche und politische Partizipation (Prof. Dr. Thomas Siedler)
- Evaluation des BGW-Konzeptes zu "Gesundsförderlicher Führung" (Führ' Gesund) (Dr. Sylvie Vincent-Hoeper)
- Flexibles Lernen unter Stress: Neurokognitive Mechanismen und klinische Implikationen (Prof. Dr. Tania Lincoln)
- Vermeidung von Zwangsmaßnahmen im psychiatrischen Hilfesystem (Prof. Dr. Tania Lincoln)
- Messung gesundheitsförderlicher Führung im Gesundheits- und Sozialwesen (Dr. Sylvie Vincent-Hoeper)
- Interdisziplinäre Konferenzreihe “String-Math” (Prof. Dr. Jörg Teschner)
- DGS-Korpus: Korpusbasiertes Wörterbuch Deutsche Gebärdensprache (DGS) (Thomas Hanke und Prof. Dr. Annika Herrmann)
- ARTISTIC – Valorization of Intangible cultural heritage (ICH). Assets for local sustainable development in CE Regions (Prof. Dr. Gertraud Koch)
- REdMig – nicht-monetäre Bildungserträge in Form sozialer Einbindung bei Personen mit und ohne Migrationshintergrund (Prof. Dr. Dr. h.c. Ingrid Gogolin)
- Wissenschaftliche Begleitung der Evaluation im Projekt "Schulmentoren – Hand in Hand für starke Schulen" (Prof. Dr. Julia Gerick)
- Disaster Management (Prof. Dr. Daniel Geiger)
- Environmental Protection during Armed Conflict (Anne Dienelt)
- Teilprojekt "Gleichstellung, Antidiskriminierung und Diversity Management in neuen Beschäftigungsformen" (Prof. Dr. Daniela Rastetter, Dr. Anna Mucha)
- Produktionen von Vielfalt – Eine Dispositivanalyse von Diversity (Management) in Organisationen (Dipl.-Soziologin Wiebke Frieß)
- Professional Identity and the Gender Gap in Risk-Taking. Evidence from a Field Experiment with Scientists (Prof. Dr. Moritz Drupp)
- "Formulae – Litterae – Chartae. Neuedition der frühmittelalterlichen Formulae inklusive der Erschließung von frühmittelalterlichen Briefen und Urkunden im Abendland (ca. 500 – ca. 1000)" (Prof. Dr. Philippe Depreux)
- Southern African Science Service Center for Climate Change and Adaptive Land Management (SASSCAL)/ Research Portfolio (Prof. Dr. Norbert Jürgens (Project coordinator))
- MECHAL - An integrated research approach to develop adaptive management strategies by small-scale farmers in semi-arid South Africa and Ethiopia under changing climatic and policy conditions (Dr. Ute Schmiedel)
- Arid Lands Restoration and Combat of Desertification: Setting Up a Drylands and Desert Restoration Hub (Dr. Ute Schmiedel)
- The Future Okavango (TFO) - Scientific support for sustainable land and resource management in the Okavango basin (Prof. Dr. Norbert Jürgens (project coordinator))
- INEL: „Grammatiken, Korpora und Sprachtechnologie für indigene nordeurasische Sprachen“ (Prof. Beáta Wagner-Nagy)
- Grand Challenges & New Forms of Organizing (Ali Aslan Gümüsay)
- Working Group Business and Human Rights Arbitration (Anne van Aaken, member of the drafting committee; Chair of the working Group, former ICJ Judge Bruno Simma, , )
- Hamburger Numeracy Projekt (Prof. Dr. Anke Grotlüschen (Projektleitung))
- Simulationspatienten in der medizinischen Ausbildung am UKE (SIMPAT) (Prof. Dr. med. Martin Scherer)
- Partizipation und Inklusion in demokratieorientierten Kitas (PInK) (Prof. Dr. Benedikt Sturzenhecker (Projektleitung))
- Indikatoren Berufliche Bildung für nachhaltige Entwicklung (IBBnE) (Prof. Dr. Werner Kuhlmeier, Sören Schütt-Sayed)
- Open Foresight zur strategischen Sicherstellung der Innovationsfähigkeit von KMU (Prof. Dr. Sebastian Späth)
- European Plasma Research Accelerator with eXcellence in Applications (Dr. Andreas R. Maier)
- Longitudinale Kohärenz am Freie-Elektronen-Laser – Kontrolle, Analyse und Anwendungen: X-Ray-Puls-Kompression an Freie-E (Dr. Andreas R. Maier)
- EnzymeStructures: Integrierter Webservices zur Unterstützung strukturbasierter, lebenswissenschaftlicher Forschung in Protein-Biochemie (Prof. Dr. Matthias Rarey)
- Development of a long-strand compressed panel based on East African highland bamboo (Prof. Dr. Jörg Ressel)
- Molecular design of improved production microalgae to accelerate the establishment of an algae-based bio-economy (Prof. Dr. Sigrun Reumann)
- Ultrakalte Atome in Wechselwirkung mit ultrakalten nanomechanischen Oszillatoren (Prof. Dr. Roland Wiesendanger, Prof. Dr. Klaus Sengstock, Dr. Christoph Becker, Dr. Alexander Schwarz)
- Climate-KIC Summer School (Prof. Dr. Annette Eschenbach)
- Laserinduzierten Elektronenbeugung von stark ausgerichteten und orientierten Molekülen (Prof. Dr. Jochen Küpper)
- Untersuchungen der Lastwechselfestigkeit von Target- und Kollimatormaterial (Prof. Dr. Gudrid Moortgat-Pick)
- Hybrid Organizing in & for Society (Ali Aslan Gümüsay)
- Humanities Centre for Advanced Studies "Futures of Sustainability: Modernization, Transformation, Control" (Prof. Dr. Sighard Neckel (Director), Prof. Dr. Frank Adloff (Director), Sören Altstaedt, Dr. Philipp Degens, Dr. Benno Fladvad, Martina Hasenfratz, Iris Hilbrich, Dr. Sarah Lenz)
- UHH-Patenschaft für SDG 9: Industrie, Innovation und Infrastruktur (Prof. Dr. Sebastian Späth)
- Videobasiertes Lernen durch Forschung zur Nachhaltigkeit: Student Crowd Research (SCoRe) (Prof. Dr. Gabi Reinmann)
- Information Governance Technologies (Prof. Dr. Tilo Böhmann, Prof. Dr. Hannes Federrath, Prof. Dr. Ingrid Schirmer, Prof. Dr. Judith Simon, Prof. Dr. Sibylle Schupp, Prof. Dr. Wolfgang Schulz, Dr. Martin Semmann, Christian Kurtz, Tobias Müller, Fabian Burmeister, Mattis Jacobs, Kai Bavendiek, Florian Wittner)
- Risikopraktiken im Finanzsektor und in der Politik (Jürgen Beyer)
- DFG-Kolleg-Forschungsgruppe „Zukünfte der Nachhaltigkeit: Modernisierung, Transformation, Kontrolle“ (Prof. Dr. Sighard Neckel (Kolleg Leitung), Prof. Dr. Frank Adloff (Kolleg Leitung), Sören Altstaedt, Dr. Philipp Degens, Dr. Benno Fladvad, Martina Hasenfratz, Iris Hilbrich, Dr. Sarah Lenz)
Center for a Sustainable University
Mittelweg 177
20148 Hamburg
www.nachhaltige.uni-hamburg.de