Mathematical and Algorithmic Foundations
Reliability of AI with all its facets can only be achieved through a profound understanding of its foundations. In fact, the current gap between theory and practice of AI methodologies is one of the key obstacles for deriving comprehensive guarantees as required by critical applications. Supporting our goal of reliable AI, the general research challenges we aim to address are twofold.
Firstly, we aim to establish theoretical guarantees for AI. This includes expressivity of AI models, analysis of learning algorithms, generalization capabilities of trained AI systems, and aspects such as robustness, aiming predominantly at concrete error bounds and certification. A particular challenge are novel and highly complex architectures such as graph neural networks or transformers.
Secondly, to support reliability, we research algorithmic foundations of AI on relevant topics, such as IT security, federated learning, distributed systems, and causal modeling, thereby ensuring a tight link to the application domains and their practical realization.
Fellows in Mathematical and Algorithmic Foundations
Interpretable and Reliable Machine Learning (TUM)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Data Science and Intelligent Systems (TUM, Helmholtz AI)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Algorithmic Decision-Making
Decentralized Systems Engineering (TUM)
Mathematical & Algorithmic Foundations
Robotics & Interacting Systems
Statistical Learning & Data Science (LMU)
Mathematical & Algorithmic Foundations
Computer Vision and Artificial Intelligence (TUM)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Robotics & Interacting Systems
Mathematical Statistics (TUM)
Mathematical & Algorithmic Foundations
Efficient Learning and Probabilistic Inference for Science (Helmholtz AI)
Mathematical & Algorithmic Foundations
Theoretical Foundations of AI (TUM)
Mathematical & Algorithmic Foundations
Data Analytics & Machine Learning (TUM)
Mathematical & Algorithmic Foundations
Machine Learning (TUM)
Mathematical & Algorithmic Foundations
Artificial Intelligence & Machine Learning (LMU)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Responsible Data Science (TUM)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Social Data Science and Statistical Learning (LMU)
Mathematical & Algorithmic Foundations
Ethics in Systems Design & Machine Learning (TUM, Helmholtz)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Mathematical Foundations of AI (LMU)
Mathematical & Algorithmic Foundations
Mathematical Data Science (LMU)
Mathematical & Algorithmic Foundations
Computer Vision & Learning (LMU)
Mathematical & Algorithmic Foundations
Department of Statistics (LMU)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Philosophy of Science (LMU)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
AI has the potential to fundamentally transform the future of medicine and healthcare by enabling earlier and more accurate diagnosis and better treatment, leading to improved outcomes for patients and increased efficiency in healthcare. The emergence of AI for medicine and healthcare also offers a number of transformative opportunities for economic growth. Examples cover prevention and early detection, e.g. AI for wearable devices as well as AI for screening (e.g. mammography). In relAI, we combine the expertise in AI healthcare and medicine to successfully tackle these challenges.
A key requirement for the successful deployment of AI in clinical environments is the development of safe, secure, and trustworthy ML techniques. In particular, advances are required in robust and data efficient learning, privacy preservation, and interpretable deep learning.
Fellows in Medicine & Healthcare
Data Science and Intelligent Systems (TUM, Helmholtz AI)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Algorithmic Decision-Making
Ethics in Medicine and Health Technologies (TUM)
Computer Vision and Artificial Intelligence (TUM)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Robotics & Interacting Systems
AI-Supported Therapy Decisions (LMU)
Medicine & Healthcare
Robotics & Interacting Systems
Clinical Data Science (LMU)
Ethics in Systems Design & Machine Learning (TUM, Helmholtz)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Robotics and Systems Intelligence (TUM, MIRMI)
Medicine & Healthcare
Robotics & Interacting Systems
Computational Imaging and Inverse Problems (TUM)
AI for Health (LMU, Helmholtz)
Computer Aided Medical Procedures & Augmented Reality (TUM)
AI in Healthcare & Medicine (TUM)
Computational Imaging & AI in Medicine (TUM, Helmholtz)
Health Informatics (TUM)
Conservative Dentistry, Periodontology and Digital Dentistry (LMU)
Medicine & Healthcare
Algorithmic Decision-Making
Mathematical Modelling of Biological Systems (TUM)
AI-based telemonitoring (LMU)
Artificial Intelligence in Medical Imaging (TUM)
AI for Image-Guided Diagnosis and Therapy (TUM)
Robotics & Interacting Systems
Engineers and computer scientists are currently developing autonomous systems with AI techniques as a core component. This provides endless possibilities but also comes with enormous challenges regarding safety, security, and privacy. For example, how to guarantee safety of an autonomous agent (e.g., a robot in a human environment) under all circumstances, given that a designer cannot foresee all situations the agent will face in the future? How to balance the advantages of AI cloud computing with the increased risk of security violations? How to leverage data to adapt to the needs of a human user while bearing privacy concerns in mind? To answer such questions, relAI will focus on safe, secure, and privacy-preserving AI in the context of autonomous agents and interacting systems.
Fellows in Robotics & Interacting Systems
Sensor Based Robotic Systems & Intelligent Assistance Systems (TUM) German Aerospace Center (DLR) I. Robotics & Mechatronics
Robotics & Interacting Systems
Cyber Physical Systems (TUM)
Robotics & Interacting Systems
AI Processor Design (TUM)
Robotics & Interacting Systems
Algorithmic Decision-Making
Decentralized Systems Engineering (TUM)
Mathematical & Algorithmic Foundations
Robotics & Interacting Systems
Human-Computer-Interaction (LMU)
Robotics & Interacting Systems
Computer Vision and Artificial Intelligence (TUM)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Robotics & Interacting Systems
AI-Supported Therapy Decisions (LMU)
Medicine & Healthcare
Robotics & Interacting Systems
Information-oriented Control (TUM)
Robotics & Interacting Systems
Natural Language Processing (LMU)
Robotics & Interacting Systems
Human-Centered Technologies for Learning (TUM)
Robotics & Interacting Systems
Learning & Instruction
AI Planning in Dynamic Environments (TUM)
Robotics & Interacting Systems
Algorithmic Decision-Making
Robotics and Systems Intelligence (TUM, MIRMI)
Medicine & Healthcare
Robotics & Interacting Systems
Intelligent Bio-Robotic Systems (TUM, MIRMI)
Robotics & Interacting Systems
Human-Centered Ubiquitous Media (LMU)
Robotics & Interacting Systems
Performance and Reliability for Learning Systems (TUM)
Robotics & Interacting Systems
Computational Linguistics (LMU)
Robotics & Interacting Systems
Algorithmic Decision-Making
Ever more applications in AI consider prescriptive modeling in the sense of learning a model that stipulates appropriate decisions or actions to be taken in real-world scenarios: Which medical therapy should be applied? Should this person be hired for the job? Decisions of that kind are increasingly automated and made by algorithms instead of humans, often relying on AI methods. Our ambition is to develop AI-based methodologies for reliable algorithmic decision-making (ADM).
This comes with the need to address specific technical issues such as the lack of an objective “ground truth” underlying every prediction, and learning from partial training information, comprising feedback about the decision made, while lacking information about counterfactuals. Methodological research on ADM will be complemented by more application-oriented research on reliable decisions in business and management.
Fellows in Decision-Making
Interpretable and Reliable Machine Learning (TUM)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
AI Processor Design (TUM)
Robotics & Interacting Systems
Algorithmic Decision-Making
Data Science and Intelligent Systems (TUM, Helmholtz AI)
Mathematical & Algorithmic Foundations
Medicine & Healthcare
Algorithmic Decision-Making
AI in Management (LMU)
Algorithmic Decision-Making
Artificial Intelligence & Machine Learning (LMU)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Responsible Data Science (TUM)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Statistics in Economics, Business Administration and Social Sciences (LMU)
Algorithmic Decision-Making
AI Planning in Dynamic Environments (TUM)
Robotics & Interacting Systems
Algorithmic Decision-Making
Statistics & Data Science in Social Sciences & the Humanities (LMU)
Algorithmic Decision-Making
AI & Computational Linguistics (LMU)
Algorithmic Decision-Making
Department of Statistics (LMU)
Mathematical & Algorithmic Foundations
Algorithmic Decision-Making
Conservative Dentistry, Periodontology and Digital Dentistry (LMU)
Medicine & Healthcare
Algorithmic Decision-Making
Database Systems & Data Mining (LMU, Siemens)
Algorithmic Decision-Making
Learning & Instruction
This research area explores how reliable AI can transform learning and teaching through intelligent tutoring systems, digital learning assistants, and adaptive feedback mechanisms. It addresses the robustness and pedagogical effectiveness of such systems, particularly in the face of incomplete or biased data. Central challenges include ensuring privacy, fairness, and responsibility in data-intensive educational contexts, as well as understanding the broader effects of AI on learners and teachers. A special focus lies on explainability and trust, investigating how transparent and pedagogically meaningful communication of AI-driven actions can foster agency and metacognitive skills. By combining expertise from AI methodology, learning sciences, and education research, this area creates strong synergies with relAI’s other domains, ranging from fair assessment and robust learner modeling to socially interactive learning environments and simulation-based training in medicine.
Fellows in Learning & Instruction
Human-Centered Technologies for Learning (TUM)
Robotics & Interacting Systems
Learning & Instruction
Physics Education Research (LMU)