relAI with Women in AI & Robotics

Save the date for the next Women in AI & Robotics community meetup co-organized by relAI!

On May 14th, our co-director Gitta Kutyniok will talk about “Reliable AI: From Mathematical Foundations to Neuromorphic Computing”.  The second presentation of the event will be held by Elke Wolf, Professor from Hochschule München University of Applied Sciences, on “Professor at a University of Applied Sciences – an attractive option for empowered women”.

See you there! Admission is free, but signing up required.

Are you interested in frontier AI systems, their astonishing capabilities and risks for humanity? Then join us for a thought-provoking deep dive and exclusive OpenAI Live Q&A on AI safety. 

  • Date: Wednesday, May 8th, 2024 | 19:00 – 20:30 
  • Location: Room B006, Department of Mathematics (Theresienstr. 39) or online 
  • Language: English 


  • 19:00 – 19:05: Doors open 
  • 19:05 – 19:30: Introduction to AI Safety 
  • 19:30 – 20:15: Presentation & Live Q&A with OpenAI researcher Jan H. Kirchner, co-author of weak-to-strong generalization paper 
  • 20:15 – 20:30: Closing talk – What can we do? 
  • 20:30 – onward: Optional socializing and small group discussions with free drinks and snacks. 

Please register on the following webpage and prepare your questions! 

We are thrilled to share the outcomes of our recent student-driven event organized by Maria Matveev and Julius Hege from the Chair of Mathematical Foundations of Artificial Intelligence (LMU): the first relAI Safety hackathon held last weekend! This dynamic gathering brought together a mix of students and professionals interested in the field of AI Safety. 

Over the course of two intense days, participants delved into practical projects aimed at addressing various aspects of AI safety. Their projects ranged from adversarial prompting on a binary question data set, measuring the robustness of the responses, to a website to compare your own emotional intelligence and bias to large language models such as Llama and ChatGPT. The latter project is publicly available, and you can try it out here:  

The atmosphere at the hackathon was inspiring, with enthusiastic participants exchanging ideas, insights and experiences on how to enhance the reliability and safety of AI. The event provided a great opportunity for attendees not to only work on innovative projects, but also to engage in thought-provoking discussions surrounding the ethical implications and potential risks associated with AI. Looking forward to more engaging events! 

Social media links of the event: X & LinkedIn

We are honored to announce that the Zuse Schools of Excellence in AI have been featured in the AI action plan of the German Federal Ministry of Education and Research ("BMBF-Aktionsplan Künstliche Intelligenz")! 

This strategic plan aims to significantly advance AI research, development, and application in Germany. It emphasizes strengthening Germany's position in the global AI landscape. This is done by enhancing research infrastructure and transfer, facilitating AI integration into various sectors such as healthcare, fostering a dialogue on the societal and ethical implications of AI and ensuring AI competencies at all levels in the long term. Notably, the BMBF has committed over 1.6 billion Euros to this AI action plan.  

Being explicitly named in this influential plan highlights the dedication of the three Zuse Schools including relAI, to fostering ethical, reliable AI innovations and preparing the next generation of AI leaders. 

A huge thank you to our supporters, partners, fellows, and students for making this milestone possible!  

Day 2 of the 2023 relAI retreat combined inspiring keynote talks by relAI fellows Sandra Hirche (“Learning Controls with Guarantees”) and Johannes Maly (“Implicit regularization of training algorithms and resource efficiency”) with more sessions of lightning talks and two rounds of group discussions, a new activity introduced for the first time during this year's retreat.

The first group discussion session dealt with research topics suggested by fellows and students. The presentations of the discussions’ outcomes showed the intensity and depth with which these discussions had been conducted. The second round of discussions focused on relAI organizational topics such as the relAI Blog and Alumni and were very productive. They were presented on the last day of the retreat with amazing outcomes, including a newly founded student committee to coordinate the new relAI blog, and a student representative responsible for building a relAI alumni network. The election of new student representatives and IDP discussion sessions rounded off two very successful days.

Although the weather was very much November-like, everyone enjoyed the talks, fruitful discussions and social activities in this great location. The preparations for the next retreat have already started; it will take place in summer 2024 and we’re looking forward to gathering the relAI family again.

From November 16th to November 18th, the relAI family gathered at the Yachthotel Chiemsee for its second retreat.

The retreat started on the 16th with a warm opening by our two directors, Stephan Günnemann and Gitta Kutyniok. Afterwards, the relAI fellow Debarghya Ghoshdastidar gave the first keynote talk about “Over-parameterization and Over-fitting: Myths, theory and tools” followed by a very lively discussion around this topic.

Day One´s program concluded with a highlight of this year's retreat, a round of lightning talks, where each of our students introduced themselves and their research focus in one minute. Spread over the two days of the retreat, the one minute presentations together with the social interactions resulted in everyone having a very good idea about what interests all the other students have.

On the 11th and 12th of October, relAI welcomed the new cohort of relAI Master and Doctoral students. The event included informative sessions about relAI and networking activities. At the Munich Data Science Institute (MDSI), TUM, the relAI directors and coordinators presented the relAI program to the new students. The first relAI cohort of students organised a lively interactive session (photo) to welcome and get to know the new students.

On 14 September, the Munich Data Science Institute (MDSI, TUM) celebrated its official opening at the Science Congress Center in Garching. The event included inaugural words by the Bavarian State Minister for Science and the Arts, M. Blume, and the TUM President, Prof. Dr. T. Hofmann. Top-class scientific lectures from MDSI Members, presentations of outstanding MDSI projects, a panel discussion, and a poster session rounded the program. 

The Konrad Zuse School of Excellence in Reliable AI (relAI), a joint project between TUM and LMU funded by DAAD, which had been initiated through an MDSI Focus Topic, was one of the projects highlighted at the opening. relAI Coordinator Dr. Andrea Schafferhans introduced relAI to the audience, giving an excellent overview of its educational and research programs as well as its people. relAI was also widely represented at the poster session by relAI Master students and PhD researchers from the TUM University, who discussed their research projects with the numerous guests of the event, among them, MDSI partners and representatives from industry and other research institutions.

The photo gallery shows memorable moments of our opening ceremony.

The Grand Opening of our Konrad Zuse School in Reliable AI was a great success. Welcome addresses by TUM Senior Vice President Prof. Dr. Gerhard Kramer, LMU Vice President Prof. Dr. Francesca Biagini and DAAD Secretary General Dr. Kai Sicks inaugurated the event. Afterward, State Minister Markus Blume honored us with the keynote address. Our directors Prof. Dr. Stephan Günnemann and Prof. Dr. Gitta Kutyniok introduced relAI to our guests from politics, science, and industry. The representatives of relAI academic, industry partners, and fellows Prof. Dr. Phillip Grohs (University of Vienna), Prof. Dr. Fabian Theis (TUM), Dr. Peter Lehnert (BMW), and Prof. Dr. Frauke Kreuter (LMU) presented our four research Focus Areas "Mathematical and Algorithmic Foundations", "Medicine and Healthcare", "Robotics and Interacting Systems", and "Algorithmic Decision Making". 

The celebration concluded with a reception combined with a poster session, where our students showed their research projects. A big thank you to everyone who contributed to presenting relAI and to everyone who joined us to celebrate the first successful steps of our school.