Students
On the latest TV episode of “Neuland” by BR - Bayerischer Rundfunk, relAI PhD student Sarah Ball shares her insights about fundamental issues surrounding a central theme of relAI: “responsibility in AI systems.” She addresses topics such as when AI might reinforce discrimination and how to ensure that AI systems align with human values.
Here is a short clip from the conversation and the link to the full video: https://www.ardmediathek.de/video/Y3JpZDovL2JyLmRlL2Jyb2FkY2FzdC9GMjAyNVdPMDA5MzQ2QTA
Last week, our industry partner QuantCo generously hosted over 30 relAI students at its offices in Munich. The visit provided a valuable platform for our students and QuantCo colleagues to connect, fostering a friendly environment for discussions on potential future collaborations.
We extend our sincere gratitude to QuantCo for their warm welcome and for facilitating such a beneficial exchange!
We are excited to announce that the call for applications to the MSc program 2025 of our Konrad Zuse School of Excellence in Reliable AI (relAI) is now open!
The novel, innovative relAI MSc program is an addition to the MSc program at TUM or LMU, offering a cross-sectional training for successful education in AI. It provides a coherent, yet flexible and personalized training by enhancing scientific knowledge, professional development courses and industrial exposure.
Funded applicants will receive a scholarship of up to 992 EUR (depending on independent income). They are further supported by travel grants, e.g., for home travel.
We highly encourage you to apply if you have:
📆 Application Deadline: 17 June 2025 (23:59 AOE)
🔗 Apply now: https://zuseschoolrelai.de/application/#MSc-Program-Application
Please help us in spreading the word, especially to excellent international candidates.
The excellent work of relAI students will be prominently represented at the Thirteenth International Conference on Learning Representations (ICLR) 2025, which will take place at the Singapore EXPO from 24 to 28 April 28 2025.
Thirteen publications from our students will be presented at the conference, nine of them in the main track. Notably, four out of these nine publications have been selected for Oral or Spotlight presentations. This is a significant achievement and demonstrates the high quality of relAI research, considering that only 15% of accepted papers are invited to give a talk.
If you plan to attend the conference, do not miss the opportunity to discuss these publications directly with some of our students. Be sure to attend the Oral presentation by Yan Scholten titled "A Probabilistic Perspective on Unlearning and Alignment for Large Language Models" on the 24th April. You can learn about Lisa Wimmer´s work, "Trust Me, I Know the Way: Predictive Uncertainty in the Presence of Shortcut Learning" at the Workshop on Spurious Correlation and Shortcut Learning: Foundations and Solutions. Additionally, check out the posters of Amine Ketata and Chengzhi Hu!. Amine will be presenting his work on “Lift Your Molecules: Molecular Graph Generation in Latent Euclidean Space” and you can talk to Chengzhi Hu about “Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation”.
Full list of relAI publications at ICLR 2025:
Oral Presentation - Main Track
Spotlight Presentation - Main Track
Posters - Main Track
Workshops
🎉The 8th edition of DataFest Germany will be held at Ludwig-Maximilians-Universität in Munich from 28 March to 30 March 2025. relAI is proud to support the event organization again this year. Additionally, a team of relAI students will participate in this exciting competition and networking opportunity.
The event is an annual data-driven competition, commonly referred to as a “hackathon,” that alternates between Mannheim and Munich. It is organized in collaboration with partners from industry and research institutions.
Datafest Germany is a celebration that follows upon the model DataFest™, organized by the American Statistical Association. The world's first DataFest took place at the University of California in 2011. Since then, many universities took up the DataFest format.
Learn more about DataFest Germany in this link.
This month, a team of 13 talented master and PhD students from our graduate school in reliable AI (relAI) showcased their quantitative skills and teamwork in an exciting estimation competition. The participants had 30 minutes to work on 13 estimation challenges, such as "What is the average discharge of the Isar when it meets the Donau in m^3/s?"
The spirit of competition and learning was truly inspiring. Check out the photo of our team, proudly representing relAI.
The recent relAI Collab Accelerator Workshop brought together researchers to share their work, explore new ideas, and identify potential collaborations. Here's a brief overview of the event:
The day began with the participants pitching their research topic from 9:00 to 11:00, followed by a coffee break until 11:15. After the break, participants engaged in one-to-one sessions until 14:00, followed by lunch, discussion, and feedback.
Participants contributed diverse topics in the field of Machine Learning and Artificial Intelligence. Mohamed Amine Ketata discussed Generative AI for Graphs, Max Beier presented on Learning Operator of Dynamical Systems, Richard Schwank explored Robust Aggregation through the Geometric Median, and Yurou Liang delved into Differentiable Learning for Causal Discovery.
The workshop was fertile ground for generating new research ideas and possible collaborations. During the one-to-one discussions, participants identified several projects for cooperation, such as principled modifications of loss functions to enhance robustness against outlier data rows.
Participants gained new insights into their research during the event. For example, one participant discovered a probabilistic approach to their forecasting issue without relying on a model. Another learned about structure learning as it applies to tabular data, which provided a temporal interpretation of the data. One researcher was challenged about the convexity of their problem. Discussions highlighted intriguing applications of median aggregation techniques to abstract spaces, connecting concentration inequalities with uncertainty quantification.
The relAI Collab Accelerator Workshop was an enriching experience, offering a platform for researchers to connect, share insights, and pave the way for future collaborations. The feedback during this first iteration will help refine the format and make it even more engaging. We are looking forward to the next iteration!
relAI thanks Max Beier and Richard Schwank for their initiative and the organization of the event.
Congratulations!
The recent work of relAI PhD student Lukas Gosch has won the Best Paper Award at the 3rd AdvML-Frontiers workshop at the 38th Annual Conference on Neural Information Processing Systems (NeurIPS 2024). The workshop and paper presentation took place at the Vancouver Convention Center in Canada on December 14th, 2024.
Lukas is a PhD student at relAI, advised by the relAI Co-Director Prof. Dr. Stephan Günnemann. His research focuses on robust and reliable machine learning, as well as machine learning on graphs.
The award-winning paper „Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks“, that Lukas authored together with Mahalakshmi Sabanayagam and relAI Fellows Debarghya Ghoshdastidar and Stephan Günnemann, develops the first architecture-aware certification technique for common neural networks against poisoning and backdoor attacks.
Explore this outstanding paper here.
Our sincerest congratulations to Lukas and his co-authors on this achievement!
We are excited to announce that the call for applications to the PhD program 2025 of our Konrad Zuse School of Excellence in Reliable AI (relAI) is now open!
The novel, innovative PhD relAI program offers a cross-sectional training for successful education in AI including scientific knowledge, professional development courses and industrial exposure, providing a coherent, yet flexible and personalised training.
Funded applicants will receive a full salary for three years, including social benefits (TV-L E13 of the German public sector). They are further supported by travel grants, e.g. for conference attendance, research stays or home travel. Doctoral students are hosted by a relAI Fellow who helps them to define their research project. Depending on the affiliation of this hosting fellow they enrol at TUM or LMU.
We highly encourage you to apply if you have:
📆 Application Deadline: January 13th, 2025
🔗 Apply now: www.zuseschoolrelai.de/application
Please help us in spreading the word, especially to excellent international candidates.
Congratulations! relAI student Sameer Ambekar wins the best paper award at the MICCAI Workshop on Advancing Data Solutions in Medical Imaging AI (ADSMI).
Sameer is a PhD student at relAI, advised by the relAI Fellow Julia A. Schnabel. His research focusses on test-time adaptation and domain generalization for medical imaging.
His award-winning paper “Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representations”, co-authored with Julia A. Schnabel and Cosmin Bereca, presents a novel zero-shot methodology to adapt models in real time to test images from new domains using deep pre-trained features. The approach is validated on brain anomaly detection data.
This work addresses domain shift at test-time, which Sameer explains in more detail in his recently published relAI blog post. In the post, you can also learn about the importance of handling domain shifts to make AI more reliable: https://zuseschoolrelai.de/blog/mitigating-domain-shifts/
Congratulations on this achievement!