publications

2026

1. JAIR

   Unified Approaches in Self-Supervised Event Stream Modeling: Progress and Prospects

   Levente Zólyomi, Tianze Wang, Sofiane Ennadir, Oleg Smirnov, and Lele Cao

   Journal of Artificial Intelligence Research, 2026

   DOI HTML PDF
2. ICLR

   Understanding Early Collapse in Predictive World-Model Pretraining

   Sofiane Ennadir^*, Levente Zólyomi^*, and Oleg Smirnov^*

   In ICLR 2026 Workshop on World Models, 2026

   *Equal contribution

   HTML PDF
3. ICML

   Nonlinear RNNs as a Compute Shortcut for Time Series Foundation Models

   Levente Zólyomi, David Stap, Sebastian Böck, Günter Klambauer, and Sepp Hochreiter

   In Foundational Models for Structured Data @ ICML 2026, 2026

   HTML
4. NeurIPS

   TiRex-2: Generalizing TiRex to Multivariate Data and Streaming

   Patrick Podest, Marco Pichler, Elias Bürger, Levente Zólyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian Böck, Günter Klambauer, and Sepp Hochreiter

   In NeurIPS 2026, 2026

   HTML PDF
5. arXiv

   On Subquadratic Architectures: From Applications to Principles

   Anamaria-Roberta Hartl^*, Levente Zólyomi^*, David Stap, Pieter-Jan Hoedt, Niklas Schmidinger, Lukas Hauzenberger, Sebastian Böck, Günter Klambauer, and Sepp Hochreiter

   arXiv preprint arXiv:2606.12364, 2026

   *Equal contribution

   HTML PDF

2025

1. NeurIPS

   Pool Me Wisely: On the Effect of Pooling in Transformer-Based Models

   Sofiane Ennadir^*, Levente Zólyomi^*, Oleg Smirnov, Tianze Wang, John Pertoft, Filip Cornell, and Lele Cao

   In NeurIPS 2025, 2025

   *Equal contribution

   HTML PDF

2024

1. TMLR

   Expressivity of representation learning on continuous-time dynamic graphs: An information-flow centric review

   Sofiane Ennadir, Gabriela Zarzar Gandler, Filip Cornell, Lele Cao, Oleg Smirnov, Tianze Wang, Levente Zólyomi, Björn Brinne, and Sahar Asadi

   Transactions on Machine Learning Research, 2024

   HTML PDF