Mohamed Elsayed
Dept. of Computing Science, University of Alberta
I am a PhD student at the RLAI lab, working with Rupam Mahmood. My research focuses on learning from a stream of experience. Humans and other animals keep improving through their interaction with the world, using each moment as it happens rather than recording it to revisit later. My goal is to build artificial agents that can do the same.
Today's deep learning systems, in contrast, depend on stored experience to retain knowledge, stabilize updates, and assign credit over time. I develop simple methods that do all three from the stream itself, spanning (1) continual learning without forgetting or losing the ability to learn, (2) deep reinforcement learning that learns reliably from one transition at a time, and (3) recurrent memory that learns from delayed feedback without backpropagating through the past. These methods are efficient enough for learning on real robots and even microcontrollers.
Prior to this, I completed my master's degree from the University of Alberta and my bachelor's degree in Communication and Information Engineering from Zewail City of Science and Technology, Egypt.
Outside of research: I'm passionate about photography. I also enjoy observing animal behavior and intelligence, particularly ravens.
news
| May 9, 2026 | Our paper led by Kris De Asis on extending differential temporal difference methods for episodic problems is accepted at RLC 2026. |
|---|---|
| May 9, 2026 | Our paper led by Arsalan Sharifnassab on intentional updates for deep streaming reinforcement learning is accepted at ICML 2026. |
| Jul 10, 2025 |
Our new paper on sequence learning from continuous streams of data is now released. |
| Oct 18, 2024 | Our paper on streaming deep reinforcement learning is now released. |
| Sep 25, 2024 | Our paper led by Gautham Vasan on deep policy gradient methods without batch updates, target networks, or replay buffers is accepted at NeurIPS 2024. |
| May 15, 2024 | Our paper on the role of weight clipping for deep continual and reinforcement learning is accepted at RLC 2024. |
| May 1, 2024 | Our paper on revisiting scalable Hessian diagonal approximations for applications in reinforcement learning is accepted at ICML 2024. |
| Jan 16, 2024 | Our paper on loss of plasticity and catastrophic forgetting is accepted at ICLR 2024. |
| Sep 1, 2022 | Started PhD in continual representation learning at the University of Alberta. |
| May 13, 2022 | Defended my MSc thesis on online representation search. |