Pavel Rumiantsev
PhD Student
Hello there!
I am a PhD students under supervision of Prof. Mark Coates. My research interests are dynamically routed neural networks, mixtures of experts and large language models.
I have industry experience of collaborative work on big machine learning projects. My experience is mostly related to graph neural networks, computer vision and reinforcement learning.
My current research projects include (1) more efficient routing system for diverse experts, and (2) enhanced in-context interference for LLMs, that will allow LLM to answer question without confusion from irrelevant context.