Antreas Antoniou

Research Associate in Machine Learning, interested in the intersection of multi-modal learning and meta-learning.

I serve as a Research Associate in Machine Learning at the University of Edinburgh, supervised by Prof. Amos Storkey. I am affiliated with the BayesWatch research group and the Adaptive and Neural Computation (ANC) research institute.

Overarching Theme

My overarching goal is to emulate the trajectory of human-like representation learning, starting from foundational representations akin to those seen in human infants but without requiring eons of evolutionary fine-tuning. This serves as a springboard for my broader research ambition: to investigate how these infant-like representations can be fine-tuned in concert with higher-level abstract concepts to pave the way for general artificial intelligence systems. To achieve this, my research focuses on scalable, data-efficient, and generalizable self-supervised learning techniques in a multi-modal setting. I integrate insights from neuroscience and evolutionary computation to explore optimal learning sequences and curricula, paying close attention to architectural choices and their corresponding training recipes.

Research Focus

Leading my research interests is Multi-Modal Learning, specifically targeting the synergistic integration of text, images, audio, and video data. This is followed by the development of Self-Supervised Methods, inspired by mechanisms of infant learning and principles of evolutionary computation.

Additional key areas include Meta-Learning, Adversarial Learning, and Optimization Techniques Inspired by Evolutionary Optimization. These are applied across both differentiable and gradient-free optimization paradigms. Other relevant research dimensions include Inductive Biases, Scalability, Computational Efficiency, and Memory-Augmented Neural Networks.

Research Philosophy

Operating within a pragmatic framework, my research aims to identify high-leverage focal points conducive to in-depth investigation. This allows for the efficient allocation of both computational and cognitive resources. In line with both evolutionary tenets and the Pareto Principle, my methodology can be seen as focusing on the “fittest” 20% of research avenues likely to contribute 80% of impactful results.