We work on advancing science and AI research in the following areas.

Artificial General Intelligence
General purpose multimodal agents with universal inputs and outputs.

Self-improving Agents
Proactive agents of knowledge that continuously self-improve and stay updated without supervision.

Internationalization
AI for everyone regardless of background, cultural, and social norms.

Efficiency
AI that can be deployed in a cost-efficient manner effectively and efficiently.

Past Research

Prior to Reka, our team has been involved in some of the greatest breakthroughs in AI.

AlphaStar (Nature, DeepMind Blog)
Co-authored by Dani Yogatama

AlphaCode (Science, DeepMind Blog)
Co-authored by Cyprien de Masson d’Autume

Bard (Sundar Pichai’s Blogpost)
Yi Tay as core contributor

DeepSpeech-2 (Paper)
Co-authored by Dani Yogatama

Gopher: Scaling Language Models: Methods, Analysis and Insights from Training Gopher (DeepMind Blog)
Co-authored by Cyprien de Masson d’Autume

Gmail Smart Reply (Paper)
Led by Matt Henderson

Flan-2: Scaling Instruction Finetuned Models (Google AI Blog)
Co-authored by Yi Tay as core contributor

LASER: Language-Agnostic SEntence Representations (Meta AI Blog, Paper)
Led by Mikel Artetxe

MoE-LM: Efficient Large Language Modeling with Mixture of Experts (Paper)
Co-led by Mikel Artetxe

OPT: Open Pretrained Transformer Language Models (Paper)
Co-authored by Mikel Artetxe

PaLM: Scaling Language Modeling with Pathways (Google AI Blog)
Co-authored by Yi Tay

PaLM-2: Technical Report (Announcement at Google I/O)
Co-led by Yi Tay (modeling & architecture)

PaLI-X: On Scaling up a Multilingual Vision and Language Model (Paper)
Co-authored by Yi Tay

UL2: Unifying Language Learning Paradigms (Google AI blog, Flan-UL2 release)

Co-led by Yi Tay

Unsupervised Machine Translation (Paper 1, Paper 2, Paper 3)
Led by Mikel Artetxe

Task-Oriented Dialogue (Paper 1, Paper 2)
Led by Qi Liu

ViT-22B: Scaling Vision Transformers to 22B Parameters (Google AI Blog).
Co-authored by Yi Tay

XGLM: Few Shot Learning with Multilingual Language Models (Paper)
Co-authored by Mikel Artetxe