Faget Transformers