Text this: On the Thermal Transformer Performances