Geometric Algebra Transformer: A study on equivariance and optimization for transformers

📈 Implementation of the famous Geometric Algebra Transformer to deal with geometric data. A modification of its attention module has been performed to study the equivariance of the architecture.