How do we Responsibly Democratize Transformers, the Most Impactful Tech of the Decade?