Alternatives to DistilGPT-2

Options that appear in the same research papers as DistilGPT-2, by co-occurrence.

AlternativePapers (with DistilGPT-2)Avg viability
LoRA1
DistilBERT1
TinyT51