This model is a version XLM-RoBERTa with embeddings and vocabulary reduced to most frequent tokens in English and Russian.