Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization
Large language models (LLMs) have exhibited considerable cross-lingual generalization abilities, whereby they implicitly transfer knowledge across languages. However, the transfer is not equally successful for all languages, especially for low-resource ones, which poses an ongoing challenge. It is u…