← Search

Achyut Mani Tripathi

2 accepted papers

2025

Semi-Supervised Knowledge Distillation Framework towards Lightweight Large Language Model for Spoken Language Translation

ICASSP 2025accepted

Even though large language models (LLMs) have demonstrated remarkable performance across various natural language processing tasks, their application in speech-related tasks has largely remained underexplored. This work addresses this gap by incorporating acoustic features into an LLM which can be f…

Cited by 0SourceScholar
2023

Sub-Band Contrastive Learning-Based Knowledge Distillation For Sound Classification

ICASSP 2023accepted

Knowledge distillation(KD) technique is widely known for its outstanding ability to train a compact student model under supervision of a cumbersome pre-trained teacher network. The traditional KD technique focuses only on distilling dark knowledge using logits of a teacher network while neglecting t…

Cited by 0SourceScholar