Hiteshi Jain

qa-FLoRA: Data-free query-adaptive Fusion of LoRAs for LLMs

The deployment of large language models for specialized tasks often requires domain-specific parameter-efficient finetuning through Low-Rank Adaptation (LoRA) modules. However, effectively fusing these adapters to handle complex, multi-domain composite queries remains a critical challenge. Existing