← Search

Shikhar Vashishth

10 accepted papers

2024

A Morphology-Based Investigation of Positional Encodings

EMNLP 2024main

Contemporary deep learning models effectively handle languages with diverse morphology despite not being directly integrated into them. Morphology and word order are closely linked, with the latter incorporated into transformer-based models through positional encodings. This prompts a fundamental in…

Cited by 1SourcePDFScholar
2024

LinguaMeta: Unified Metadata for Thousands of Languages

COLING 2024main

We introduce LinguaMeta, a unified resource for language metadata for thousands of languages, including language codes, names, number of speakers, writing systems, countries, official status, coordinates, and language varieties. The resources are drawn from various existing repositories and suppleme…

Cited by 0SourcePDFScholar
2024

Multimodal Modeling for Spoken Language Identification

ICASSP 2024accepted

Spoken language identification refers to the task of automatically predicting the spoken language in a given utterance. Conventionally, it is modeled as a speech-based language identification task. Prior techniques have been constrained to a single modality; however in the case of video data there i…

Cited by 0SourceScholar
2023

Self-Influence Guided Data Reweighting for Language Model Pre-training

EMNLP 2023long main

Language Models (LMs) pre-trained with selfsupervision on large text corpora have become the default starting point for developing models for various NLP tasks. Once the pre-training corpus has been assembled, all data samples in the corpus are treated with equal importance during LM pre-training. H…

Cited by 0SourceScholar
2022

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

EMNLP 2022finding

Entity linking faces significant challenges such as prolific variations and prevalent ambiguities, especially in high-value domains with myriad entities. Standard classification approaches suffer from the annotation bottleneck and cannot effectively handle unseen entities. Zero-shot entity linking h…

Cited by 45SourcePDFScholar
2021

DialoGraph: Incorporating Interpretable Strategy-Graph Networks into Negotiation Dialogues

ICLR 2021poster

To successfully negotiate a deal, it is not enough to communicate fluently: pragmatic planning of persuasive negotiation strategies is essential. While modern dialogue agents excel at generating fluent sentences, they still lack pragmatic grounding and cannot reason strategically. We present DialoGr…

2021

Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network

ACL 2021long

Knowledge Graph (KG) completion research usually focuses on densely connected benchmark datasets that are not representative of real KGs. We curate two KG datasets that include biomedical and encyclopedic knowledge and use an existing commonsense KG dataset to explore KG completion in the more reali…

2020

Composition-based Multi-Relational Graph Convolutional Networks

ICLR 2020poster

Graph Convolutional Networks (GCNs) have recently been shown to be quite successful in modeling graph-structured data. However, the primary focus has been on handling simple undirected graphs. Multi-relational graphs are a more general and prevalent form of graphs where each edge has a label and dir…

Cited by 1247SourcecodeScholar
2019

Confidence-based Graph Convolutional Networks for Semi-Supervised Learning

AISTATS 2019poster

Predicting properties of nodes in a graph is an important problem with applications in a variety of domains. Graph-based Semi Supervised Learning (SSL) methods aim to address this problem by labeling a small subset of the nodes as seeds, and then utilizing the graph structure to predict label scores…

2019

Lovasz Convolutional Networks

AISTATS 2019poster

Semi-supervised learning on graph structured data has received significant attention with the recent introduction of Graph Convolution Networks (GCN). While traditional methods have focused on optimizing a loss augmented with Laplacian regularization framework, GCNs perform an implicit Laplacian typ…