← Search

Jitin Krishnan

2 accepted papers

2024

Representation Deficiency in Masked Language Modeling

ICLR 2024poster

Masked Language Modeling (MLM) has been one of the most prominent approaches for pretraining bidirectional text encoders due to its simplicity and effectiveness. One notable concern about MLM is that the special $\texttt{[MASK]}$ symbol causes a discrepancy between pretraining data and downstream da…

2022

SMARTAVE: Structured Multimodal Transformer for Product Attribute Value Extraction

EMNLP 2022finding

Automatic product attribute value extraction refers to the task of identifying values of an attribute from the product information. Product attributes are essential in improving online shopping experience for customers. Most existing methods focus on extracting attribute values from product title an…