← Search

Yanna Ma

4 accepted papers

2024

Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model

EMNLP 2024main

Although most current large multimodal models (LMMs) can already understand photos of natural scenes and portraits, their understanding of abstract images, e.g., charts, maps, or layouts, and visual reasoning capabilities remains quite rudimentary. They often struggle with simple daily tasks, such a…

2023

An Expression Tree Decoding Strategy for Mathematical Equation Generation

EMNLP 2023long main

Generating mathematical equations from natural language requires an accurate understanding of the relations among math expressions. Existing approaches can be broadly categorized into token-level and expression-level generation. The former treats equations as a mathematical language, sequentially ge…

Cited by 0SourceScholar
2022

A Closed-Loop Perception, Decision-Making and Reasoning Mechanism for Human-Like Navigation

IJCAI 2022poster

Reliable navigation systems have a wide range of applications in robotics and autonomous driving. Current approaches employ an open-loop process that converts sensor inputs directly into actions. However, these open-loop schemes are challenging to handle complex and dynamic real-world scenarios due…

2022

Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem

EMNLP 2022finding

Math word problem solver requires both precise relation reasoning about quantities in the text and reliable generation for the diverse equation. Current sequence-to-tree or relation extraction methods regard this only from a fixed view, struggling to simultaneously handle complex semantics and diver…