← Search

Shen Ge

11 accepted papers

2023

Dialogue Medical Information Extraction with Medical-Item Graph and Dialogue-Status Enriched Representation

EMNLP 2023long findings

The multi-turn doctor-patient dialogue includes rich medical knowledge, like the symptoms of the patient, the diagnosis and medication suggested by the doctor. If mined and represented properly, such medical knowledge can benefit a large range of clinical applications, including diagnosis assistance…

Cited by 0SourceScholar
2022

DeltaNet: Conditional Medical Report Generation for COVID-19 Diagnosis

COLING 2022main

Fast screening and diagnosis are critical in COVID-19 patient treatment. In addition to the gold standard RT-PCR, radiological imaging like X-ray and CT also works as an important means in patient screening and follow-up. However, due to the excessive number of patients, writing reports becomes a he…

2022

End-to-end Spoken Conversational Question Answering: Task, Dataset and Model

NAACL 2022findings

In spoken question answering, the systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human seek or test their knowledge is via human conversations. Therefore, we propose a new Spoken Conversational Question An…

Cited by 37SourcePDFScholar
2022

Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations

NeurIPS 2022accept

Most video-and-language representation learning approaches employ contrastive learning, e.g., CLIP, to project the video and text features into a common latent space according to the semantic similarities of text-video pairs. However, such learned shared latent spaces are not often optimal, and the…

2022

Retrieve, Reason, and Refine: Generating Accurate and Faithful Patient Instructions

NeurIPS 2022accept

The "Patient Instruction" (PI), which contains critical instructional information provided both to carers and to the patient at the time of discharge, is essential for the patient to manage their condition outside hospital. An accurate and easy-to-follow PI can improve the self-management of patient…

2022

Towards Joint Intent Detection and Slot Filling via Higher-order Attention

IJCAI 2022poster

Recently, attention-based models for joint intent detection and slot filling have achieved state-of-the-art performance. However, we think the conventional attention can only capture the first-order feature interaction between two tasks and is insufficient. To address this issue, we propose a unifie…

2021

Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention

AAAI 2021technical

While Machine Comprehension (MC) has attracted extensive research interests in recent years, existing approaches mainly belong to the category of Machine Reading Comprehension task which mines textual inputs (paragraphs and questions) to predict the answers (choices or text spans). However, there ar…

Cited by 29SourcePDFScholar
2021

Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation

NeurIPS 2021poster

Medical report generation, which aims to automatically generate a long and coherent report of a given medical image, has been receiving growing research interests. Existing approaches mainly adopt a supervised manner and heavily rely on coupled image-report pairs. However, in the medical domain, bui…

Cited by 135SourcePDFScholar
2021

Competence-based Multimodal Curriculum Learning for Medical Report Generation

ACL 2021long

Medical report generation task, which targets to produce long and coherent descriptions of medical images, has attracted growing research interests recently. Different from the general image captioning tasks, medical report generation is more challenging for data-driven neural models. This is mainly…

2021

Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation

CVPR 2021poster

Automatically generating radiology reports can improve current clinical practice in diagnostic radiology. On one hand, it can relieve radiologists from the heavy burden of report writing; On the other hand, it can remind radiologists of abnormalities and avoid the misdiagnosis and missed diagnosis.…

Cited by 393PDFScholar
2020

Prophet Attention: Predicting Attention with Future Attention

NeurIPS 2020poster

Recently, attention based models have been used extensively in many sequence-to-sequence learning systems. Especially for image captioning, the attention based models are expected to ground correct image regions with proper generated words. However, for each time step in the decoding process, the at…

Cited by 77SourcePDFScholar