Maria Elkjær Montgomery

How Should Transformers Represent Numeric Values in Electronic Health Records?

How do we map numeric values to representations in transformer-based sequence processing, particularly in electronic health record (EHR) data? We systematically compare discrete, continuous, and hybrid value embeddings using synthetic arithmetic tasks embedded within real-world EHR data, as well as …