← Search

Songming Liu

9 accepted papers

2025

RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation

ICLR 2025poster

Bimanual manipulation is essential in robotics, yet developing foundation models is extremely challenging due to the inherent complexity of coordinating two robot arms (leading to multi-modal action distributions) and the scarcity of training data. In this paper, we present the Robotics Diffusion Tr…

2024

DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training

ICML 2024poster

Pre-training has been investigated to improve the efficiency and performance of training neural operators in data-scarce settings. However, it is largely in its infancy due to the inherent complexity and diversity, such as long trajectories, multiple scales and varying dimensions of partial differen…

2024

Fourier Controller Networks for Real-Time Decision-Making in Embodied Learning

ICML 2024poster

Transformer has shown promise in reinforcement learning to model time-varying features for obtaining generalized low-level robot policies on diverse robotics datasets in embodied learning. However, it still suffers from the issues of low data efficiency and high inference latency. In this paper, we…

2024

PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs

NeurIPS 2024poster

While significant progress has been made on Physics-Informed Neural Networks (PINNs), a comprehensive comparison of these methods across a wide range of Partial Differential Equations (PDEs) is still lacking. This study introduces PINNacle, a benchmarking tool designed to fill this gap. PINNacle pro…

2024

Reference Neural Operators: Learning the Smooth Dependence of Solutions of PDEs on Geometric Deformations

ICML 2024poster

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a sufficiently accurate neural operator. However, for many in…

Cited by 2SourcePDFScholar
2023

GNOT: A General Neural Operator Transformer for Operator Learning

ICML 2023poster

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input functions, and complexity of the PDEs' solution. To address t…

2023

MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks

ICML 2023poster

Physics-informed Neural Networks (PINNs) have recently achieved remarkable progress in solving Partial Differential Equations (PDEs) in various fields by minimizing a weighted sum of PDE loss and boundary loss. However, there are several critical challenges in the training of PINNs, including the la…

Cited by 22SourcePDFScholar
2023

NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Data

ICML 2023poster

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use mesh-based techniques such as the FFT. To address this, we introduce…

2022

A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEs

NeurIPS 2022accept

We present a unified hard-constraint framework for solving geometrically complex PDEs with neural networks, where the most commonly used Dirichlet, Neumann, and Robin boundary conditions (BCs) are considered. Specifically, we first introduce the "extra fields'' from the mixed finite element method t…