39 accepted papers
Textual adapter-based tuning methods have shown significant potential in transferring knowledge from pre-trained Vision-Language Models (VLMs) to downstream tasks. Existing works generally employ the deterministic textual feature adapter to refine each category textual representation. However, due t
Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have explored diffusion models to streamline this process; however, pre-trained diff
Recent advances in Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have made it standard practice to reconstruct 3D scenes from multi-view images. Removing objects from such 3D representations is a fundamental editing task that requires complete and seamless inpainting of occluded reg
We present IntrinsicWeather, a diffusion-based framework for controllable weather editing in intrinsic space. Our framework includes two components based on diffusion priors: an inverse renderer that estimates material properties, scene geometry, and lighting as intrinsic maps from an input image, a
Physically-based rendering (PBR) materials are fundamental to photorealistic graphics, yet their creation remains labor-intensive and requires specialized expertise. While generative models have advanced material synthesis, existing methods lack a unified representation bridging natural image appear
Monocular depth estimation infers per-pixel depth from a single RGB image. It remains particularly challenging in far-range regions, where sparse observations and long-tailed depth distributions bias learning toward near-range content. Diffusion models offer a promising alternative to discriminative
WiFi sensing has emerged as a compelling contactless modality for human activity monitoring by capturing fine-grained variations in Channel State Information (CSI). Its ability to operate continuously and non-intrusively while preserving user privacy makes it particularly suitable for health monitor…
Roadside camera-based perception methods are in high demand for developing efficient vehicle-infrastructure collaborative perception systems. By focusing on object-level depth prediction, we explore the potential benefits of integrating environmental priors into such systems and propose a geometry-b
3D Gaussian splatting (3DGS) has shown its detailed expressive ability and highly efficient rendering speed in the novel view synthesis (NVS) task. The application to inverse rendering still faces several challenges, as the discrete nature of Gaussian primitives makes it difficult to apply geometry…
Indoor falls often lead to fatalities due to delayed assistance. Current approaches to detecting indoor falls, such as cameras and wearables, intrude on privacy and are inconvenient. Radar-based device-free sensing has a limited range and requires dense deployment, leading to overhead costs. WiFi-ba…
3D Gaussian Splatting (3DGS) has shown impressive results for the novel view synthesis task, where lighting is assumed to be fixed. However, creating relightable 3D assets, especially for objects with ill-defined shapes (fur, fabric, etc.), remains a challenging task. The decomposition between light…
Reconstructing 3D assets from images, known as inverse rendering (IR), remains a challenging task due to its ill-posed nature. 3D Gaussian Splatting (3DGS) has demonstrated impressive capabilities for novel view synthesis (NVS) tasks. Methods apply it to relighting by separating radiance into BRDF p…
Multi-modal object Re-IDentification (ReID) has gained considerable attention with the goal of retrieving specific targets across cameras using heterogeneous visual data sources. At present, multi-modal object ReID faces two core challenges: (1) learning robust features under fine-grained local nois…
Recent research has demonstrated the advantages of Bird’s-eye-view (BEV) representation in the field of 3D perception. However, due to the lack of height information, BEV representation alone is insufficient to accurately reconstruct the complete surrounding 3D scene. On the other hand, voxel repres…
In multimodal perception systems, achieving precise extrinsic calibration between LiDAR and camera is of critical importance. However, the pre-calibrated extrinsic parameters may gradually drift during operation, leading to a decrease in the accuracy of the perception system. It is challenging to ad
It is time-consuming to render high-resolution images in applications such as video games and virtual reality and thus super-resolution technologies become increasingly popular for real-time rendering. However it is challenging to preserve sharp texture details keep the temporal stability and avoid…
Visual navigation has been widely studied under the assumption that there may be several clear routes to reach the goal. However, in more practical scenarios such as a house with several messy rooms, there may not. Interactive Navigation (InterNav) considers agents navigating to their goals more eff…
Respiratory rate tracking has gained more and more interest in the past few years because of its great potential in exploring different pathological conditions of human beings. Conventional approaches usually require dedicated wearable devices, making them intrusive and unfriendly to users. To tackl…
In-car child presence detection (CPD) has gained worldwide attention due to increased child deaths reported yearly when they are left unattended in a car. Existing solutions usually require dedicated sensors and are being surpassed by WiFi-based CPD because the latter can provide broader coverage an…
Indoor maps are essential to indoor location-based services, but are not widely accessible despite considerable efforts from the industry. Existing solutions employ costly hardware to achieve accurate mapping, or resort to laborious crowdsourcing methods, which may suffer from low accuracy due to in…
Heat-stroke and death of children being left alone in a parked car has attracted more and more attentions. As a result, car manufactures start to reward solutions for in-car Child Presence Detection (CPD) system to save lives recently. However, most of the existing works rely on dedicated sensors an…
Speech enhancement and separation have been a long-standing problem with recent advances using a single microphone. With the help of video modality, improvements have been shown for these tasks. In this work, we explore a multimodal approach using mmWave radio devices, as these devices can measure v…
Traffic accident forecasting is of great importance to urban public safety, emergency treatment, and construction planning. However, it is very challenging since traffic accidents are affected by multiple factors, and have multi-scale dependencies on both spatial and temporal dimensional features. M…
While high accuracy tracking of targets has been extensively explored because of its wide applications, many exiting methods degenerate in the presence of multipath distortions. This paper proposes an accurate and novel multipath-resilient system to track the targets by leveraging the large number o…
Heart Rate Variability (HRV), which measures the fluctuation of heartbeat intervals, has been considered as an important indicator for general health evaluation. In this paper, we present mmHRV, a contact-free HRV monitoring system using commercial millimeter-wave (mmWave) radio. We devise a heartbe…
Motion detection based on WiFi signals has gained much attention recently. However, most of the existing approaches can only detect motion in a large coverage area without knowing how far the target motion happens. In this paper, we propose two robust and responsive features in the frequency dimensi…
With the proliferation of smart devices, voice interfaces have become an integral part of our lives, which typically senses sound by microphones through converting the changes in air pressure into electrical signals. Sound sensing through another modality can enable various sensing applications in t…
Device-free (passive) gesture recognition offers an enormous potential to simplify Human-Computer Interaction (HCI) in future smart environments. WIFI-based gesture recognition approaches have attained acclaim amongst others due to the omnipresence, privacy-preservation, and broad coverage of WIFI.…
Fall detection systems based on WiFi signals are gaining popularity recently. However, most of the existing works relying on training are environment-dependent. In this paper, we propose DeFall, a novel WiFi-based environment-independent fall detection system by leveraging the features inherently as…
Heading direction information is crucial to many ubiquitous computing applications. The main stream has been resorting to inertial sensors, such as accelerometer, gyroscope and magnetometer, which suffer from severe accumulative errors or large degradations indoors. In this paper, we utilize the rad…
Gesture recognition using wireless sensing opened a plethora of applications in the field of human-computer interaction. However, most existing works are not robust without requiring wearables or tedious training/calibration. In this work, we propose WiGRep, a time reversal based gesture recognition…
Accurate monitoring of human vital signs (e.g. breathing and heart rates) is crucial in detecting medical problems. In this paper, we propose ViMo, a calibration-free remote Vital sign Monitoring system that can simultaneously monitor multiple users by leveraging the channel impulse response (CIR) o…
Automobiles have become an essential part of everyday lives. In this work, we attempt to make them smarter by introducing the idea of in-car driver authentication using wireless sensing. Our aim is to develop a model which can recognize drivers automatically. Firstly, we address the problem of "chan…
Environmental information is recorded in the multipath propagation, and can be accessed in the form of channel state information (CSI) through commodity WiFi devices. A single CSI reading for event detection is adopted in most existing CSI based indoor monitoring system. However, due to the impact o…
In a rich-scattering environment, radio frequency (RF) devices communicate through multipath channels and the channel state information (CSI) is uniquely determined by the location of the transmitter or receiver devices along with surrounding environments. Whenever one of the devices moves, the CSI…
Motion detection as a key component in modern security systems has received an increasing attention recently, but most existing solutions require special installation, calibration, and only have a limited coverage. In this paper, we propose WiDetect, a highly accurate, calibration-free, and low-comp…
Time-reversal (TR) transmission scheme has attracted more and more attention from both academia and industry due to its ability to focus the energy of a transmitted signal at an intended focal spot, both in the time and spatial domains. Based on the extensive data collected in the real world, we obs…
Next-generation wireless networks are expected to support exponentially increasing number of users and demands of data, which all rely on the essential media: spectrum. Notice that the 5G networks are featured either by wide bandwidth like mmWave systems, or by large-scale antennas like massive MIMO…
In this work, we propose a novel wireless time-reversal indoor events detection system (TRIEDS). By leveraging the time-reversal (TR) technique to capture the changes of channel state information (CSI) in the indoor environment, TRIEDS enables low-complexity single-antenna devices that operate in th…