9 accepted papers
Differential privacy (DP) limits the impact of individual training data samples by bounding their gradient norms through clipping. Conventional clipping operations assign unequal scaling factors to sample gradients with different norms, leading to a direction mismatch between the true batch gradient…
Quantization is a common approach to mitigate the communication cost of federated learning (FL). In practice, the quantized local parameters are further encoded via an entropy coding technique, such as Huffman coding, for efficient data compression. In this case, the exact communication overhead is…
Quasi-Newton algorithms estimate the second-order information of loss landscape from its first-order information. They hence propose a promising solution for communication-efficient federated learning (FL), as they reduce the required number of training rounds while avoiding the necessity of exchang…
This work invokes the notion of f-divergence to introduce a novel upper bound on the Bayes error rate of a general classification task. We show that the proposed bound can be computed by sampling from the output of a parameterized model. Using this practical interpretation, we introduce the Bayes op…
Utilizing compressive sensing (CS), one can significantly reduce the number of required antenna elements in MIMO radar systems, while preserving a high spatial resolution. Most CS-based studies focus on individual processing of a single set of measurements collected from an stationary scene. In this…
We introduce the new concept of computation coding. For linear functions, we present an algorithm to reduce the computational cost of multiplying an arbitrary given matrix with an unknown vector. It decomposes the given matrix into the product of codebook and wiring matrices whose entries are either…
In this work, we propose a new single-RF MIMO architecture which enjoys high scalability and energy-efficiency. The transmitter in this proposal consists of a single RF illuminator radiating towards a reflecting surface. Each element on the reflecting surface re-transmits its received signal after a…
In conventional Multiple-Input Multiple Output (MIMO) systems, each antenna requires its own Radio Frequency (RF) chain. Since each RF-chain includes several active components that have to be synchronised, costs and complexity become restrictive. The outphasing MIMO and the outphasing precoder archi…
This paper studies the asymptotic performance of maximum-a-posteriori estimation in the presence of prior information. The problem arises in several applications such as recovery of signals with non-uniform sparsity pattern from underdetermined measurements. With prior information, the maximum-a-pos…