Department Publications

The Relative Transfer Matrix (ReTM), recently introduced as a generalization of the relative transfer function for multiple sources and multiple microphones, shows promising performance when applied to speech denoising and speaker separation in a noisy reverberant room. This work utilizes the ReTM to propose a novel framework for drone noise suppression. Difficulties in noise cancellation for drone audition applications arise due to its self-generated noise that causes an adverse noisy environment of low Signal-to-Drone Noise Ratio (SDNR) levels. In this paper, we divide the drone on-board microphones into two multichannel groups to approximately estimate the drone noise from one group to the other with known drone noise ReTM for denoising. We demonstrate the ReTM spatial mapping ability in both indoor and outdoor experiments using hovering drone on-board microphone recordings with low average magnitude spectrum error. Finally, we validate the method in a real-life environment for source signal enhancement over different SDNR conditions and offer both improved speech intelligibility and signal-to-distortion ratio.

The auditory brainstem response (ABR) is a measure of subcortical activity in response to auditory stimuli. The wave V peak of the ABR depends on stimulus intensity level, and has been widely used for clinical hearing assessment. Conventional methods to estimate the ABR average electroencephalography (EEG) responses to short unnatural stimuli such as clicks. Recent work has moved towards more ecologically relevant continuous speech stimuli using linear deconvolution models called Temporal Response Functions (TRFs). Investigating whether the TRF waveform changes with stimulus intensity is a crucial step towards the use of natural speech stimuli for hearing assessments involving subcortical responses. Here, we develop methods to estimate level-dependent subcortical TRFs using EEG data collected from 21 participants listening to continuous speech presented at 4 different intensity levels. We find that level-dependent changes can be detected in the wave V peak of the subcortical TRF for almost all participants, and are consistent with level-dependent changes in click-ABR wave V. We also investigate the most suitable peripheral auditory model to generate predictors for level-dependent subcortical TRFs and find that simple gammatone filterbanks perform the best. Additionally, around 6 minutes of data may be sufficient for detecting level-dependent effects and wave V peaks above the noise floor for speech segments with higher intensity. Finally, we show a proof-of-concept that level dependent subcortical TRFs can be detected even for the inherent intensity fluctuations in natural continuous speech. Visual abstract Significance …

Denoising of four-dimensional (4-D) light fields (LFs) is a fundamental preprocessing step before employing LFs for downstream tasks. Most of LF denoising methods have higher computational complexities despite excellent performance. Denoising of LFs using 4-D linear filters is a low-complexity approach that can achieve near real-time or real-time processing. We propose an ultra low-complexity LF denoising methods using 4-D infinite-extent impulse response (IIR) hyperfan filters in this paper. Our approach exploits the sparsity of an LF in the 4-D frequency domain, and employ a set of one-dimensional and two-dimensional first-order IIR filters to approximate the 4-D hyperfan-shaped passband. On average, the proposed 4-D IIR hyperfan filter needs only 2.56 multiplications and 21.06 additions to process a LF sample leading to more than 92% and 64% savings in the number of multiplications and additions to …

A spatially-interpolated (SI) beamformer is proposed in this paper to enhance narrowband plane waves received by a sparse linear antenna array. Similar to a conventional SI filter, the proposed beamformer employs two filters: an SI prototype filter and a masking filter. However, the proposed SI beamformer employs a parallel structure compared to a cascade structure of conventional SI filters leading to a sparse antenna array. Both the prototype filter and the masking filter are designed as optimal filters in the minimax sense. Furthermore, we employ a bell-shaped passband for the ideal magnitude response for the design compared to a conventional ideal frequency response that employs 1 and 0 as the passband and the stopband gains with a finite transition band. Simulation results confirm that the proposed SI beamformer provides approximately 37% reduction in computational complexity and a similar reduction …

We propose a minimax design method for multi-dimensional (M-D) interpolated finite-support impulse response (IFIR) filters. As a result of the cascade structure of an MD IFIR filter, the optimization problem of the minimax design is nonconvex. In order to solve this nonconvex optimization problem, we employ a convex-concave procedure, where each iteration solves a convex constrained optimization problem. We present experimental results to confirm the effectiveness and the superior performance of the proposed method compared to previously proposed minimax designs of M-D IFIR filters. Furthermore, we present an implementation of M-D IFIR filter on the Xilinx Kintex UltraScale KCU105 field-programmable gate array, where a quantization error of −60.59 dB is achieved with the coefficient word length of 24 bits.

Chromatic derivatives (CDs) and associated chromatic approximations (CAs) provide a numerically robust and powerful framework for digital processing of continuous-time/space signals, using not only the discrete signal amplitudes, but also higher order derivatives. Acquisition of CDs has so far been limited to software implementations. This paper presents field-programmable gate array (FPGA)-based digital hardware architectures suitable for the real-time acquisition of CDs, thus enabling CDs to be used for practical signal processing algorithm development in embedded systems. With 24 bits of fixed-point precision, the proposed hardware architectures provide approximate 116 dB accuracy in the frequency responses of FIR filters capturing the CDs, and 76.85 dB and 75.09 dB accuracy in signal reconstruction with synthetic and real audio signals using CDs up to order 28 degrees. The designs have been …

With applications in quantitative metabolomics and label-free digital pathology, Quantitative Phase Microscopy (QPM) measures refractive index maps of thin transparent specimens like live cells or tissue sections. In QPM, refractive index maps are usually reconstructed from interference measurements of the object’s light field with respect to a reference field. To this end, many previous works focused on designing stable full-field interferometers from the bottom up. In this work, we present an alternative strategy to design a QPM system top-down, starting from the desired measurement outcomes, with no explicit knowledge about interferometry. We call our inverse design strategy Differentiable Microcopy. To this end, our Differentiable Microcopy approach designed a range of Fourier-filter-based QPM systems that do not require computational post-reconstruction. Our designs are superior to existing similar designs in …

Recently, various optical neural architectures have been designed to perform imaging and all-optical image processing. These designs consist of several optical masks with optimized transmission coefficients for the task. Designing sparse optical masks for them is important as it can promote different aspects of the design such as ease of fabrication and power efficiency of the design. To this end, inspired by the sparse filter designs, we propose training optical neural architectures with a regularization promoting sparsity in the masks. As preliminary results, we demonstrate a D2NN design for QPI achieving a sparsity of 33% with a performance degradation of only 12%.

Wi-Fi has become a cost-effective sensing mechanism due to its widespread availability. Channel State Information (CSI) from the OFDM-based physical layer of Wi-Fi contains rich information for sensing static and dynamic channel conditions, and hence for sensing activities within the channel. Numerous applications which combine CSI-based sensing with machine learning (ML) available for both indoor and outdoor environments. We extend the use of CSI- based Wi-Fi sensing to a unique setting: a confined environment. An industrial beverage cooler is specifically considered. We address the challenges of sensing device placement in such confined environments, where line-of-sight obstruction and near-field effects play a key role in CSI stability. We compensate for these effects by introducing novel combinations of data preprocessing techniques and input feature definitions. We demonstrate an accuracy of 89 …