Department Publications

A four-dimensional light field (LF) captures both textural and geometrical information of a scene in contrast to a two-dimensional image that captures only the textural information of a scene. Post-capture refocusing is an exciting application of LFs enabled by the geometric information captured. Previously proposed LF refocusing methods are mostly limited to the refocusing of single planar or volumetric region of a scene corresponding to a depth range and cannot simultaneously generate in-focus and out-of-focus regions having the same depth range. In this paper, we propose an end-to-end pipeline to simultaneously refocus multiple arbitrary planar or volumetric regions of a dense or a sparse LF. We employ pixel-dependent shifts with the typical shift-and-sum method to refocus an LF. The pixel-dependent shifts enables to refocus each pixel of an LF independently. For sparse LFs, the shift-and-sum method introduces ghosting artifacts due to the spatial undersampling. We employ a deep learning model based on U-Net architecture to almost completely eliminate the ghosting artifacts. The experimental results obtained with several LF datasets confirm the effectiveness of the proposed method. In particular, sparse LFs refocused with the proposed method archive structural similarity index higher than 0.9 despite having only 20% of data compared to dense LFs.

The combined use of algorithms for approximate discrete cosine transform (DCT) with approximate computing is examined toward area-efficient field programmable gate array (FPGA) hardware architectures. The performance of previously reported, multiplierless approximate DCT transforms are explored in the presence of non-exact hardware adders which provide better utilisation of FPGA resources in terms of look-up-tables (LUTs). In the context of 2D image compression, provided examples are demonstrating a 20% LUT reduction in FPGA utilization compared to accurate adders, with a corresponding image quality degradation of 0.6 dB in terms of PSNR. The potential benefit of such area-efficient FPGA hardware designs is explored on 3D (video compression), 4D (static light field compression), and 5D (light field video compression) cases where significant FPGA resource savings are obtained at the cost of …

Discrete Fourier Transform (DFT) based beam-formers provide N beams with a uniform linear array having N antennas. Despite low-complexity, DFT beamformers cannot generate deep nulls at arbitrary directions of arrivals (DOAs) in the beam pattern to attenuate interferences. On the other hand, data-dependent adaptive beamformers can achieve deep nulls at arbitrary DOAs, however, at higher complexity due to an inversion of a matrix in deriving optimum weights. In this paper, we propose a combined approximate DFT (ADFT) and adaptive beamformer for a uniform linear array consisting of P subarrays, each consisting of M antennas. Here, we first employ P ADFT beamformers to process signals received by subarrays, and the P outputs of these subarrays are then processed by an adaptive beamformer. Simulation results confirm that the proposed beamformer provides the benefits of both DFT and adaptive …

Five-dimensional (5-D) light field videos (LFVs) capture spatial, angular, and temporal variations in light rays emanating from scenes. This leads to a significantly large amount of data compared to conventional three-dimensional videos, which capture only spatial and temporal variations in light rays. In this paper, we propose an LFV compression technique using low-complexity 5-D approximate discrete cosine transform (ADCT). To further reduce the computational complexity, our algorithm exploits the partial separability of LFV representations. It applies two-dimensional (2-D) ADCT for sub-aperture images of LFV frames with intra-view and inter-view configurations. Furthermore, we apply one-dimensional ADCT to the temporal dimension. We evaluate the performance of the proposed LFV compression technique using several 5-D ADCT algorithms, and the exact 5-D discrete cosine transform (DCT). The experimental results obtained with LFVs confirm that the proposed LFV compression technique provides a more than 250 times reduction in the data size with near-lossless fidelity with a peak-signal-to-noise ratio greater than 40 dB and structural similarity index greater than 0.9. Furthermore, compared to the exact DCT, our algorithms requires approximately 10 times less computational complexity.

Cardiac auscultation is an essential clinical skill, requiring excellent hearing to distinguish subtle differences in timing and pitch of heart sounds. However, diagnosing solely from these sounds is often challenging due to interference from surrounding noise, and the information may be limited. Most of the existing solutions that adaptively cancel external noise are either non-real-time or computationally intensive, making them unsuitable for implementation in a portable system. This work proposes an end-to-end system with a real-time adaptive noise cancellation pipeline integrated into a device that simultaneously acquires electrocardiogram (ECG) and phonocardiogram (PCG) signals. We employ a burst adaptive normalized least mean square algorithm that adjusts its adaptation in response to high-energy, non-stationary hospital noise. The algorithm's performance was initially assessed using datasets with artificially induced noise. Subsequently, the complete end-to-end system was validated using real-world hospital recordings captured with the dual-modality device. For PCG and ECG signals recorded from the device in noisy hospital settings, the proposed system achieved signal-to-noise ratio improvements of 37.01 dB and 30.32 dB, respectively. Furthermore, complexity analysis confirms the pipeline's suitability for embedded implementation. These results demonstrate the system's effectiveness in enabling reliable and accessible cardiac screening in noisy hospital environments typical of resource-constrained settings.

Real-time pedestrian sensing at crossings is essential for Intelligent Transportation Systems (ITS). Yet traditional vision-based solutions and wearable devices face privacy, cost, and deployment challenges. While Wi-Fi channel state information (CSI) has shown promise in indoor environments, its potential for dynamic outdoor environments remains largely unexplored. This paper presents a device-free, CSI-based system for detecting human movement and walking direction at crossings and alert oncoming vehicles to enhance pedestrian safety. A twostage classification framework is adopted with noise suppression and Doppler-sensitive features. Classical and deep learning models are evaluated across four outdoor locations and seven subjects, achieving 96.9% accuracy for movement detection and up to 62% accuracy for classification of movement direction. These findings demonstrate the feasibility of …