Department Publications

Dynamic adjustment of signal timing based on the number of pedestrians waiting at a crossing results in safer and more efficient intersections. Traditionally, such information is obtained through push-buttons or vision-based techniques. Though counting is possible with the latter, the techniques are associated with privacy concerns, are affected by poor lighting, and equipment is costly and bulky. We present a novel alternative that uses Wi-Fi Channel State Information (CSI) processed through a Deep Neural Network (DNN) model. The amplitude and phase of 51 Orthogonal Frequency Division Multiplexing sub carriers in the IEEE802.11n standard are captured with two ESP32 devices. Of the candidate DNNs trained with the CSI data, a ID-Convolutional Neural Network is experimentally demonstrated to count up to 12 pedestrians with an accuracy of 79 % at the current level of training. This can be generalized to …

Light fields (LFs) and light field videos (LFVs) capture both angular and spatial variation of light rays emanating from scenes. This richness of information leads to novel applications such as post-capture refocusing, depth estimation and depth-velocity filtering which are not possible with images and videos. These capabilities come, however, with a significant increase in data to be processed. In order to fully exploit opportunities provided by LFs and LFVs, low-complexity signal processing algorithms that process LF and LFV data in real-time are required. In this brief, we survey such state-of-the-art algorithms, in particular for depth filtering, refocusing and denoising of LFs and depth-velcoty filtering for LFVs, and future directions for these real-time LF an LFV processing algorithms.

In four-dimensional (4-D) light field (LF) processing, 4-D linear shift-invariant filters having hyperplanar passbands are used for depth-based scene enhancement. In this paper, two low-sensitivity and low-complexity field programmable gate array (FPGA)-based digital hardware architectures for 4-D hyperplanar filters are proposed for on-chip real-time processing of LFs. Both 4-D filters are designed exploiting resonant properties of multi-dimensional passive prototype networks, and are realized as wave digital filters (WDFs). The two 4-D WDF realizations are implemented as raster-scanned processing architectures on a Xilinx Virtex 6 Sx35 FPGA with a real-time clock speed of up to 33 MHz. This corresponds to a real-time throughout of 16.8 LFs/s for an LF of size .

We propose a weighted least-squares (WLS) design method for multi-dimensional (M-D) complex-coefficient finite- extent impulse response (FIR) filters. We consider the general form of M-D FIR filters having arbitrary frequency responses and low group delays. We formulate the proposed WLS design as a second-order cone programming problem. Design examples confirm that the proposed method provides the state-of-the-art M-D FIR filter designs with almost constant group delay.

Three-dimensional space-time velocity filters may be used to enhance dynamic passband objects of interest in videos while attenuating moving interfering objects based on their velocities. In this paper, we show that the attenuation of interfering stopband objects may be significantly improved using recently proposed shifted-velocity filters. It is shown that an improvement of approximately 20 dB in signal-to-interference ratio may be achieved for stopband to passband velocity differences of only 1 pixels/frame. More importantly, this improvement is achieved without increasing the computational complexity.