Department Publications

Machine vision has been widely deployed in many industrial applications. However, the accuracy and maturity level for the inspection of through-hole technology (THT) solder joints have yet to reach its ultimate goal. In this paper, we have presented a detailed explanation on a set of novel algorithms that can be effectively used to implement an automatic vision system that is capable of classifying the quality of THT solder joints very precisely. This vision system can be easily integrated into a soldering robotic system that performs automatic soldering on THT solder joints. The proposed vision system is capable of controlling the entire robotic system while providing automatic rework capability on the defective solder joints with much less user interaction. The experimental results indicate that the proposed system has an improved recognition rate and good resilience to noise and uneven illumination distribution.

In recent years, Convolution Neural Network (CNN) gained great success in many applications, especially in computer vision. Now adapting CNN inference on edge devices has become an active research area in embedded vision and hot topic in Edge AI. The primary design hurdles for implementing CNN inference on embedded systems are limited computational resource, memory resource, and power budget. This study presents a novel architecture for SqueezeNet [1] like CNN models, which can be extended to support any CNN model as well. We address two approaches to mitigate resource constraints. First, we use a custom floating point(12 bit for computation and 8bit for storing). Second is slicing the model into a repetitive block called computation blocks. Computation block can be configured dynamically by the host processor to operate in a different mode. We have implemented SqueezeNet v1.1 for …

This paper presents the development of a Sinhala Speech Recognition System to be deployed in an Interactive Voice Response (IVR) system of a telecommunication service provider. The main objectives are to recognize Sinhala digits and names of Sinhala songs to be set up as ringback tones. Sinhala being a phonetic language, its features are studied to develop a list of 47 phonemes. A continuous speech recognition system is developed based on Hidden Markov Model (HMM). The acoustic model is trained using the voice through mobile phone. The outcome is a speaker independent speech recognition system which is capable of recognizing 10 digits and 50 Sinhala songs. A word error rate (WER) of 11.2% using a speech corpus of 0.862 hours and a sentence error rate (SER) of 5.7% using a speech corpus of 1.388 hours are achieved for digits and songs respectively.

Purpose Automatic Optical Inspection (AOI) systems that are extensively used in the industry of Electronics Manufacturing Services (EMS), performs the inspection of Surface Mount Devices (SMD). One of the main tasks of such an AOI system is to align a given PCB to the parameters of the corresponding PCB positioning system by a process called fiducial alignment. However, no detailed analysis has been carried out so far on the methodologies that can be used to have a very precise identification of PCB fiducial points. In our research, we have implemented an AOI system for the inspection of soldering defects of Through Hole Technology (THT) solder joints, which can be integrated to a desktop soldering robotic platform. Such platforms are used in environments where no specific lighting conditions can be provided within a surrounded atmosphere. Therefore, an AOI system that is capable of performing fiducial alignment of any given PCB under varying lighting condition is highly preferred. In this paper, we have presented a detailed analysis on feature extraction and template matching algorithms that can be used to implement a very precise fiducial verification process under normal lighting condition. Design/methodology/approach A detailed analysis and performance evaluation have been carried out in this paper on prominent image comparison algorithms that are extensively used in the field of image processing. Findings According to the analysis carried out in this paper, it could be observed that the combination of feature extraction and template matching algorithms gives the best performance in PCB fiducial verification process. Research …

Convolutional Neural Networks (CNNs) are widely used in deep learning applications, e.g. visual systems, robotics etc. However, existing software solutions are not efficient. Therefore, many hardware accelerators have been proposed optimizing performance, power and resource utilization of the implementation. Amongst existing solutions, Field Programmable Gate Array (FPGA) based architecture provides better cost-energy-performance trade-offs as well as scalability and minimizing development time. In this paper, we present a model-independent reconfigurable co-processing architecture to accelerate CNNs. Our architecture consists of parallel Multiply and Accumulate (MAC) units with caching techniques and interconnection networks to exploit maximum data parallelism. In contrast to existing solutions, we introduce limited precision 32 bit Q-format fixed point quantization for arithmetic representations and …

Biological sampling for biomass estimation is a highly labor intensive process that can benefit from automation using computer vision. In this paper two algorithms the Green Layer Extraction (GLE) method and Morphology and Marker Controlled Watershed Transformation (MMCWT) method are proposed for the estimation of frond (leaf) area of an invasive aquatic fern Salvinia molesta. The two algorithms are tested using a computer controlled automatic testbed. The mean accuracy for the GLE was found to be 89.66% for estimating the number of fronds and 86.74 % for estimating the frond area. For the MMCWT the respective results are 91.92% and 80.68%. Then the results are subsequently used for developing a mathematical model as growth rate estimation of Salvinia molesta for various concentrations of Sodium di-hydrogen phosphate.