Title
Implementation of a Real-Time Image-Based Vibration Detection and Adaptive Filtering on an FPGA
Abstract
In this paper, we propose and implement a field-programmable gate array (FPGA) system which extracts a vibration component of a desired frequency band from moving images in real-time, aiming at application to image-based vibration suppression such as microsurgery assistance systems. The technical challenges to this end are two-fold: fast and robust detection of vibration components in given moving images and zero-phase band-pass filtering for a desired frequency band. For the former, we employ a statistical approach using dense optical flow to derive frequency components, and design a custom optical flow computing hardware with the Lucas-Kanade (LK) method. For the latter, we implement a sort of adaptive band-pass filters called a bandlimited multiple Fourier linear combiner (BMFLC), which can recompose input signals as a mixture of sinusoidal signals with multiple frequencies in a band with no phase delay. Both designs are implemented in a deeply pipelined manner on a Xilinx Kintex-7 XC325T FPGA, without using any external memories. Empirical experiments reveal that the proposed system extracts a vibration component of high-frequency tremors in hand motions, while intentional low-frequency motions are successfully filtered out. The system processes VGA moving images at 60 FPS, with a delay of less than 1 us for the BMFLC, suggesting effectiveness of the deep pipelined architecture.
Year
DOI
Venue
2018
10.1109/DASIP.2018.8597053
2018 Conference on Design and Architectures for Signal and Image Processing (DASIP)
Keywords
Field
DocType
real-time image-based vibration detection,adaptive filtering,FPGA,field-programmable gate array system,desired frequency band,microsurgery assistance systems,given moving images,zero-phase band-pass filtering,dense optical flow,custom optical flow computing hardware,Lucas-Kanade method,adaptive band-pass filters,bandlimited multiple Fourier linear combiner,multiple frequencies,high-frequency tremors,VGA moving images,frequency components,vibration component extraction,image-based vibration suppression,robust vibration component detection,Xilinx Kintex-7 XC325T FPGA,intentional low-frequency motions,BMFLC,LK method,statistical approach
Frequency band,Computer science,Field-programmable gate array,Filter (signal processing),Group delay and phase delay,Real-time computing,Gate array,Adaptive filter,Computer hardware,Optical flow,Video Graphics Array
Conference
ISSN
ISBN
Citations 
2164-9766
978-1-5386-8238-8
0
PageRank 
References 
Authors
0.34
3
4
Name
Order
Citations
PageRank
Kazuya Uetsuhara100.34
Akane Tahara201.01
Taito Manabe333.15
Yuichiro Shibata415737.99