Title
Fpga Implementation And Evaluation Of A Real-Time Image-Based Vibration Detection System With Adaptive Filtering
Abstract
This paper shows design and implementation of an image-based vibration detection system on a field-programmable gate array (FPGA), aiming at application to tremor suppression for microsurgery assistance systems. The system can extract a vibration component within a user-specified frequency band from moving images in real-time. For fast and robust detection, we employ a statistical approach using dense optical flow to derive vibration component, and design a custom hardware based on the Lucas-Kanade (LK) method to compute optical flow. And for bandpass filtering without phase delay, we implement the band-limited multiple Fourier linear combiner (BMFLC), a sort of adaptive band-pass filter which can recompose an input signal as a mixture of sinusoidal signals with multiple frequencies within the specified band, with no phase delay. The whole system is implemented as a deep pipeline on a Xilinx Kintex-7 XC7K325T FPGA without using any external memory. We employ fixed-point arithmetic to reduce resource utilization while maintaining accuracy close to double-precision floating-point arithmetic. Empirical experiments reveal that the proposed system extracts a high-frequency tremor component from hand motions, with intentional low-frequency motions successfully filtered out. The system can process VGA moving images at 60 fps, with a delay of less than 1 mu s for the BMFLC, suggesting effectiveness of the deep pipelined architecture. In addition, we are planning to integrate a CNN-based segmentation system for improving detection accuracy, and show preliminary software evaluation results.
Year
DOI
Venue
2020
10.1587/transfun.2020VLP0002
IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES
Keywords
DocType
Volume
optical flow, Lucas-Kanade, BMFLC, FPGA, real-time
Journal
E103A
Issue
ISSN
Citations 
12
0916-8508
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Taito Manabe133.15
Kazuya Uetsuhara200.34
Akane Tahara300.34
Yuichiro Shibata401.35