Title | ||
---|---|---|
Fpga Implementation And Evaluation Of A Real-Time Image-Based Vibration Detection System With Adaptive Filtering |
Abstract | ||
---|---|---|
This paper shows design and implementation of an image-based vibration detection system on a field-programmable gate array (FPGA), aiming at application to tremor suppression for microsurgery assistance systems. The system can extract a vibration component within a user-specified frequency band from moving images in real-time. For fast and robust detection, we employ a statistical approach using dense optical flow to derive vibration component, and design a custom hardware based on the Lucas-Kanade (LK) method to compute optical flow. And for bandpass filtering without phase delay, we implement the band-limited multiple Fourier linear combiner (BMFLC), a sort of adaptive band-pass filter which can recompose an input signal as a mixture of sinusoidal signals with multiple frequencies within the specified band, with no phase delay. The whole system is implemented as a deep pipeline on a Xilinx Kintex-7 XC7K325T FPGA without using any external memory. We employ fixed-point arithmetic to reduce resource utilization while maintaining accuracy close to double-precision floating-point arithmetic. Empirical experiments reveal that the proposed system extracts a high-frequency tremor component from hand motions, with intentional low-frequency motions successfully filtered out. The system can process VGA moving images at 60 fps, with a delay of less than 1 mu s for the BMFLC, suggesting effectiveness of the deep pipelined architecture. In addition, we are planning to integrate a CNN-based segmentation system for improving detection accuracy, and show preliminary software evaluation results. |
Year | DOI | Venue |
---|---|---|
2020 | 10.1587/transfun.2020VLP0002 | IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES |
Keywords | DocType | Volume |
optical flow, Lucas-Kanade, BMFLC, FPGA, real-time | Journal | E103A |
Issue | ISSN | Citations |
12 | 0916-8508 | 0 |
PageRank | References | Authors |
0.34 | 0 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Taito Manabe | 1 | 3 | 3.15 |
Kazuya Uetsuhara | 2 | 0 | 0.34 |
Akane Tahara | 3 | 0 | 0.34 |
Yuichiro Shibata | 4 | 0 | 1.35 |