Name
Title | ||
|---|---|---|
Energy-Efficient Convolution Module With Flexible Bit-Adjustment Method and ADC Multiplier Architecture for Industrial IoT |
Abstract | ||
|---|---|---|
Offloading the unprecedented growing data to the edge exhibits a mainstream trend in the Industrial Internet of Things (IIoT) era, delivering far-reaching impacts in all aspects of our daily lives, including transportation, health care, and entertainment. However, voluminous data analyzes and processing at the edge will unavoidably raise the edge processor's burden and dramatically expand its design complexity and energy dissipation. This article proposes a flexible bit-adjustment-based energy-efficient convolution module with an approximate divide-and-conquer (ADC) multiplier for compact and low-power edge processor design. The maximum distribution search technique is utilized to exploit the optimal fixed-point representation format for both input and output of the convolution module. The neural network manifests the same precision as a 32-b floating-point multiplication deploying the determined representation formats. An ADC multiplier is proposed to realize the convolution module by eliminating the high-bit multiplication between weights and feature maps. The dynamic power consumption of the ADC multiplier-based convolution module with the
<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$Q(6, 9)$</tex-math></inline-formula>
input and
<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$Q(7, 8)$</tex-math></inline-formula>
output representation formats is 3.85% lower than that of the 16-b signed multiplication circuit. Furthermore, the dynamic power consumption with
<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$Q(6, 9)$</tex-math></inline-formula>
input is capable of being decreased by 15.38% for the 16-b convolution if the output is represented by the
<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$Q(1, 14)$</tex-math></inline-formula>
format and by up to 39.93% for the 64-b multiplication. The practical verification system of the convolution module working on a field-programmable gate array evaluation board exhibits an outstanding low-power characteristic. |
Year | DOI | Venue |
|---|---|---|
2022 | 10.1109/TII.2021.3106242 | IEEE Transactions on Industrial Informatics |
Keywords | DocType | Volume |
Approximate divide-and-conquer (ADC) multiplier,energy-efficient convolution module,flexible bit-adjustment,Industrial Internet of Things (IIoT),quantization | Journal | 18 |
Issue | ISSN | Citations |
5 | 1551-3203 | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Tao Li | 1 | 0 | 0.68 |
| Yitao Ma | 2 | 10 | 3.29 |
| Ko Yoshikawa | 3 | 0 | 0.34 |
| Osamu Nomura | 4 | 0 | 0.34 |
| Tetsuo Endoh | 5 | 155 | 35.26 |