Micro Darknet for Inference: ESL reference for inference accelerator design

Min Zhi Ji; Wei Chung Tseng; Ting Jia Wu; Bo Rong Lin; Chung Ho Chen

doi:10.1109/ISOCC47750.2019.9027644

Micro Darknet for Inference: ESL reference for inference accelerator design

Min Zhi Ji, Wei Chung Tseng, Ting Jia Wu, Bo Rong Lin, Chung Ho Chen

電腦與通信工程研究所

研究成果: Conference contribution

1 引文斯高帕斯（Scopus）

摘要

For neural network (NN) models applying to low-end edge devices, the memory management is a very important issue because of the limitation of hardware resources. However, current NN frameworks typically allocate a huge memory space for NN models in the initial stage. To reduce memory requirements, we propose a lite NN inference-only framework, MDFI (Micro Darknet for Inference) based on Darknet. We optimize the MDFI C code by a layer-wise memory management and layer-dependency resolving mechanism. According to the experimental results, the average memory consumption of MDFI has 76% reduction compared to Darknet, and the average execution time of MDFI has 8% reduction also.

原文	English
主出版物標題	Proceedings - 2019 International SoC Design Conference, ISOCC 2019
發行者	Institute of Electrical and Electronics Engineers Inc.
頁面	69-70
頁數	2
ISBN（電子）	9781728124780
DOIs	https://doi.org/10.1109/ISOCC47750.2019.9027644
出版狀態	Published - 2019 10月
事件	16th International System-on-Chip Design Conference, ISOCC 2019 - Jeju, Korea, Republic of 持續時間: 2019 10月 6 → 2019 10月 9

出版系列

名字	Proceedings - 2019 International SoC Design Conference, ISOCC 2019

Conference

Conference	16th International System-on-Chip Design Conference, ISOCC 2019
國家/地區	Korea, Republic of
城市	Jeju
期間	19-10-06 → 19-10-09

All Science Journal Classification (ASJC) codes

訊號處理
電氣與電子工程
儀器
人工智慧
硬體和架構

存取文件

10.1109/ISOCC47750.2019.9027644

其它文件與鏈接

引用此

Ji, M. Z., Tseng, W. C., Wu, T. J., Lin, B. R., & Chen, C. H. (2019). Micro Darknet for Inference: ESL reference for inference accelerator design. 於 Proceedings - 2019 International SoC Design Conference, ISOCC 2019 (頁 69-70). 文章 9027644 (Proceedings - 2019 International SoC Design Conference, ISOCC 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISOCC47750.2019.9027644

@inproceedings{388510746f6c4731bdf7532577004cb8,

title = "Micro Darknet for Inference: ESL reference for inference accelerator design",

abstract = "For neural network (NN) models applying to low-end edge devices, the memory management is a very important issue because of the limitation of hardware resources. However, current NN frameworks typically allocate a huge memory space for NN models in the initial stage. To reduce memory requirements, we propose a lite NN inference-only framework, MDFI (Micro Darknet for Inference) based on Darknet. We optimize the MDFI C code by a layer-wise memory management and layer-dependency resolving mechanism. According to the experimental results, the average memory consumption of MDFI has 76% reduction compared to Darknet, and the average execution time of MDFI has 8% reduction also.",

author = "Ji, {Min Zhi} and Tseng, {Wei Chung} and Wu, {Ting Jia} and Lin, {Bo Rong} and Chen, {Chung Ho}",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE. Copyright: Copyright 2020 Elsevier B.V., All rights reserved.; 16th International System-on-Chip Design Conference, ISOCC 2019 ; Conference date: 06-10-2019 Through 09-10-2019",

year = "2019",

month = oct,

doi = "10.1109/ISOCC47750.2019.9027644",

language = "English",

series = "Proceedings - 2019 International SoC Design Conference, ISOCC 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "69--70",

booktitle = "Proceedings - 2019 International SoC Design Conference, ISOCC 2019",

address = "United States",

}

Ji, MZ, Tseng, WC, Wu, TJ, Lin, BR & Chen, CH 2019, Micro Darknet for Inference: ESL reference for inference accelerator design. 於 Proceedings - 2019 International SoC Design Conference, ISOCC 2019., 9027644, Proceedings - 2019 International SoC Design Conference, ISOCC 2019, Institute of Electrical and Electronics Engineers Inc., 頁 69-70, 16th International System-on-Chip Design Conference, ISOCC 2019, Jeju, Korea, Republic of, 19-10-06. https://doi.org/10.1109/ISOCC47750.2019.9027644

Micro Darknet for Inference: ESL reference for inference accelerator design. / Ji, Min Zhi; Tseng, Wei Chung; Wu, Ting Jia 等.
Proceedings - 2019 International SoC Design Conference, ISOCC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 69-70 9027644 (Proceedings - 2019 International SoC Design Conference, ISOCC 2019).

研究成果: Conference contribution

TY - GEN

T1 - Micro Darknet for Inference

T2 - 16th International System-on-Chip Design Conference, ISOCC 2019

AU - Ji, Min Zhi

AU - Tseng, Wei Chung

AU - Wu, Ting Jia

AU - Lin, Bo Rong

AU - Chen, Chung Ho

PY - 2019/10

Y1 - 2019/10

N2 - For neural network (NN) models applying to low-end edge devices, the memory management is a very important issue because of the limitation of hardware resources. However, current NN frameworks typically allocate a huge memory space for NN models in the initial stage. To reduce memory requirements, we propose a lite NN inference-only framework, MDFI (Micro Darknet for Inference) based on Darknet. We optimize the MDFI C code by a layer-wise memory management and layer-dependency resolving mechanism. According to the experimental results, the average memory consumption of MDFI has 76% reduction compared to Darknet, and the average execution time of MDFI has 8% reduction also.

AB - For neural network (NN) models applying to low-end edge devices, the memory management is a very important issue because of the limitation of hardware resources. However, current NN frameworks typically allocate a huge memory space for NN models in the initial stage. To reduce memory requirements, we propose a lite NN inference-only framework, MDFI (Micro Darknet for Inference) based on Darknet. We optimize the MDFI C code by a layer-wise memory management and layer-dependency resolving mechanism. According to the experimental results, the average memory consumption of MDFI has 76% reduction compared to Darknet, and the average execution time of MDFI has 8% reduction also.

UR - http://www.scopus.com/inward/record.url?scp=85082995802&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85082995802&partnerID=8YFLogxK

U2 - 10.1109/ISOCC47750.2019.9027644

DO - 10.1109/ISOCC47750.2019.9027644

M3 - Conference contribution

AN - SCOPUS:85082995802

T3 - Proceedings - 2019 International SoC Design Conference, ISOCC 2019

SP - 69

EP - 70

BT - Proceedings - 2019 International SoC Design Conference, ISOCC 2019

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 6 October 2019 through 9 October 2019

ER -

Ji MZ, Tseng WC, Wu TJ, Lin BR, Chen CH. Micro Darknet for Inference: ESL reference for inference accelerator design. 於 Proceedings - 2019 International SoC Design Conference, ISOCC 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 69-70. 9027644. (Proceedings - 2019 International SoC Design Conference, ISOCC 2019). doi: 10.1109/ISOCC47750.2019.9027644

Micro Darknet for Inference: ESL reference for inference accelerator design

摘要

出版系列

Conference

All Science Journal Classification (ASJC) codes

存取文件

其它文件與鏈接

指紋

引用此