Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures
Nowadays, as the demand for accurate object detection (OD) applications is increasing, several attempts have been made to introduce convolutional neural network (CNN)-based super-resolution (SR) into these applications to further improve their target accuracy. OD systems require real-time processing...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11048939/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1839605320755707904 |
|---|---|
| author | Inho Lee Jaemin Park Seunghwan Lee Tae Hyun Kim Jiwon Seo Hunjun Lee Yongjun Park |
| author_facet | Inho Lee Jaemin Park Seunghwan Lee Tae Hyun Kim Jiwon Seo Hunjun Lee Yongjun Park |
| author_sort | Inho Lee |
| collection | DOAJ |
| description | Nowadays, as the demand for accurate object detection (OD) applications is increasing, several attempts have been made to introduce convolutional neural network (CNN)-based super-resolution (SR) into these applications to further improve their target accuracy. OD systems require real-time processing because they are widely used in latency-critical applications such as autonomous driving, augmented reality, and surveillance cameras. However, due to their high computational and memory requirements, the introduction of SR in OD systems often makes real-time processing difficult. To reduce computation, one possible solution is to make the SR network size smaller, but this may not be the best solution because it lowers the quality of the reconstructed image. In addition, performing SR on the entire frame is inefficient because there are unnecessary background elements other than the objects that need to be detected within a single frame. Performing SR on specific regions of interest (ROIs) instead can improve the overall efficiency. Therefore, we propose an efficient dynamic quality control SR (DQC-SR) system that can dynamically adjust the inference rate according to the number of ROIs by introducing recursive and early-exit architectures into the baseline SR network. The DQC-SR network (DQC-SRNet) adopts a recursive architecture in which layers share identical parameters and an early-exit architecture that adjusts the network’s depth through bypassing paths. The recursive architecture can reduce memory consumption, while the early-exit architecture can adapt computation dynamically. With these two architectures, the DQC-SR system enables real-time SR inference on edge devices. For evaluation, we conducted example scenarios based on license plate recognition (LPR) situations and demonstrated the effectiveness of the DQC-SR system. |
| format | Article |
| id | doaj-art-79f0e94e734e4c16ab59b8ae9bcabee9 |
| institution | Matheson Library |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-79f0e94e734e4c16ab59b8ae9bcabee92025-08-01T23:01:38ZengIEEEIEEE Access2169-35362025-01-011313414313415910.1109/ACCESS.2025.358260411048939Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model StructuresInho Lee0https://orcid.org/0000-0002-2907-4252Jaemin Park1Seunghwan Lee2Tae Hyun Kim3Jiwon Seo4Hunjun Lee5Yongjun Park6https://orcid.org/0000-0003-3725-0380Department of Computer Science, Hanyang University, Seoul, South KoreaDepartment of Computer Science, Hanyang University, Seoul, South KoreaDepartment of Computer Science, Hanyang University, Seoul, South KoreaDepartment of Computer Science, Hanyang University, Seoul, South KoreaDepartment of Electrical and Computer Engineering, ASRI, School of Transdisciplinary Innovations, Seoul National University, Seoul, South KoreaDepartment of Computer Science, Hanyang University, Seoul, South KoreaDepartment of Computer Science, Yonsei University, Seoul, South KoreaNowadays, as the demand for accurate object detection (OD) applications is increasing, several attempts have been made to introduce convolutional neural network (CNN)-based super-resolution (SR) into these applications to further improve their target accuracy. OD systems require real-time processing because they are widely used in latency-critical applications such as autonomous driving, augmented reality, and surveillance cameras. However, due to their high computational and memory requirements, the introduction of SR in OD systems often makes real-time processing difficult. To reduce computation, one possible solution is to make the SR network size smaller, but this may not be the best solution because it lowers the quality of the reconstructed image. In addition, performing SR on the entire frame is inefficient because there are unnecessary background elements other than the objects that need to be detected within a single frame. Performing SR on specific regions of interest (ROIs) instead can improve the overall efficiency. Therefore, we propose an efficient dynamic quality control SR (DQC-SR) system that can dynamically adjust the inference rate according to the number of ROIs by introducing recursive and early-exit architectures into the baseline SR network. The DQC-SR network (DQC-SRNet) adopts a recursive architecture in which layers share identical parameters and an early-exit architecture that adjusts the network’s depth through bypassing paths. The recursive architecture can reduce memory consumption, while the early-exit architecture can adapt computation dynamically. With these two architectures, the DQC-SR system enables real-time SR inference on edge devices. For evaluation, we conducted example scenarios based on license plate recognition (LPR) situations and demonstrated the effectiveness of the DQC-SR system.https://ieeexplore.ieee.org/document/11048939/Neural networksregion of interest (ROI)super-resolution (SR)object detectionlicense plate recognition |
| spellingShingle | Inho Lee Jaemin Park Seunghwan Lee Tae Hyun Kim Jiwon Seo Hunjun Lee Yongjun Park Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures IEEE Access Neural networks region of interest (ROI) super-resolution (SR) object detection license plate recognition |
| title | Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures |
| title_full | Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures |
| title_fullStr | Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures |
| title_full_unstemmed | Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures |
| title_short | Efficient Image Super-Resolution Using Dynamic Quality Control With Recursive Model Structures |
| title_sort | efficient image super resolution using dynamic quality control with recursive model structures |
| topic | Neural networks region of interest (ROI) super-resolution (SR) object detection license plate recognition |
| url | https://ieeexplore.ieee.org/document/11048939/ |
| work_keys_str_mv | AT inholee efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT jaeminpark efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT seunghwanlee efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT taehyunkim efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT jiwonseo efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT hunjunlee efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures AT yongjunpark efficientimagesuperresolutionusingdynamicqualitycontrolwithrecursivemodelstructures |