Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations
With advances in machine vision systems (e.g., artificial eye, unmanned aerial vehicles, surveillance monitoring) scene semantic recognition (SSR) technology has attracted much attention due to its related applications such as autonomous driving, tourist navigation, intelligent traffic and remote ae...
保存先:
| 主要な著者: | , , , |
|---|---|
| フォーマット: | 論文 |
| 言語: | 英語 |
| 出版事項: |
IEEE
2021-01-01
|
| シリーズ: | IEEE Access |
| 主題: | |
| オンライン･アクセス: | https://ieeexplore.ieee.org/document/9353540/ |
| タグ: |
タグ追加
タグなし, このレコードへの初めてのタグを付けませんか!
|
| _version_ | 1839640013225066496 |
|---|---|
| author | Ahmad Jalal Abrar Ahmed Adnan Ahmed Rafique Kibum Kim |
| author_facet | Ahmad Jalal Abrar Ahmed Adnan Ahmed Rafique Kibum Kim |
| author_sort | Ahmad Jalal |
| collection | DOAJ |
| description | With advances in machine vision systems (e.g., artificial eye, unmanned aerial vehicles, surveillance monitoring) scene semantic recognition (SSR) technology has attracted much attention due to its related applications such as autonomous driving, tourist navigation, intelligent traffic and remote aerial sensing. Although tremendous progress has been made in visual interpretation, several challenges remain (i.e., dynamic backgrounds, occlusion, lack of labeled data, changes in illumination, direction, and size). Therefore, we have proposed a novel SSR framework that intelligently segments the locations of objects, generates a novel Bag of Features, and recognizes scenes via Maximum Entropy. First, denoising and smoothing are applied on scene data. Second, modified Fuzzy C-Means integrates with super-pixels and Random Forest for the segmentation of objects. Third, these segmented objects are used to extract a novel Bag of Features that concatenate different blobs, multiple orientations, Fourier transform and geometrical points over the objects. An Artificial Neural Network recognizes the multiple objects using the different patterns of objects. Finally, labels are estimated via Maximum Entropy model. During experimental evaluation, our proposed system illustrated a remarkable mean accuracy rate of 90.07% over the MSRC dataset and 89.26% over the Caltech 101 for object recognition, and 93.53% over the Pascal-VOC12 dataset for scene recognition, respectively. The proposed system should be applicable to various emerging technologies, such as augmented reality, to represent the real-world environment for military training and engineering design, as well as for entertainment, artificial eyes for visually impaired people and traffic monitoring to avoid congestion or road accidents. |
| format | Article |
| id | doaj-art-08dcae2caafa41bca5cc95f75af74a67 |
| institution | Matheson Library |
| issn | 2169-3536 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-08dcae2caafa41bca5cc95f75af74a672025-07-03T23:00:19ZengIEEEIEEE Access2169-35362021-01-019277582777210.1109/ACCESS.2021.30589869353540Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object RelationsAhmad Jalal0Abrar Ahmed1Adnan Ahmed Rafique2https://orcid.org/0000-0002-3049-3921Kibum Kim3https://orcid.org/0000-0003-2590-9600Department of Computer Science, Air University, Islamabad, PakistanDepartment of Computer Science, Air University, Islamabad, PakistanDepartment of Computer Science, Air University, Islamabad, PakistanDepartment of Human-Computer Interaction, Hanyang University, Ansan, South KoreaWith advances in machine vision systems (e.g., artificial eye, unmanned aerial vehicles, surveillance monitoring) scene semantic recognition (SSR) technology has attracted much attention due to its related applications such as autonomous driving, tourist navigation, intelligent traffic and remote aerial sensing. Although tremendous progress has been made in visual interpretation, several challenges remain (i.e., dynamic backgrounds, occlusion, lack of labeled data, changes in illumination, direction, and size). Therefore, we have proposed a novel SSR framework that intelligently segments the locations of objects, generates a novel Bag of Features, and recognizes scenes via Maximum Entropy. First, denoising and smoothing are applied on scene data. Second, modified Fuzzy C-Means integrates with super-pixels and Random Forest for the segmentation of objects. Third, these segmented objects are used to extract a novel Bag of Features that concatenate different blobs, multiple orientations, Fourier transform and geometrical points over the objects. An Artificial Neural Network recognizes the multiple objects using the different patterns of objects. Finally, labels are estimated via Maximum Entropy model. During experimental evaluation, our proposed system illustrated a remarkable mean accuracy rate of 90.07% over the MSRC dataset and 89.26% over the Caltech 101 for object recognition, and 93.53% over the Pascal-VOC12 dataset for scene recognition, respectively. The proposed system should be applicable to various emerging technologies, such as augmented reality, to represent the real-world environment for military training and engineering design, as well as for entertainment, artificial eyes for visually impaired people and traffic monitoring to avoid congestion or road accidents.https://ieeexplore.ieee.org/document/9353540/Scene recognitionobject segmentationrecognitionbag of featuresartificial neural networkmaximum entropy |
| spellingShingle | Ahmad Jalal Abrar Ahmed Adnan Ahmed Rafique Kibum Kim Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations IEEE Access Scene recognition object segmentation recognition bag of features artificial neural network maximum entropy |
| title | Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations |
| title_full | Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations |
| title_fullStr | Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations |
| title_full_unstemmed | Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations |
| title_short | Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations |
| title_sort | scene semantic recognition based on modified fuzzy c mean and maximum entropy using object to object relations |
| topic | Scene recognition object segmentation recognition bag of features artificial neural network maximum entropy |
| url | https://ieeexplore.ieee.org/document/9353540/ |
| work_keys_str_mv | AT ahmadjalal scenesemanticrecognitionbasedonmodifiedfuzzycmeanandmaximumentropyusingobjecttoobjectrelations AT abrarahmed scenesemanticrecognitionbasedonmodifiedfuzzycmeanandmaximumentropyusingobjecttoobjectrelations AT adnanahmedrafique scenesemanticrecognitionbasedonmodifiedfuzzycmeanandmaximumentropyusingobjecttoobjectrelations AT kibumkim scenesemanticrecognitionbasedonmodifiedfuzzycmeanandmaximumentropyusingobjecttoobjectrelations |