Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting
Engagement can be defined as how individuals are involved in and interact with a task that requires attention and emotional conditions. Engagement is an affective state positively correlated with learning processes. Engagement along with other affective states, such as boredom, confusion, and frustr...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Ikatan Ahli Informatika Indonesia
2025-06-01
|
| Series: | Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) |
| Subjects: | |
| Online Access: | https://jurnal.iaii.or.id/index.php/RESTI/article/view/6161 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1839645539757457408 |
|---|---|
| author | Joseph Ananda Sugihdharma Fitra Bachtiar Novanto Yudistira |
| author_facet | Joseph Ananda Sugihdharma Fitra Bachtiar Novanto Yudistira |
| author_sort | Joseph Ananda Sugihdharma |
| collection | DOAJ |
| description | Engagement can be defined as how individuals are involved in and interact with a task that requires attention and emotional conditions. Engagement is an affective state positively correlated with learning processes. Engagement along with other affective states, such as boredom, confusion, and frustration must be analyzed to identify students’ learning behavior. Implementing proper prevention by measuring student engagement levels could increase students’ learning intake. Such implementation involves building an effective feedback system or rearranging the learning design. Several researchers have proposed deep-learning approaches using the DAiSEE dataset to classify student engagement levels. In addition, previous studies utilized various loss functions equipped with class weighting to assign higher importance to the minor classes, which are low and very low engagement classes. Most of the state-of-the-art models achieved high accuracy, but the f1-score was still low because of the minor class struggle. This research tries to solve engagement level classification on imbalance conditions by proposing a normalized loss function weighting based on the Inverse Class Frequency formula based on each class’ instances to give more importance and focus to the classes and trained on Vanilla EfficientNet model rather than experimenting on more advanced model to keep the efficient and suit the memory constraint on the e-learning implementation. Based on the conducted experiments, the normalized ICF obtained the highest accuracy of 51.64% and weighted f1-score of 50.86%, which is superior to the standard ICF performance, which received 50.32% accuracy and weighted f1-score of 50.49% using the same settings. |
| format | Article |
| id | doaj-art-39321f1041c94d3ab5ea8d8075da4fb5 |
| institution | Matheson Library |
| issn | 2580-0760 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | Ikatan Ahli Informatika Indonesia |
| record_format | Article |
| series | Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) |
| spelling | doaj-art-39321f1041c94d3ab5ea8d8075da4fb52025-07-01T15:32:55ZengIkatan Ahli Informatika IndonesiaJurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)2580-07602025-06-019363564510.29207/resti.v9i3.61616161Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss WeightingJoseph Ananda Sugihdharma0Fitra Bachtiar1Novanto Yudistira2Universitas BrawijayaUniversitas BrawijayaUniversitas BrawijayaEngagement can be defined as how individuals are involved in and interact with a task that requires attention and emotional conditions. Engagement is an affective state positively correlated with learning processes. Engagement along with other affective states, such as boredom, confusion, and frustration must be analyzed to identify students’ learning behavior. Implementing proper prevention by measuring student engagement levels could increase students’ learning intake. Such implementation involves building an effective feedback system or rearranging the learning design. Several researchers have proposed deep-learning approaches using the DAiSEE dataset to classify student engagement levels. In addition, previous studies utilized various loss functions equipped with class weighting to assign higher importance to the minor classes, which are low and very low engagement classes. Most of the state-of-the-art models achieved high accuracy, but the f1-score was still low because of the minor class struggle. This research tries to solve engagement level classification on imbalance conditions by proposing a normalized loss function weighting based on the Inverse Class Frequency formula based on each class’ instances to give more importance and focus to the classes and trained on Vanilla EfficientNet model rather than experimenting on more advanced model to keep the efficient and suit the memory constraint on the e-learning implementation. Based on the conducted experiments, the normalized ICF obtained the highest accuracy of 51.64% and weighted f1-score of 50.86%, which is superior to the standard ICF performance, which received 50.32% accuracy and weighted f1-score of 50.49% using the same settings.https://jurnal.iaii.or.id/index.php/RESTI/article/view/6161classificationdeep learningengagementefficientnetnormalized loss |
| spellingShingle | Joseph Ananda Sugihdharma Fitra Bachtiar Novanto Yudistira Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) classification deep learning engagement efficientnet normalized loss |
| title | Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting |
| title_full | Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting |
| title_fullStr | Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting |
| title_full_unstemmed | Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting |
| title_short | Improving Frame-based Engagement Classification in E-Learning Using EfficientNet and Normalized Loss Weighting |
| title_sort | improving frame based engagement classification in e learning using efficientnet and normalized loss weighting |
| topic | classification deep learning engagement efficientnet normalized loss |
| url | https://jurnal.iaii.or.id/index.php/RESTI/article/view/6161 |
| work_keys_str_mv | AT josephanandasugihdharma improvingframebasedengagementclassificationinelearningusingefficientnetandnormalizedlossweighting AT fitrabachtiar improvingframebasedengagementclassificationinelearningusingefficientnetandnormalizedlossweighting AT novantoyudistira improvingframebasedengagementclassificationinelearningusingefficientnetandnormalizedlossweighting |