ILMICA - Interactive Learning Model of Image Collage Assessment: A Transfer Learning Approach for Aesthetic Principles
Withöft, Ani and Abdenebaoui, Larbi and Boll, Susanne
International Conference on Multimedia Modeling
The beauty of moments can be expressed in many ways. One of them is the image collage which captures events and expresses emotions. Nowadays there is a large number of digital images. Aesthetic analyses of image collages are rarely performed due to their complexity and time-consuming nature. For this reason, this is an important issue that has to be addressed. In this paper, we propose an interactive learning model for image collage assessment. It consists of two components: A pre-trained convolutional neural network with built-in knowledge about aesthetics obtained from single image analysis, and an “Interactive Transfer Learning” component specialized in collage aesthetics which is adaptable via Active Learning. We present a mixed method study in which rules for software-based collage generation are identified and a dataset of automatically generated collages representative of the rules is created. ILMICA’s performance is analyzed by a user survey. It is found that the knowledge transfer from single image assessment to collage assessment works: ILMICA can assess collage aesthetics based on predefined rules, thereby demonstrating the system’s ability to learn. Thus, this process can alleviate the end user and simplify aesthetic collage evaluations.
2022
978-3-030-98354-3
inproceedings
Springer Nature Switzerland AG
Lecture Notes in Computer Science, Volume 13142
84-96
Springer International Publishing
