A showcase of ÉTS researchers’ publications and other contributions

A generic preprocessing architecture for multi-modal IoT sensor data in artificial general intelligence


Downloads per month over past year

Dmytryk, Nicholas and Leivadeas, Aris. 2022. « A generic preprocessing architecture for multi-modal IoT sensor data in artificial general intelligence ». Electronics, vol. 11, nº 22.
Compte des citations dans Scopus : 1.

[thumbnail of Leivadeas-A-2022-25962.pdf]
Leivadeas-A-2022-25962.pdf - Published Version
Use licence: Creative Commons CC BY.

Download (2MB) | Preview


A main barrier for autonomous and general learning systems is their inability to understand and adapt to new environments—that is, to apply previously learned abstract solutions to new problems. Supervised learning system functions such as classification require data labeling from an external source and do not have the ability to learn feature representation autonomously. This research details an unsupervised learning method for multi-modal feature detection and evaluation to be used for preprocessing in general learning systems. The learning method details a clustering algorithm that can be applied to any generic IoT sensor data, and a seeded stimulus labeling algorithm impacted and evolved by cross-modal input. The method is implemented and tested in two agents consuming audio and image data, each with varying innate stimulus criteria. Their run-time stimulus changes over time depending on their experiences, while newly experienced features become meaningful without preprogrammed labeling of distinct attributes. The architecture provides interfaces for higher-order cognitive processes to be built on top of the unsupervised preprocessor. This method is unsupervised and modular, in contrast to the highly constrained and pretrained learning systems that exist, making it extendable and well-disposed for use in artificial general intelligence.

Item Type: Peer reviewed article published in a journal
Leivadeas, Aris
Affiliation: Génie logiciel et des technologies de l'information
Date Deposited: 15 Dec 2022 17:37
Last Modified: 05 Jan 2023 20:35

Actions (login required)

View Item View Item