We architect Perception: From Small-Scale Datasets to Embedded AI Deployment, powering Industrial Human and Machine Perception
The dual meaning of Perception — both sensing and facilitating comprehension — is what enables cognitive, sustainable, and human-centered systems. We specialize in architecting this capability: bringing robust solutions to the industrial environments. By leveraging expertise in Small-Scale Datasets and Embedded AI Deployment, we ensure that sophisticated Machine Perception (real-time understanding of processes, environment, and human intent) and Human Perception (objective awareness of cognitive load and state) are practical and deployable. We move beyond mere automation that doesn’t improve or only optimizes single targets. The unified awareness that we deploy ensures safety in workspaces, allows for adaptive automation that prevents worker overload, supports sustainable resource use, enables precise error detection and process improvement, and facilitates the development of trustworthy symbiotic systems. Perception, driven by efficient algorithms on dedicated hardware, is the foundation for transforming sensor data into actionable knowledge for both people and machines, ensuring that integration creates massive value in modern manufacturing environments and for novel products.
Research Approach
Our research is centered on architecting perception in and for industrial systems. Our approach is built upon foundational research in human perception and machine perception, where we focus on closing the critical perceptual gaps between them. We design industrial solutions that are built upon neuro/cognitive architectures and principles. These are validated and iteratively optimized using a metric-based assessment that couples quantitative performance goals (e.g., throughput, accuracy) with critical qualitative human factors goals (e.g., operator trust, reduced cognitive load, and system transparency). Our solutions go beyond simple AI models, as we also focus on enriching human and machine perception, especially in collaborative or distributed environments.
Technologies and Innovations
- Energy-Efficient and Real-Time Capable Embedded AI
- Industrial Internet of Things and Federated AI Solutions
- Designing and Evaluating Human-Machine (graphical) Interfaces and Environments
- Process and Environmental Understanding Pipelines
- Physical AI systems leveraging Digital Twins and Shadows of Environments
- Explainable, Trustworthy, Interpretable, and Empirically Evaluated Machine Learning
- Advanced Multi-Modal Sensor Fusion Architectures
- Physiological and Cognitive State Sensing for Heavy Industry Workers.
- Autonomous Collaborative Systems (Robots, Drones, AGVs)
- Neuromorphic AI Building Blocks for Realtime and Low-energy Systems.
Industries
- Assembly Operation Support and Automation
- Predictive Maintenance and Maintenance Support
- Quality Assurance and Inspection Tasks
- AI Hardware Integration and Cognition System Operation
- Collaborative Production Ecosystems (micro to macro scale)
- Human-Machine Teaming
Topics
With machine perception we focus on computational entities acquiring a fundamental, real-time understanding of industrial processes, humans, and the environment. This pillar is the basis for understanding the world using all forms of machine learning (supervised, unsupervised, semi-supervised and reinforcement learning) typically using deep learning and embedded, even neuromorphic, hardware. Research moves from basic detection to multi-modal entity tracking and real-time process understanding. Our past solutions addressed industrial key problems, the absence of large-scale datasets, only small or badly labelled data, cloudless edge deployment and real-time and energy constraints.
With human perception we focus on empowering people by understanding their cognitive, physical, and psychosocial states in complex work environments. This pillar is the basis for personalized assistance, using dedicated sensors (e.g., IMUs, EEG, eye-tracking) to quantify attention, load, and skill or human behavior. Research moves from subjective assessments to objective, real-time state awareness to create self-optimizing user interfaces or adaptive environments. Our past solutions focused on industrial key problems: supporting complex process management while preventing cognitive overload and ensuring safety and skill transfer by delivering highly individualized and contextual guidance when needed.
With federated perception we focus on strategies for distributed AI systems to cooperate and learn collectively while maintaining individual data sovereignty. This pillar is the basis for scaling intelligence across entire machine ecosystems, using Federated and Transfer Learning Approaches to exchange models, or subparts thereof, not proprietary data. Research moves from single-system learning to collective knowledge propagation. Our past solutions focused on industrial key problems: managing data silos, coordinating AI ensembles, enabling high-level collective cognition, and ensuring energy-efficient model aggregation across heterogeneous edge devices.
With symbiotic perception we focus on enabling effortless and trustworthy cooperation by synchronizing human and machine understanding and intent. This pillar is the basis for true Human-Machine Co-Perception, requiring holistic scene understanding and a level of machine agency. Research moves from limited interaction to environments where AI actions are comprehensible by humans and adaptive to humans. Our past solutions focused on industrial key problems, building mutual trust and safety in shared workspaces, minimizing unpredictable and explaining behavior of physical or digital AI, and allowing users to easily adapt the machine's perception through direct feedback or indirectly using behavioral clues and following social norms.
Projects
