We investigate how we can gather information about a person's behaviour. Which type of information could be gathered via Haru’s future functions (e.g., audio, visual, sentiment analysis). We aim to equip Haru with multisensory functions for deep human understanding.

Once we gather a person's information, our goal shifts to data output. Focusing on efficient interaction between Haru and a person, we can use the collected data to allow for exploration that could improve behviour. Questions such as "How do we deliver information to people so their behaviours can be improved effectively over time?" "Can we deliver data so anyone can benefit from it?" Our current plan is to a apply data video approach for this investigation. Our study confirmed that the way we deliver messages in a video can influence the user’s perception (Sallam et al., 2022). We plan to apply this approach to deliver information to our users.

For deeper human understanding in school settings, Haru will be gathering various types of information about children’s experiences. For example, EEG data will be captured to infer their potential focus, facial expressions will be captured to understand their emotion or social cues, and voice data will be also analyzed to understand their sentiment. We aim to deliver smooth communication between children and Haru.