Devlog 5: After a lot of data smoothing and optimization, the CV was integrated into Unreal Engine to trigger different animation states based on the engagement of the viewer. I then filmed this interaction in a demo of all the cool features my collaborators and I added for our CHI submission!
February 2, 2026 at 2:15 AM
Devlog 5: After a lot of data smoothing and optimization, the CV was integrated into Unreal Engine to trigger different animation states based on the engagement of the viewer. I then filmed this interaction in a demo of all the cool features my collaborators and I added for our CHI submission!
Devlog 4: Continuing work on the CV interaction. I have overridden our old push to talk system and established a new one that uses webcam to detect engagement of the user. Its working but the data is too noisy. It requires a lot of smoothing, tweaking and optimization to implement into UE!
February 2, 2026 at 2:15 AM
Devlog 4: Continuing work on the CV interaction. I have overridden our old push to talk system and established a new one that uses webcam to detect engagement of the user. Its working but the data is too noisy. It requires a lot of smoothing, tweaking and optimization to implement into UE!
Devlog 3: I am working on the implementation of Computer vision as a way to streamline the interactions had with the twin. With this feature the twin will be able to recognize the user's face and determine their level of engagement. Based on this it will turn on the mic and listen for conversation.
February 2, 2026 at 2:15 AM
Devlog 3: I am working on the implementation of Computer vision as a way to streamline the interactions had with the twin. With this feature the twin will be able to recognize the user's face and determine their level of engagement. Based on this it will turn on the mic and listen for conversation.
Devlog 2: Slow and steady progress made on the Twins project in the second week of the academic quarter. We have delegated tasks in order to add new features we can demonstrate for our CHI submission. We are submitting to the "Interactive Demos" category and are excited to get back to work!
February 2, 2026 at 2:15 AM
Devlog 2: Slow and steady progress made on the Twins project in the second week of the academic quarter. We have delegated tasks in order to add new features we can demonstrate for our CHI submission. We are submitting to the "Interactive Demos" category and are excited to get back to work!