| Affiliations: | College of Engineering and Computer Science |
| Project Leader: |
|
| Faculty Mentor: |
Joseph J. LaViola Jr., PhD
|
|
Meeting Times:
|
TBA
|
|
Team Size:
|
2 |
| Open Spots: | 2 |
|
Team Needs:
|
Seeking undergraduate students with experience in Python and Unity. Students are invited to apply for recruitment onto the team, but the project will not begin until summer 2025. |
|
Description:
|
This project explores AI-driven dialogue systems in virtual environments using Large Language Models (LLMs), Visual-Language Models (VLMs), Gesture Recognition, and Virtual Reality (VR). The existing pipeline enables real-time interactions with virtual agents through ASR → LLM → TTS, built in Unity. The goal is to enhance these interactions by making them multimodal, incorporating gestures, visual context, and richer conversational dynamics. Students will contribute to research that expands the capabilities of interactive AI in immersive settings. |