JarventGPT – A IA Avatar

This proof of concept aims to develop a hyper-realistic 3D animated avatar in Unity, integrated with conversational capabilities using GPT (either GPT-4 from Azure or OpenAI’s ChatGPT) and AI-generated voice. The avatar will respond to inquiries in both text/chat and voice formats, providing an immersive and realistic interactive experience.

Key Features:

  1. Creation of the Hyper-Realistic Avatar:
    • Unity will be employed, utilizing the High Definition Render Pipeline (HDRP) for the PC version, and the Universal Render Pipeline (URP) with a more modest and cartoonish graphical style for the web version.
    • A highly detailed 3D model will be designed for the avatar, featuring photorealistic textures, advanced lighting, and stunning visual effects for the PC version.
    • For the web version, the avatar will be adapted to embrace a lighter, cartoonish graphical style, ensuring optimal performance in web browsers.
  2. Integration with GPT and Response Generation:
    • An API integration with either GPT-4 from Azure or OpenAI’s ChatGPT will be established to enable conversational interactions with the avatar.
    • User input in the form of text or voice will be sent to the corresponding API, and the response generated by GPT will be received and conveyed by the avatar.
    • Responses will be tailored to ensure a consistent and natural conversational tone and style.
  3. Natural Voice Generation:
    • An AI-driven voice generation engine will be implemented to achieve smooth and natural voice reproduction.
    • The avatar’s voice will be generated in real-time and synchronized with the provided responses.
    • A lip-sync system will be employed to ensure mouth movements align with spoken words.
  4. User Interaction:
    • Users will be able to query the avatar using both text/chat and voice commands.
    • An intuitive user interface will be developed, allowing users to type queries or communicate directly with the avatar using voice commands.
    • Responses will be visually presented in the interface and articulated by the avatar in a natural manner.
  5. Two Adapted Versions:
    • Two avatar versions will be provided to accommodate varying hardware capabilities and visual preferences.
    • The PC version with HDRP will deliver hyper-realistic graphics, while the web version with URP will offer a lighter, cartoonish graphical style.
  6. Testing and Evaluation:
    • Thorough testing will be conducted to ensure smoothness and coherence in conversations between users and the avatar.
    • User feedback will be gathered to enhance response quality and the overall interactive experience.

This proof of concept aims to demonstrate the feasibility of creating a hyper-realistic 3D animated avatar connected to powerful AI language models such as GPT-4 from Azure or OpenAI’s ChatGPT, capable of responding to inquiries in both text and voice formats in a lifelike manner. Additionally, the goal is to achieve an immersive and natural conversational experience through AI-generated voice.

Description

  • Bravent

  • 2023

This proof of concept aims to develop a hyper-realistic 3D animated avatar in Unity, integrated with conversational capabilities using GPT (either GPT-4 from Azure or OpenAI's ChatGPT) and AI-generated voice. The avatar will respond to inquiries in both text/chat and voice formats, providing an immersive and realistic interactive experience.

en_US