{"id":690,"date":"2023-08-11T19:45:15","date_gmt":"2023-08-11T18:45:15","guid":{"rendered":"https:\/\/mosqueraperez.es\/?post_type=fw-portfolio&#038;p=690"},"modified":"2023-08-11T19:47:29","modified_gmt":"2023-08-11T18:47:29","slug":"jarventgpt-a-ia-avatar","status":"publish","type":"fw-portfolio","link":"https:\/\/mosqueraperez.es\/en\/project\/jarventgpt-a-ia-avatar\/","title":{"rendered":"JarventGPT &#8211; A IA Avatar"},"content":{"rendered":"<figure class=\"wp-block-video\"><video controls src=\"https:\/\/mosqueraperez.es\/wp-content\/uploads\/2023\/08\/JarventGPT-2023-08-11-20-43-14.mp4\"><\/video><\/figure>\n\n\n\n<p>This proof of concept aims to develop a hyper-realistic 3D animated avatar in Unity, integrated with conversational capabilities using GPT (either GPT-4 from Azure or OpenAI&#8217;s ChatGPT) and AI-generated voice. The avatar will respond to inquiries in both text\/chat and voice formats, providing an immersive and realistic interactive experience.<\/p>\n\n\n\n<p>Key Features:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Creation of the Hyper-Realistic Avatar:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Unity will be employed, utilizing the High Definition Render Pipeline (HDRP) for the PC version, and the Universal Render Pipeline (URP) with a more modest and cartoonish graphical style for the web version.<\/li>\n\n\n\n<li>A highly detailed 3D model will be designed for the avatar, featuring photorealistic textures, advanced lighting, and stunning visual effects for the PC version.<\/li>\n\n\n\n<li>For the web version, the avatar will be adapted to embrace a lighter, cartoonish graphical style, ensuring optimal performance in web browsers.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Integration with GPT and Response Generation:<\/strong>\n<ul class=\"wp-block-list\">\n<li>An API integration with either GPT-4 from Azure or OpenAI&#8217;s ChatGPT will be established to enable conversational interactions with the avatar.<\/li>\n\n\n\n<li>User input in the form of text or voice will be sent to the corresponding API, and the response generated by GPT will be received and conveyed by the avatar.<\/li>\n\n\n\n<li>Responses will be tailored to ensure a consistent and natural conversational tone and style.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Natural Voice Generation:<\/strong>\n<ul class=\"wp-block-list\">\n<li>An AI-driven voice generation engine will be implemented to achieve smooth and natural voice reproduction.<\/li>\n\n\n\n<li>The avatar&#8217;s voice will be generated in real-time and synchronized with the provided responses.<\/li>\n\n\n\n<li>A lip-sync system will be employed to ensure mouth movements align with spoken words.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>User Interaction:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Users will be able to query the avatar using both text\/chat and voice commands.<\/li>\n\n\n\n<li>An intuitive user interface will be developed, allowing users to type queries or communicate directly with the avatar using voice commands.<\/li>\n\n\n\n<li>Responses will be visually presented in the interface and articulated by the avatar in a natural manner.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Two Adapted Versions:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Two avatar versions will be provided to accommodate varying hardware capabilities and visual preferences.<\/li>\n\n\n\n<li>The PC version with HDRP will deliver hyper-realistic graphics, while the web version with URP will offer a lighter, cartoonish graphical style.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Testing and Evaluation:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Thorough testing will be conducted to ensure smoothness and coherence in conversations between users and the avatar.<\/li>\n\n\n\n<li>User feedback will be gathered to enhance response quality and the overall interactive experience.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<p>This proof of concept aims to demonstrate the feasibility of creating a hyper-realistic 3D animated avatar connected to powerful AI language models such as GPT-4 from Azure or OpenAI&#8217;s ChatGPT, capable of responding to inquiries in both text and voice formats in a lifelike manner. Additionally, the goal is to achieve an immersive and natural conversational experience through AI-generated voice.<\/p>","protected":false},"featured_media":691,"template":"","fw-portfolio-category":[43,41],"class_list":["post-690","fw-portfolio","type-fw-portfolio","status-publish","has-post-thumbnail","hentry","fw-portfolio-category-bravent","fw-portfolio-category-prototype"],"_links":{"self":[{"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/fw-portfolio\/690","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/fw-portfolio"}],"about":[{"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/types\/fw-portfolio"}],"version-history":[{"count":2,"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/fw-portfolio\/690\/revisions"}],"predecessor-version":[{"id":695,"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/fw-portfolio\/690\/revisions\/695"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/media\/691"}],"wp:attachment":[{"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/media?parent=690"}],"wp:term":[{"taxonomy":"fw-portfolio-category","embeddable":true,"href":"https:\/\/mosqueraperez.es\/en\/wp-json\/wp\/v2\/fw-portfolio-category?post=690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}