Applying AI and 3D Skills for an International Client Project

David Pinzón

Hello, I’m David, a multimedia producer and 3D designer from Cali, Colombia. A year ago, I studied at Libel Academy and completed a master’s program in Character Creator 4 (CC4) and ZBrush. This course provided me with a solid foundation in ZBrush, Character Creator 4, Blender, and Substance Painter. It allowed me to hone my skills and techniques in 3D design.

Although my professional background is in multimedia production, I decided to delve deeply into 3D design. I traveled to San José, Costa Rica, for an internship at a Virtual Production studio. There, I rediscovered my passion for 3D design. I created my first virtual environment using Unreal Engine 5.

My favorite tools for working include ZBrush, Blender, Substance Painter, and Character Creator. Each of these tools enables me to explore different aspects of design and elevate my ideas to new heights.

What I love most about being a 3D designer is the ability to create worlds and characters from scratch. I can bring my ideas to life. It pushes my creativity to the limit. It’s incredible to see how my designs come to life and interact with people in real-time.

One of the most notable projects in my career was creating a 3D character for an event in Malaysia. This character was designed in Character Creator and refined in ZBrush. It was integrated into Unreal Engine and connected with artificial intelligence. This enabled real-time verbal interaction during the event. This project not only allowed me to apply my technical skills. It also allowed me to use my ability to innovate and solve problems. This was especially true when we had to set everything up remotely using Pixel Streaming technology.

“One of the most notable projects in my career was creating a 3D character for an event in Malaysia. This character was designed in Character Creator and refined in ZBrush. It was integrated into Unreal Engine and connected with artificial intelligence for real-time verbal interaction during the event. This project not only allowed me to apply my technical skills. It also allowed me to use my ability to innovate and solve problems. “

David  Pinzón – Multimedia Producer | 3D Designer

“Would you recommend the union of these two software? ZBrush and Character Creator?

Totally! The truth is that I believe it is a lot easier to reach final results that look really professional. The truth is that I believe it is a lot easier to reach final results that look really professional.

It helped me so much being able to integrate Character Creator to my design workflow, because not only could I achieve a base for the character, but also a base that I could later animate with ease.

So we can say that we save many spaces (labor), and many moments to say it that way, to reach the final result.

How did you achieve your first 3D contract?

Well I was super happy because in a matter of months I was able to find a very good project. Through a client in Colombia we were able to take a project in Malaysia for an international event. It was a very good experience. The truth is that I had very good tools that allowed me to reach that final result.

What would you recommend to 3D Designers?

To research well the facilities we have with artificial intelligence and these new tools. They have served me much in saving effort, and in having this plus that in the final result.

David  Pinzón – Multimedia Producer | 3D Designer

Workflow Description

Reallusion Tools Used

For the base design of the character, I used Character Creator 4 (CC4). Afterwards, I made adjustments and customized the character in ZBrush.

Main Challenges and Solutions

One of the main challenges was the need to prepare everything from Character Creator for remote execution. We used Unreal Engine’s Pixel Streaming technology, relying on third-party services to ensure the best quality.

Steps from Conceptualization to Project Completion

Planning Stage:

1. Executive Approval: In the early stages of the project, iClone was instrumental in creating and presenting preliminary animations. Company executives then approved these animations.

Avatar Design

1. Base Design: I used Character Creator to get a solid and easily manipulable base.
2. Customization: I customized the character in ZBrush to give it a unique look.
3. Texture Editing: I edited colors and textures in Substance Painter.

Integration into Unreal Engine

1. Integration: I integrated the finished character into Unreal Engine using the “Unreal Auto Setup” tool.
2. Adjustments: I made adjustments to the lighting and camera in Unreal.

Implementation of Artificial Intelligence

1. AI Integration: I used Convai technology to integrate artificial intelligence into the character.
2. Training: I trained the character with the necessary information for the event. I gave it a name. I provided a voice generated by Eleven Labs.
3. Lip Sync Synchronization: I synchronized the lip sync using tools provided by Convai.

Remote Projection

1. Projection Setup: I used Eagle 3D Streaming technology for projection via Pixel Streaming.
2. Server Setup: I set up the project on their servers. I ensured the quality needed to obtain a remote connection link.
3. Opening & Presentation at Event: iClone was used to generate the introduction to the event. It was also used to create some supporting videos. These videos were shown throughout the presentation.

This project allowed me to combine various tools and technologies innovatively. I achieved a unique interactive experience for the event in Malaysia.

Follow David Pinzón:

ArtStation:
https://www.artstation.com/dapin

Website:
https://www.digitalrising.us/

Related Posts

• Audio to Animation AI-Integration in iClone with Audio2Face
• ZBrush Face Tools Help Character Artists Bridge the Skill Gap to Achieve Expressive Animations
• Prompt Muse – Unleash the Power of AI to Create Next-Level Animations