Research

Graduate Work in MADTech Program at NCSU

Dragon’s Den – Unity Engine Game

---

In order to build the immersive worlds I created in game engines like Unreal Engine 5 and Unity, I used a wide variety of tools. Some examples include procedural terrains, AI skyboxes, and 3D assets from Quixel Megascans. I used the Blueprint in UE5 to have an OpenDoor function which was dependent on the Chestnut Collectibles. As for Unity I had multiple C# mechanics, to name a few, “DoorTrigger, TextHint, ObjectPickup” are just a few scripts that were used for my game. Lastly, I  added  a shooter and object trigger upon shooting to light the flame for the dragon. 

To make my Metahuman I first had to use photogrammetry in Reality Capture to scan my face. Then, I imported that scan in the Metahuman Creator to create my digital double. Next, I used Noitom Perception Neuron Studio Inertial Suit to mocap my body and the Rokoko Headrig to capture my face for Metahuman Animator, and lastly processed the data into UE5 Sequencer. I applied Curtis Hickman’s concept of Hyper Reality into my cultural heritage projects. For each game I tried to incorporate elements that would represent my Korean culture. Some examples would be green jade, dragon symbolism, traditional architectural buildings, and Hanbok (traditional Korean dress). Specifically for Unreal Engine 5 I wanted to create an immersive experience with my passed Grandmother. By incorporating my Korean language, it felt as if I was truly present with her, speaking our native tongue. That to me was the most fulfilling gift to ever receive from a game engine.

Mitchelville Tour Interpretive Scene Test: Intro to Ghosted Structures & Gullah Elders

This funded digital design research project was developed over the summer 2024 semester to develop a proof-of-concept video of a virtual tour of Historic Mitchelville Freedom Park (HMFP) on Hilton Head Island South Carolina. Mitchelville was the first black town in America during the Civil War (founded 1862) and today a Gullah-Geechee cultural heritage site. We processed photogrammetry and performance capture data of Gullah elders and the Executive Director of HMFP to create Metahuman virtual docents for an interpretive scene introducing the park and elders. The results of this research were submitted to a National Endowment of the Humanities (NEH) Digital Projects for the Public grant (prototyping-level) to continue this important work in Media Arts, Design and Technology (MADTech).

We rendered our Metahuman sequences in an Unreal Engine scene that simulated the new “ghosted structures” location in the park using 360 photography as a “skydome” background and by modeling a 3D version of a ghosted structure house using reference material from Mitchelville. We added visual and audio effects to apply a hyper-reality or magical aesthetic to the
final design of our animation, inspired by VR magician Curtis Hickman who gave a guest lecture to our MADTech students in the spring semester.

What we learned: How to create test renders in UE5.4 Sequencer to iteratively improve the animation using video from the original capture. We also added visual effects and video titles in postproduction using Adobe Premiere. The challenge was to be true to the expressive quality of the actor’s performance.

---

NCSU Virtual Production

---

UNCG BFA Senior Capstone Work

Sister Sun + Brother Moon

3D Environment created in Maya

---

For my senior capstone, I was able to combine the aspects of my identity and artistic skills into my project. I based it on a Korean folklore called, “Sister Sun and Brother Moon.” This folklore is very special and personal to me because my mother and grandmother would read it to me as a child. I created a digital version of this world in Maya, detailing their home and the environment to tell the folklore visually. The house is in a traditional Korean style called “Hanok” and is set during the Joseon Period, 1392-1910. In this interactive 3D environment, the viewer can move throughout the world, exploring it as if they are immersed within it, finding clues about the story of the siblings.