Rapport: Interactive AI Avatars

Rapport allows users to have real-time conversations with digital characters. I work on the bridge between the AI brain and the visual body to make sure the performance feels natural and runs without lag.

  • I lead the development of the Unity plugin so other developers can easily add AI characters to their own games and apps.
  • Debugging animation tools, AI Prompt writing, and developing prototypes in C#, C++, and Javascript are just a few of my daily activities.
  • I spend a lot of time in R&D figuring out how to make AI characters move and talk in a more human way.
  • From time to time I also assist in some DevOps tasks, like setting up environments, and managing github repositories.
  • I also provide technical support for our largest clients to help them launch their projects globally.
See the Tech

Aquifer Motion: Instant Character Animation

Aquifer was built to let brands create animated content in minutes instead of weeks. I focused on making the technical side of animation simple for the people using the app.

  • I built the tools that allowed our artists to take famous characters like the Transformers or Paw Patrol and get them ready for the app.
  • I worked on the systems that helped the AI interpret facial expressions to keep the characters looking recognizable.
  • I helped set up the backbone of our asset pipeline to make sure we could push updates to users quickly and reliably.
Company Site
Ask ABC Mouse

Ask ABCmouse Android and IOS App

This pioneering initiative integrated advanced conversational AI into a premier educational platform, utilizing GPT-4 to create dynamic learning experiences. By enabling real-time dialogue with beloved animated characters, the project sought to transform passive screen time into an engaging, interactive tutoring session.

  • I was the lead engineer on this project from the first prototype all the way to the App Store launch.
  • I wrote the C# code that handles the conversation flow and keeps the AI responses safe and helpful.
  • I managed the multi-platform release to make sure the experience was identical on both iOS and Android.

SIMETRI M3TS: AR Combat Medic Training

This project used the Microsoft HoloLens 2 to train medics for high-pressure situations. It combines augmented reality with real physical equipment that you can actually hold and use.

  • I built the AR interface in Unity so that trainees could see medical data and targets while they worked.
  • I wrote the C++ code for the physical weapon controllers and sensors to make sure the hardware talked to the headset.
  • I designed a custom networking setup so all the gear stayed perfectly in sync over WiFi and Bluetooth.
  • Developed a hardware-in-the-loop integration for the SIMETRI Smart Tourniquet, requiring players to physically apply the device to halt hemorrhaging within the virtual simulation.
Read the Case Study
Smart Tourniquet

SIMETRI Smart Tourniquet

I helped develop a medical training tool that utilizes pressure sensors to monitor tourniquet application accuracy, streaming real-time performance data to a tablet for instructor evaluation.

  • Developed the sensor firmware to ensure high-speed, precision pressure data acquisition.
  • Built a custom bridge to interface the hardware with Unity, allowing the tourniquet to function as a physical controller for immersive simulations like the above M3TS project.
  • Performed hardware assembly and rigorous testing to ensure sensor accuracy and reliable data transmission across the system.
CPR Training

SIMETRI CPR Training Module

This is a hardware add-on for medical mannequins. It measures exactly how deep and how fast a student is doing chest compressions during CPR training.

  • I was the lead developer for both the mobile app and the software running on the hardware itself.
  • I also handled the physical assembly, including soldering and testing for the initial 50 units we delivered to hospitals.
  • Managed on-site deployment for the initial 50 units, providing technical installation and hands-on training for hospital staff to ensure seamless integration into their curriculum.
  • Developed a high-concurrency Unity application that allows instructors to monitor real-time compression statistics for multiple mannequins simultaneously, enabling efficient proctoring for entire classes.
  • Integrated a post-session reporting system that generates detailed performance analytics, evaluating student consistency and adherence to life-saving CPR standards.