Blog
Audio2Face + Audio2Gesture - Merging the Streams with OpenUSD
February 15, 2024NVIDIA Omniverse includes a number of AI based tools, including Audio2Face and Audio2Gesture. Audio2Face takes an audio file and generates facial blend shape animations. Audio2Gesture ...
Resources to help learn OpenUSD
February 11, 2024There was a recent Omniverse Discord thread that had some great links to videos by @Simplychenable. I am capturing the videos here for later reference. ...
OpenUSD UsdPreviewSurface Material Portability
February 6, 2024I am interested in OpenUSD for portability of content. Instead of being tied to one rendering engine, my content can be rendered in multiple tools. ...
Animated Voiceovers
February 3, 2024Want to add a bit more "life" to your video voiceovers, but don't want to show your own face? How about using a 3D avatar, ...
CloudZeta - GitHub for 3D Assets
January 19, 2024I sometimes listen in on the Academy Software Foundation (https://www.aswf.io/) sessions. The latest Web OpenUSD online meeting had a presentation by CloudZeta, OpenUSD for 3D ...
TensorFlow.js in the browser for expression prediction
January 11, 2024In my last post I introduced the approach of using Google MediaPipe to control VRM character facial expressions. Hasn't this been done before? Yes! There ...
Getting Google MediaPipe to control VRM Characters
January 7, 2024I am working on a web based 3D animation project where you can create an animated video using 3D character models, like a cut scene ...
Generative AI for 3D Scene Backgrounds
December 14, 2023Generative AI can be great for background images in animated videos. Want a single shot walking along a path? Creating a background image can take ...
Retargeting Skeletal Animation to USD
November 13, 2023I am working on a project where I want to manipulate Skeletal Animation clips (for 3D computer animation) in JavaScript, then export to USD. Depressingly ...
AI and Animation - the path ahead
November 6, 2023Generative text to image AI is pretty amazing. If you can write, you can create an image. Generative AI for video is also making great ...
OpenUSD on the Web - October '23 Musings
October 12, 2023TL;DR: In this post I explore the pros and cons of using OpenUSD directly in web applications. What is OpenUSD? "Developed by Pixar, Universal Scene ...
Options for representing Animation in OpenUSD
September 27, 2023I have been exploring NVIDIA Omniverse and the standard it is built on, OpenUSD (aka USD). It provides a number of ways to animate objects ...
Sunbeams via Fog in Omniverse
September 14, 2023I am trying to work out how to do various cinematic effects in Omniverse. This post is one step on that journey, particularly for "God ...
Making the Omniverse Hub Vision Reality
August 9, 2023At SIGGRAPH 2023, Jensen Huang (founder and CEO of NVIDIA) described Omniverse as more of a connector of tools, rather than the only tool you ...
NVIDIA Omniverse and the SIGGRAPH 2023 Keynote
August 8, 2023SIGGRAPH 2023 kicked off this week and the keynote was from Jensen Huang, NVIDIA founder and CEO. I have been using NVIDIA Omniverse, so I ...
Omniverse Start to Finish - Wind Animation
July 24, 2023I created a scene using NVIDIA Omniverse standard assets. No movement in the trees or grass. Ideally want some wind to give the feeling of ...
Displaying USD 3D Models in a Web Browser
July 16, 2023I was exploring how to display a USD model in a web browser. A few people had asked about streaming Omniverse output into a browser ...
Omniverse 105 (beta) Colliders for Particle Mesh Hair and Clothes
July 4, 2023I am trying to identify a good solution for dangling hair bounces and cloth (e.g., a skirt) in NVIDIA Omniverse for characters/avatars. The recently released ...
Animation Retargeting in Omniverse
July 1, 2023In NVIDIA Omniverse (and OpenUSD in general), animation clips are tied to a specific set of skeletal bone names. This is fine if you create ...
Using Omniverse Audio2Face in Animated Film Production
June 29, 2023NVIDIA Omniverse includes Audio2Face, an AI powered audio clip to facial animation tool. Give it a voice track, and it can animate the face of ...
Implementing Springbones in Omniverse
June 17, 2023I am trying to bring VRoid Studio characters into NVIDIA Omniverse. Omniverse has powerful deformers and particle cloth physics support which I am still exploring ...
USD Variants and Variant Sets
June 4, 2023Pixar USD (Universal Scene Description) is for modeling 3D worlds such as used in computer animated movies, 3D video games, VR/AR experiences, architecture, and robotics ...
Practical Tips for Structuring Stories
June 3, 2023I have found the Writing Excuses podcast (and archives) very useful to learn about the art of story writing. One I found particularly useful was ...
First Steps for VRoid Studio characters in NVIDIA Omniverse
May 28, 2023I have been working on getting a VRoid Studio character imported into NVIDIA Omniverse. VRoid Studio is free software by Pixiv for creating 3D avatars. ...