Core Services

These are the primary services that comprise an Omniverse Application Streaming API instance.

Omniverse Application Store

Allows users to list and manage Omniverse streaming applications and runtime profiles, enhancing the user experience and integration within the Omniverse ecosystem.

Omniverse Streaming Session Manager

Facilitates the creation and management of NVIDIA Kit application streams, ensuring efficient allocation and utilization within a Kubernetes cluster.

Omniverse Resource Management Control Plane

Offers comprehensive lifecycle management for Helm charts and resources, enabling the instantiation of charts and overseeing the resources spawned by these charts.

Omniverse Streaming AWS NLB Manager (optional)

Manages a pool of listeners and target groups bound to Network Load Balancers. On creation of a stream, a set of target group and listeners are selected and attached to the stream. At termination, the target group and listener are returned to the pool.

Additional components

Memcached Shared Shader Cache

The memcached shader cache provides a shared cache across GPU worker nodes, allowing reuse of compiled shaders across the cluster, significantly improving Kit application start-up time.