Table of Contents

Class MaxineAIGSVideoEffect

Namespace
VisioForge.Core.Types.VideoEffects
Assembly
VisioForge.Core.dll

AI-powered green screen (background removal/replacement) effect using NVIDIA Maxine technology. Implements the VisioForge.Core.Types.VideoEffects.VideoEffect.

public class MaxineAIGSVideoEffect : VideoEffect, IVideoEffect

Inheritance

Implements

Inherited Members

Remarks

Available in: VideoCaptureCore, MediaPlayerCore, VideoEditCore (Windows only)

AI-powered effect using NVIDIA Maxine technology. Requires NVIDIA RTX GPU with Tensor cores.

The Maxine AI Green Screen (AIGS) effect leverages deep learning-based semantic segmentation to perform real-time person segmentation without requiring a physical green screen or chroma key backdrop. The AI model has been trained on diverse datasets to accurately distinguish human subjects from backgrounds across various lighting conditions, backgrounds, and scenarios. This eliminates the need for special lighting setups and physical green/blue screens that are required by traditional chroma keying techniques.

Unlike conventional green screen effects that rely on color-based keying (which can fail with similar colors, require even lighting, and struggle with fine details like hair), this AI approach performs semantic understanding of the scene. The neural network identifies the person(s) in the frame based on learned features such as body shape, pose, and contextual information, not just color values. This results in more accurate edge detection, better handling of semi-transparent elements like hair and clothing, and consistent performance regardless of the subject's clothing colors or the background environment.

The effect supports multiple output modes including background blur, replacement with custom images, or generating a segmentation matte for further processing. The AI model continuously adapts to changing scenes and can handle multiple people, partial occlusions, and complex backgrounds that would challenge traditional keying methods.

System requirements:

  • NVIDIA GeForce RTX 2060 or higher (Tensor cores required for real-time AI inference)
  • NVIDIA Maxine SDK installed with AI Green Screen models
  • Minimum 4GB GPU memory recommended (6GB+ for higher resolutions)
  • Windows 10/11 with latest NVIDIA drivers

Constructors

MaxineAIGSVideoEffect(string, MaxineAIGSEffectMode, string)

Initializes a new instance of the VisioForge.Core.Types.VideoEffects.MaxineAIGSVideoEffect class.

public MaxineAIGSVideoEffect(string name = "aigs", MaxineAIGSEffectMode mode = MaxineAIGSEffectMode.Background, string backgroundImage = null)

Parameters

name string

The unique name for this effect instance. Defaults to "aigs".

mode MaxineAIGSEffectMode

The AI Green Screen mode determining background processing. Defaults to VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Background.

backgroundImage string

Optional file path to background image for replacement mode. Only used when mode is VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Background.

Properties

BackgroundImage

Gets or sets the file path to the background image used when VisioForge.Core.Types.VideoEffects.MaxineAIGSVideoEffect.Mode is VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Background.

public string BackgroundImage { get; set; }

Property Value

string

Remarks

The background image will be automatically scaled to match the video resolution. For best results, use images with similar aspect ratio to your video or images that look good when stretched/cropped.

The image is loaded once at initialization and cached for performance. To change the background image during playback, update this property and reinitialize the effect.

BlurStrength

Gets or sets the blur strength when using VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Blur mode.

public float BlurStrength { get; set; }

Property Value

float

Remarks

This property only affects the output when VisioForge.Core.Types.VideoEffects.MaxineAIGSVideoEffect.Mode is set to VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Blur. The blur is applied to the background while keeping the foreground person sharp, creating a depth-of-field effect.

Mode

Gets or sets the AI Green Screen effect mode, determining how the background is processed.

public MaxineAIGSEffectMode Mode { get; set; }

Property Value

MaxineAIGSEffectMode

Remarks

Available modes include:

  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Background - Replace background with custom image
  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Blur - Blur the background while keeping the subject sharp
  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Matte - Output alpha matte (segmentation mask)
  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.Green - Replace background with green screen
  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.White - Replace background with white
  • VisioForge.Core.Types.VideoEffects.MaxineAIGSEffectMode.None - Output segmentation without background processing

See Also