DefaultGlFrameProcessor


@ExperimentalApi
public final class DefaultGlFrameProcessor implements FrameProcessor


A FrameProcessor implementation that executes a chain of GlTextureFrameConsumers.

Summary

Nested types

@RequiresApi(value = 26)
public final class DefaultGlFrameProcessor.Factory implements FrameProcessor.Factory

A FrameProcessor.Factory that creates DefaultGlFrameProcessor instances.

A builder for Factory instances.

Constants

static final ColorInfo

An HDR color space with BT.2020 color primaries, and HLG transfer function.

static final ColorInfo

An HDR color space with BT.2020 color primaries, and linear transfer function.

static final ColorInfo

An SDR color space with BT.709 / sRGB color primaries, and linear transfer function.

static final ColorInfo

An SDR color space with BT.709 / sRGB color primaries, and sRGB transfer function.

static final String
KEY_COMPOSITION_EFFECTS = "KEY_COMPOSITION_EFFECTS"

Metadata key for storing the List of video effects to apply on the composited frames, in frame metadata.

static final String
KEY_COMPOSITION_SEQUENCE_INDEX = "KEY_COMPOSITION_SEQUENCE_INDEX"

Metadata key for storing the integer index to identify the source sequence in a Composition from which an input frame comes, in frame metadata.

static final String
KEY_COMPOSITOR_SETTINGS = "KEY_COMPOSITOR_SETTINGS"

Metadata key for storing the VideoCompositorSettings, in frame metadata.

static final String
KEY_FRAME_DISCONTINUITY_NUMBER = "KEY_FRAME_DISCONTINUITY_NUMBER"

Metadata key for storing the frame discontinuity number, in getMetadata and getMetadata.

static final String
KEY_ITEM_EFFECTS = "KEY_ITEM_EFFECTS"

Metadata key for storing the List of video effects to apply on a single media item, in frame metadata.

Public methods

void

Blocks until all resources are released.

boolean

Attempts to queue a List of frames for processing.

void

Notifies this processor that the current stream has ended.

Inherited methods

From java.lang.AutoCloseable
abstract void

Constants

BT2020_HLG

public static final ColorInfo BT2020_HLG

An HDR color space with BT.2020 color primaries, and HLG transfer function.

When input is PQ or Ultra HDR (JPEG_R), values are first converted to optical linear BT.2020 display light and normalized against the 1,000-nit HLG reference display peak. The resulting display light is converted to scene light via inverse HLG OOTF (system gamma 1.2) and encoded into an HLG electrical signal using the BT.2100 HLG OETF.

HLG signal cannot represent scene light above 1.0 (either from display light above the 1,000-nit reference peak or saturated primaries where inverse OOTF boosts channel values above 1.0), so scene light is scaled down to fit in [0.0, 1.0] after the inverse HLG OOTF and before the OETF; all channels are scaled equally to preserve chromaticity.

The values are always scene-referred.

BT2020_LINEAR

public static final ColorInfo BT2020_LINEAR

An HDR color space with BT.2020 color primaries, and linear transfer function.

Values are display-referred linear optical light anchored on the ITU-R BT.2408 203-nit diffuse white reference, so 1.0 represents diffuse white, the 1,000-nit HLG reference peak evaluates to ~4.9224, and the 10,000-nit PQ peak evaluates to ~49.2242.

When input is HLG, HLG scene-referred electrical values are converted to display light using the ITU-R BT.2100 HLG EOTF (OOTF_1.2(OETF^-1(E))) and scaled onto the diffuse white anchor. When input is PQ, PQ electrical values are linearized using the SMPTE ST 2084 EOTF and scaled onto the diffuse white anchor. When input is Ultra HDR (JPEG_R), the sRGB base image is linearized to optical BT.709 display light (1.0 = 203-nit diffuse white), boosted by the gainmap up to the 1,000-nit reference peak (~4.9224), and converted to BT.2020.

BT709_LINEAR

public static final ColorInfo BT709_LINEAR

An SDR color space with BT.709 / sRGB color primaries, and linear transfer function.

BT709_SRGB

public static final ColorInfo BT709_SRGB

An SDR color space with BT.709 / sRGB color primaries, and sRGB transfer function.

KEY_COMPOSITION_EFFECTS

public static final String KEY_COMPOSITION_EFFECTS = "KEY_COMPOSITION_EFFECTS"

Metadata key for storing the List of video effects to apply on the composited frames, in frame metadata.

The order of effect application is KEY_ITEM_EFFECTS, KEY_COMPOSITOR_SETTINGS and then KEY_COMPOSITION_EFFECTS.

KEY_COMPOSITION_SEQUENCE_INDEX

public static final String KEY_COMPOSITION_SEQUENCE_INDEX = "KEY_COMPOSITION_SEQUENCE_INDEX"

Metadata key for storing the integer index to identify the source sequence in a Composition from which an input frame comes, in frame metadata.

KEY_COMPOSITOR_SETTINGS

public static final String KEY_COMPOSITOR_SETTINGS = "KEY_COMPOSITOR_SETTINGS"

Metadata key for storing the VideoCompositorSettings, in frame metadata.

When using CompositionPlayer or Transformer, the value is Composition#videoCompositorSettings.

The order of effect application is KEY_ITEM_EFFECTS, KEY_COMPOSITOR_SETTINGS and then KEY_COMPOSITION_EFFECTS.

KEY_FRAME_DISCONTINUITY_NUMBER

public static final String KEY_FRAME_DISCONTINUITY_NUMBER = "KEY_FRAME_DISCONTINUITY_NUMBER"

Metadata key for storing the frame discontinuity number, in getMetadata and getMetadata.

The number is an integer, incremented every time the player reports a discontinuity (for example, when seeking).

The number is only mandatory for previewing use cases. It is used to trigger flushes in GlShaderProgram implementations during discontinuities.

KEY_ITEM_EFFECTS

public static final String KEY_ITEM_EFFECTS = "KEY_ITEM_EFFECTS"

Metadata key for storing the List of video effects to apply on a single media item, in frame metadata.

The order of effect application is KEY_ITEM_EFFECTS, KEY_COMPOSITOR_SETTINGS and then KEY_COMPOSITION_EFFECTS.

Public methods

close

public void close()

Blocks until all resources are released.

queue

public boolean queue(List<AsyncFrame> frames)

Attempts to queue a List of frames for processing.

All frames provided in a single invocation of this method represent the exact same point in time.

If this consumer is at capacity, this method returns false and the onWakeup will be invoked when capacity becomes available.

If this method returns true, onFrameProcessed must be called once with every input frame instance queued, once the FrameProcessor has finished processing the frames.

Parameters
List<AsyncFrame> frames

The frames to queue.

Returns
boolean

true if the frames were queued, false if the consumer is at capacity.

signalEndOfStream

public void signalEndOfStream()

Notifies this processor that the current stream has ended.

More frames may be queued after calling this method, if the current stream changes.