wiki:

Hardware

/

QuickSync

WARNING: DO NOT install the Intel Media SDK without being sure that you need it, especially on Linux. In many cases you don't need it, and trying to use it may break other things.

"Intel Quick Sync Video" is the marketing name for a set of hardware features available inside many Intel GPUs.

Hardware Support

Platform Name Graphics Adds support for...
Ironlake gen5 MPEG-2, H.264 decode.
Sandy Bridge gen6 VC-1 decode; H.264 encode.
Ivy Bridge gen7 JPEG decode; MPEG-2 encode.
Bay Trail gen7 -
Haswell gen7.5 -
Broadwell gen8 VP8 decode.
Braswell gen8 H.265 decode; JPEG, VP8 encode.
Skylake gen9 H.265 encode.
Apollo Lake gen9 VP9, H.265 Main10 decode.
Kaby Lake gen9.5 VP9 profile 2 decode; VP9, H.265 Main10 encode.
Gemini Lake gen9.5 -

(Each new platform supports a superset of the capabilities of the previous platform.)

API Support

The hardware can be accessed through a number of different APIs:

DXVA2 / D3D11VA

These are standard Windows APIs, which are implemented by the Intel graphics driver to support video decode.

libmfx on Linux

This is a library from Intel which can be installed as part of the Intel Media SDK, and supports a subset of encode and decode cases.

libmfx on Windows

This is a library supplied with Intel's graphics drivers which supports all encode and decode cases.

Media Foundation

Another Windows API which supports some encode and decode cases via the Intel graphics drivers. Not supported in ffmpeg.

VAAPI with i965 driver

This is a mostly-free (but see below) driver for the libva / VAAPI instructure. Most Linux distributions package it.

VAAPI with iHD driver

The back-end of libmfx on Linux uses a modified libva and VAAPI driver; this can also be used directly by the user.

Linux

It is strongly recommended to use VAAPI with the i965 driver if possible. Only use libmfx if your use-case specifically requires its particular feature set.

VAAPI / i965

  • Packaged as standard in most Linux distributions.
  • Runs on all usable hardware, including older and cheaper devices.
  • Wider codec support.
  • Common API for applications which may also use AMD / Nvidia hardware with Mesa.
  • Interopable with standard APIs (EGL/OpenGL, OpenCL).

libmfx

  • May give better encode quality in some cases (?).
  • May give higher encode throughput in some cases (particularly on Iris graphics).
  • Common API for applications which may also run on Windows.
  • Interoperable with Intel OpenCL implementation.

Windows

(TODO)

Running

VAAPI

See Hardware/VAAPI.

DXVA2 / D3D11VA

libmfx

The library has a large number of options to set, the possible valid values of are dependent on the version and hardware. libavcodec attempts to map common options sensibly to the libmfx options, but the mapping is crude and has holes, especially around rate control.

Using an invalid combination is likely to provoke the message: "Selected ratecontrol mode is not supported by the QSV runtime. Choose a different mode." Usually this message is accurate, but it can also refer to other issues like the lack of a usable device.

Installing the Media SDK on Linux

Note that the kernel patches and modified system libraries are all required. It is recommended not to install this on any machine also used for other purposes, as it does not use normal distribution mechanisms and may break / be broken by other packages unexpectedly.

Build machine:

  • Build and install the packaged dispatcher: <https://github.com/lu-zero/mfx_dispatch>. (It is also possible to extract the necessary files from the Media SDK installation as described in the install manual - this is not recommended, just use the package instead.)
  • Build ffmpeg with --enable-libmfx.

Target machine:

  • Ensure the target machine has a supported CPU. Current versions only support gen8/gen9 graphics on expensive CPUs ("Xeon"/"Core i" branding). The same graphics cores on cheaper CPUs ("Pentium"/"Celeron"/"Atom" branding) are explicitly disabled, presumably for commercial reasons.
  • Get a clean version of the supported kernel version (currently 4.4: <https://www.kernel.org/pub/linux/kernel/v4.x/linux-4.4.tar.xz>) and apply the supplied patches. Build and install.
  • Build and install the supplied libva and libdrm trees.
  • Run the Media SDK install script to install the proprietary components.
  • Reboot.

Licence status of i965 VAAPI driver

All of the user source code is available, but it includes proprietary blobs of compiled GPU code. Since the complete human-readable source is not available, this certainly renders it GPL-incompatible and is likely to cause issues with other copyleft licences. Using the libva dynamic-loading shim mostly sidesteps this, and therefore is encouraged.

Last modified 5 weeks ago Last modified on Jul 19, 2017, 11:19:11 PM