HEIF support

[mateo]

With the upcoming iOS 11 release, Apple will use the HEIF format instead of the JPEG one as its default photo format.

I've started working on adding this support to lavf/mov. I open this ticket to track my progress (and will update it accordingly).

[Avi Alkalay]

To help with this, here is a zip with some photos, videos and photo bursts I took myself with an iPhone 7+:

​https://avi.alkalay.net/clipboard/HEIF-iOS-11.zip

Currently, this is what ffmpeg 3.3.3 on Fedora Linux knows about HEIF/HEIC:

$ ffprobe IMG_4449.HEIC
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x558604647da0] moov atom not found
IMG_4449.HEIC: Invalid data found when processing input

[Carl Eugen Hoyos]

This patch does not work for any of the files attached:
​http://ffmpeg.org/pipermail/ffmpeg-devel/2017-August/215003.html

[Kurosh Jadali]

Hello +1

Kodi is depending on this.

Thanks for the great work so far.

[james-vidmob]

+1 on this from VidMob

[Kurosh Jadali]

Hi,

Is anyone working on this?

[Justin Mo]

I write heif demux plugin for ffmpeg, it can work with vfilter

./ffmpeg -y -f heif -i ~/data/media/heif/IMG_4454.HEIC -vf "tile=8x6:48:0:0:blue, crop=4032:3024:0:0" heif2jpeg_2.jpg

./ffplay -f heif -i ~/data/media/heif/IMG_4454.HEIC -vf "tile=8x6, crop=4032:3024:0:0"

[Kurosh Jadali]

Hello, is there any update / progress on HEIF support now that IOS 12 is out?

[yosefarr]

Hi,
Any update on this?
Is anyone working on this?
Is it on your releases plans?

Thanks

[Elon Musk]

No,
No,
No.

[llogan]

To elaborate, we as an organization don't generally plan milestones. Things just happen when they do. I don't know if there are plans to work on this because I can't speak for others. The only set release plans are a loose schedule of release dates. Progress depends on contributions from interested individuals, and anyone is welcome and encouraged to do so.

The best way to get something included into FFmpeg is to participate in development. You can submit patches, fix bugs, review patches, etc. You can also post a bounty or offer to sponsor development.

[Jason]

I put up a $300 bounty on this.

[marcusj0015]

Lossless Sample 1024x1024 RGB 8 bit

[S.A.N]

I stopped waiting for the support in ffmpeg to appear.
I use for the photo a separate excellent solution with HEIF supported.
​https://github.com/libvips/libvips

[Balling]

Please note that (my issue) ​https://github.com/strukturag/libheif/issues/533 is not longer producing lossless images. Just FYI.

[Balling]

HEIC container for HEIF/AVIF is done here. ​https://trac.ffmpeg.org/ticket/7621#comment:10 maybe we can just move to jpeg-xl, patches are on the mailing list.

[Nik]

Even though the format is a mess, we still need (at least basic) support for it, as it is used extensively almost everywhere now.

[hydra3333]

I wonder if this helps: libheif
​https://github.com/strukturag/libheif

Would it be possible for ffmpeg to use it to deal with HEIF and AVIF ?

ffmpeg perhaps may be currently falling behind in this regard since newer phones produce it, which means there'd be an increasing volume of images etc using it.

With fingers crossed, submitting this for your consideration.

[Balling]

This is now partially fixed in a0821345eb31b727d93c9c3ed7d74d2774c73afa

[hydra3333]

Thankyou Balling.
I use the MABS build system to build a standalone x64 ffmpeg executable for use in Win11 ...
Which heif library does ffmpeg recognise and would need to be built and provided to ffmpeg at built time for ffmpeg to recognise and "use" it at runtime ? Is it ​https://github.com/strukturag/libheif ?
If so I guess it could be build by MABS (I am unsure if a heif lib is or isn't currently built as a part of the ffmpeg build process, and will look it up given your advice).

EDIT: Ah, sorry, please ignore this comment. Somewhat clarified over at ​https://github.com/m-ab-s/media-autobuild_suite/issues/2516#issuecomment-2477980138