noto-emoji Coding Comparisons

There were 17 images used to calculate the data below. The average resolution for all of the images is 512x512 or 0.3 Megapixels.

Updated 2022-12-14 (history)

Transcode Timing Graphs

Format Best Quality(Slowest) Default On The Fly(Fastest)
AVIF Speed 0 Speed 6 Speed 9
JPEG XL Effort 9 Effort 7 Effort 3
WebP Method 7 Method 4 Method 0
noto-emoji chart showing fastest encode mode WebP > AVIF > JPEG XL. Other modes, AVIF and JPEG XL are similar noto-emoji chart showing transcode performance with eight threads.
noto-emoji chart showing transcode performance for all efforts and speeds for WebP, AVIF, JPEG XL, and MozJPEG. noto-emoji chart showing transcode performance with eight threads for WebP, AVIF, JPEG XL, and MozJPEG.
noto-emoji chart showing transcode performance with multiple threads.

Source Images

The source images can be found here: noto-emoji.tar.gz
For more information see the main Noto Emoji project as well as the About & License page.

Quality Table

To read the tables below you first look at the title column which will have image format 1 vs image format 2.
For example if the title is "AVIF s5 vs JPEG XL s8", then image format 1 would be "AVIF" and "s5" specifies speed 5, and image format 2 would be "JPEG XL" and "s8" specifies effort 8.

Image format 1 had a better overall rate if the percentages are shaded like this:
-51.0% -41.0% -31.0% -21.0% -11.0% -1.0%

Image format 2 had a better overall rate if the percentages are shaded like this:
51.0% 41.0% 31.0% 21.0% 11.0% 1.0%

Notes:

Metrics One Thread AVIF speed 0 vs Speed 6

These values depict the current best AVIF quality versus the default AVIF settings.
title psnr_magick psnr_hvs psnr_y ssim ssim_magick msssim dssim vmaf ciede2000 ssimulacra ssimulacra2 butteraugli p3norm
AVIF s0 vs AVIF s6 -21.84% -22.46% -24.64% -22.76% -25.00% -24.79% -23.19% -21.46% -24.60% -24.14% -21.95% -20.47% -18.95%

Metrics One Thread Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.
title psnr_magick psnr_hvs psnr_y ssim ssim_magick msssim dssim vmaf ciede2000 ssimulacra ssimulacra2 butteraugli p3norm
AVIF s3 vs JPEG XL s9 -61.42% -75.56% -77.52% -89.32% -84.51% -80.08% -61.09% -87.77% -63.08% -59.76% -58.49% -50.33% -42.69%
AVIF s4 vs JPEG XL s8 -61.11% -75.20% -77.06% -87.69% -83.45% -79.38% -60.26% -86.66% -62.74% -59.07% -57.42% -51.30% -43.62%
AVIF s7 vs JPEG XL s7 -57.87% -71.17% -70.21% -82.83% -78.84% -72.94% -55.78% -76.69% -58.25% -52.75% -53.69% -49.28% -41.54%
AVIF s8 vs JPEG XL s4 -82.90% -79.06% -79.27% -80.37% -87.97% -77.66% -68.71% -77.64% -70.78% -70.91% -55.34% -37.66% -39.74%


Metrics Eight Threads Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.
title psnr_magick psnr_hvs psnr_y ssim ssim_magick msssim dssim vmaf ciede2000 ssimulacra ssimulacra2 butteraugli p3norm
AVIF s6 vs JPEG XL s7 -57.27% -69.80% -68.12% -78.05% -75.92% -70.46% -56.36% -72.58% -56.73% -51.22% -52.50% -48.10% -40.58%
AVIF s8 vs JPEG XL s4 -78.53% -73.34% -74.21% -77.24% -84.66% -67.29% -60.22% -67.81% -66.27% -59.51% -44.43% -25.32% -26.23%


Metrics Eight Threads Common Speeds/Efforts

The effort/speed for the transcodes listed below were selected because they should have the best quality (slowest), fastest (on the fly), default, or only option available (MozJPEG and libjpeg-turbo).
title psnr_magick psnr_hvs psnr_y ssim ssim_magick msssim dssim vmaf ciede2000 ssimulacra ssimulacra2 butteraugli p3norm
AVIF s0 vs JPEG XL s9 -60.90% -74.82% -76.31% -86.73% -84.37% -78.76% -60.12% -84.79% -63.25% -59.44% -57.15% -49.82% -41.58%
AVIF s6 vs JPEG XL s7 -57.27% -69.80% -68.12% -78.05% -75.92% -70.46% -56.36% -72.58% -56.73% -51.22% -52.50% -48.10% -40.58%
AVIF s9 vs JPEG XL s3 -48.20% -38.30% -25.35% -36.96% -56.59% -23.85% -11.58% -12.10% -5.09% 7.57% 28.36% 46.53% 31.10%


Metrics One Thread Common Speeds/Efforts

The effort/speed for the transcodes listed below were selected because they should have the best quality (slowest), fastest (on the fly), default, or only option available (MozJPEG and libjpeg-turbo).
title psnr_magick psnr_hvs psnr_y ssim ssim_magick msssim dssim vmaf ciede2000 ssimulacra ssimulacra2 butteraugli p3norm
AVIF s0 vs JPEG XL s9 -61.66% -76.29% -79.30% -90.31% -85.42% -81.64% -62.19% -89.94% -63.95% -61.13% -59.12% -50.84% -41.65%
AVIF s6 vs JPEG XL s7 -60.17% -73.71% -73.37% -84.02% -80.51% -75.98% -58.20% -80.86% -61.66% -56.89% -56.17% -52.90% -44.32%
AVIF s9 vs JPEG XL s3 -54.05% -45.63% -31.31% -43.00% -60.82% -31.81% -21.40% -20.58% -11.29% -0.95% 19.07% 33.75% 18.14%
AVIF s0 vs WebP s6 -68.92% -62.09% -67.59% -73.68% -62.73% -74.79% -73.38% -67.85% -65.54% -73.28% -68.10% -66.38% -64.13%
AVIF s6 vs WebP s4 -61.11% -55.16% -59.25% -62.44% -55.17% -64.44% -62.75% -61.54% -56.98% -65.63% -59.21% -54.47% -55.49%
AVIF s9 vs WebP s0 -13.61% -15.77% -1.69% -37.73% -31.41% -26.61% -26.19% -17.10% -14.77% -25.53% -21.33% -20.07% -22.44%
JPEG XL s9 vs WebP s6 41.87% 72.37% 48.12% 118.58% 122.95% 59.46% 35.12% 58.40% 30.96% -6.17% 4.93% 5.46% 2.16%
JPEG XL s7 vs WebP s4 47.33% 75.45% 51.51% 120.49% 123.59% 59.46% 38.19% 53.40% 35.39% -9.03% 6.34% 18.06% 2.86%
JPEG XL s3 vs WebP s0 80.77% 49.37% 45.47% 8.31% 33.09% 7.72% -4.65% 9.26% 1.18% -13.99% -27.16% -33.76% -30.50%
AVIF s0 vs MozJPEG s0 -83.25% -69.79% -90.86% -84.67% -84.28% -85.74% -83.59% -86.60% -85.74% -90.91% -88.64% -85.22% -84.98%
AVIF s6 vs MozJPEG s0 -81.83% -65.85% -89.42% -74.36% -81.22% -80.21% -79.41% -83.02% -83.42% -88.96% -85.94% -81.47% -82.69%
AVIF s9 vs MozJPEG s0 -38.18% -6.74% -55.89% -2.06% -27.51% -23.80% -28.07% -18.72% -40.66% -42.73% -40.28% -26.10% -35.83%
JPEG XL s9 vs MozJPEG s0 -31.75% 24.78% -55.77% 27.08% 15.62% -8.17% -20.89% -4.81% -42.25% -63.37% -55.02% -49.69% -53.72%
JPEG XL s7 vs MozJPEG s0 -31.34% 27.35% -56.34% 37.71% 20.98% -6.36% -18.58% -5.86% -41.93% -63.81% -54.60% -46.14% -54.62%
JPEG XL s3 vs MozJPEG s0 36.12% 74.22% -33.87% 67.93% 40.63% 12.00% -7.82% 3.05% -25.92% -41.13% -53.48% -52.90% -49.71%
AVIF s0 vs Turbo s0 -81.68% -78.56% -88.58% -87.14% -87.89% -87.45% -84.68% -84.38% -86.56% -91.49% -85.02% -83.38% -82.36%
AVIF s6 vs Turbo s0 -80.64% -75.90% -86.69% -83.42% -86.28% -85.13% -82.40% -82.72% -84.43% -90.12% -82.75% -80.55% -81.10%
AVIF s9 vs Turbo s0 -51.35% -45.40% -57.08% -53.29% -58.30% -60.91% -59.58% -52.37% -53.97% -65.67% -57.73% -53.45% -59.93%
JPEG XL s9 vs Turbo s0 -42.17% -24.79% -56.74% -34.36% -39.58% -55.43% -57.53% -47.28% -53.46% -76.18% -62.93% -61.42% -66.88%
JPEG XL s7 vs Turbo s0 -42.26% -23.61% -56.47% -28.86% -36.53% -53.38% -55.21% -45.69% -53.26% -75.98% -60.27% -57.92% -65.66%
JPEG XL s3 vs Turbo s0 4.16% 5.28% -33.25% -20.44% -24.07% -42.36% -46.15% -33.10% -36.88% -60.85% -53.87% -58.73% -61.15%

Sample Images

emoji_u1f382.png


Source, 41.23 KB
.

AVIF Speed 7, 7.98 KB
PSNR 39.49, SSIM 0.99, MS-SSIM 0.9995, SSIMULACRA 0, Butteraugli 2.84

JPEG XL Effort 7, 7.65 KB
PSNR 32.17, SSIM 0.92, MS-SSIM 0.9946, SSIMULACRA 0.02, Butteraugli 7

WebP Method 6, 7.83 KB
PSNR 36.17, SSIM 0.97, MS-SSIM 0.9973, SSIMULACRA 0.02, Butteraugli 4.51

libjpeg-turbo, 9.01 KB
PSNR 23.45, SSIM 0.805, MS-SSIM 0.932, SSIMULACRA 0.125, Butteraugli 26.14

MozJPEG, 8.08 KB
PSNR 29.89, SSIM 0.93, MS-SSIM 0.99, SSIMULACRA 0.04, Butteraugli 9.62

The zoomed images are laid out in this order:
Source 2.0x Zoom AVIF Speed 7 2.0x Zoom JPEG XL Effort 7 2.0x Zoom
WebP Method 6 2.0x Zoom libjpeg-turbo 2.0x Zoom MozJPEG 2.0x Zoom


emoji_u1f602.png


Source, 37.45 KB
.

AVIF Speed 7, 7.79 KB
PSNR 34.41, SSIM 0.97, MS-SSIM 0.9991, SSIMULACRA 0.01, Butteraugli 5.12

JPEG XL Effort 7, 8.59 KB
PSNR 27.81, SSIM 0.85, MS-SSIM 0.9917, SSIMULACRA 0.02, Butteraugli 7.24

WebP Method 6, 7.79 KB
PSNR 32.3, SSIM 0.95, MS-SSIM 0.9972, SSIMULACRA 0.02, Butteraugli 6.39

libjpeg-turbo, 9.19 KB
PSNR 23.05, SSIM 0.77, MS-SSIM 0.9388, SSIMULACRA 0.127, Butteraugli 27.52

MozJPEG, 8.78 KB
PSNR 28.95, SSIM 0.86, MS-SSIM 0.99, SSIMULACRA 0.05, Butteraugli 9.46

The zoomed images are laid out in this order:
Source 2.0x Zoom AVIF Speed 7 2.0x Zoom JPEG XL Effort 7 2.0x Zoom
WebP Method 6 2.0x Zoom libjpeg-turbo 2.0x Zoom MozJPEG 2.0x Zoom