noto-emoji Coding Comparisons

There were 17 images used to calculate the data below. The average resolution for all of the images is 512x512 or 0.3 Megapixels.

Updated 2022-12-14 (history)

Transcode Timing Graphs

Format	Best Quality(Slowest)	Default	On The Fly(Fastest)
AVIF	Speed 0	Speed 6	Speed 9
JPEG XL	Effort 9	Effort 7	Effort 3
WebP	Method 7	Method 4	Method 0

Source Images

The source images can be found here: noto-emoji.tar.gz
For more information see the main Noto Emoji project as well as the About & License page.

Quality Table

To read the tables below you first look at the title column which will have image format 1 vs image format 2.
For example if the title is "AVIF s5 vs JPEG XL s8", then image format 1 would be "AVIF" and "s5" specifies speed 5, and image format 2 would be "JPEG XL" and "s8" specifies effort 8.

Image format 1 had a better overall rate if the percentages are shaded like this:

-51.0%	-41.0%	-31.0%	-21.0%	-11.0%	-1.0%

Image format 2 had a better overall rate if the percentages are shaded like this:

51.0%	41.0%	31.0%	21.0%	11.0%	1.0%

Notes:

BD-Rate calculation is not comprehensive. For a more comprehensive indication of how the image codec performed, please click on the links in the table below.
bpp range for quality is 0.1 to 3.
All of the timing was done on an Intel Xeon processor released in 2016, Intel Xeon Processor E5-2690 v4 clocked at 2.60GHz.
The CPU was in "ondemand" mode.
Compiler used was clang version 14.0.6-2.
JPEG XL effort 1 and 2 were not measured because the JPEG XL team discourages their use.

Metrics One Thread AVIF speed 0 vs Speed 6

These values depict the current best AVIF quality versus the default AVIF settings.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs AVIF s6	-21.84%	-22.46%	-24.64%	-22.76%	-25.00%	-24.79%	-23.19%	-21.46%	-24.60%	-24.14%	-21.95%	-20.47%	-18.95%

Metrics One Thread Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s3 vs JPEG XL s9	-61.42%	-75.56%	-77.52%	-89.32%	-84.51%	-80.08%	-61.09%	-87.77%	-63.08%	-59.76%	-58.49%	-50.33%	-42.69%
AVIF s4 vs JPEG XL s8	-61.11%	-75.20%	-77.06%	-87.69%	-83.45%	-79.38%	-60.26%	-86.66%	-62.74%	-59.07%	-57.42%	-51.30%	-43.62%
AVIF s7 vs JPEG XL s7	-57.87%	-71.17%	-70.21%	-82.83%	-78.84%	-72.94%	-55.78%	-76.69%	-58.25%	-52.75%	-53.69%	-49.28%	-41.54%
AVIF s8 vs JPEG XL s4	-82.90%	-79.06%	-79.27%	-80.37%	-87.97%	-77.66%	-68.71%	-77.64%	-70.78%	-70.91%	-55.34%	-37.66%	-39.74%

Metrics Eight Threads Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s6 vs JPEG XL s7	-57.27%	-69.80%	-68.12%	-78.05%	-75.92%	-70.46%	-56.36%	-72.58%	-56.73%	-51.22%	-52.50%	-48.10%	-40.58%
AVIF s8 vs JPEG XL s4	-78.53%	-73.34%	-74.21%	-77.24%	-84.66%	-67.29%	-60.22%	-67.81%	-66.27%	-59.51%	-44.43%	-25.32%	-26.23%

Metrics Eight Threads Common Speeds/Efforts

The effort/speed for the transcodes listed below were selected because they should have the best quality (slowest), fastest (on the fly), default, or only option available (MozJPEG and libjpeg-turbo).

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-60.90%	-74.82%	-76.31%	-86.73%	-84.37%	-78.76%	-60.12%	-84.79%	-63.25%	-59.44%	-57.15%	-49.82%	-41.58%
AVIF s6 vs JPEG XL s7	-57.27%	-69.80%	-68.12%	-78.05%	-75.92%	-70.46%	-56.36%	-72.58%	-56.73%	-51.22%	-52.50%	-48.10%	-40.58%
AVIF s9 vs JPEG XL s3	-48.20%	-38.30%	-25.35%	-36.96%	-56.59%	-23.85%	-11.58%	-12.10%	-5.09%	7.57%	28.36%	46.53%	31.10%

Metrics One Thread Common Speeds/Efforts

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-61.66%	-76.29%	-79.30%	-90.31%	-85.42%	-81.64%	-62.19%	-89.94%	-63.95%	-61.13%	-59.12%	-50.84%	-41.65%
AVIF s6 vs JPEG XL s7	-60.17%	-73.71%	-73.37%	-84.02%	-80.51%	-75.98%	-58.20%	-80.86%	-61.66%	-56.89%	-56.17%	-52.90%	-44.32%
AVIF s9 vs JPEG XL s3	-54.05%	-45.63%	-31.31%	-43.00%	-60.82%	-31.81%	-21.40%	-20.58%	-11.29%	-0.95%	19.07%	33.75%	18.14%
AVIF s0 vs WebP s6	-68.92%	-62.09%	-67.59%	-73.68%	-62.73%	-74.79%	-73.38%	-67.85%	-65.54%	-73.28%	-68.10%	-66.38%	-64.13%
AVIF s6 vs WebP s4	-61.11%	-55.16%	-59.25%	-62.44%	-55.17%	-64.44%	-62.75%	-61.54%	-56.98%	-65.63%	-59.21%	-54.47%	-55.49%
AVIF s9 vs WebP s0	-13.61%	-15.77%	-1.69%	-37.73%	-31.41%	-26.61%	-26.19%	-17.10%	-14.77%	-25.53%	-21.33%	-20.07%	-22.44%
JPEG XL s9 vs WebP s6	41.87%	72.37%	48.12%	118.58%	122.95%	59.46%	35.12%	58.40%	30.96%	-6.17%	4.93%	5.46%	2.16%
JPEG XL s7 vs WebP s4	47.33%	75.45%	51.51%	120.49%	123.59%	59.46%	38.19%	53.40%	35.39%	-9.03%	6.34%	18.06%	2.86%
JPEG XL s3 vs WebP s0	80.77%	49.37%	45.47%	8.31%	33.09%	7.72%	-4.65%	9.26%	1.18%	-13.99%	-27.16%	-33.76%	-30.50%
AVIF s0 vs MozJPEG s0	-83.25%	-69.79%	-90.86%	-84.67%	-84.28%	-85.74%	-83.59%	-86.60%	-85.74%	-90.91%	-88.64%	-85.22%	-84.98%
AVIF s6 vs MozJPEG s0	-81.83%	-65.85%	-89.42%	-74.36%	-81.22%	-80.21%	-79.41%	-83.02%	-83.42%	-88.96%	-85.94%	-81.47%	-82.69%
AVIF s9 vs MozJPEG s0	-38.18%	-6.74%	-55.89%	-2.06%	-27.51%	-23.80%	-28.07%	-18.72%	-40.66%	-42.73%	-40.28%	-26.10%	-35.83%
JPEG XL s9 vs MozJPEG s0	-31.75%	24.78%	-55.77%	27.08%	15.62%	-8.17%	-20.89%	-4.81%	-42.25%	-63.37%	-55.02%	-49.69%	-53.72%
JPEG XL s7 vs MozJPEG s0	-31.34%	27.35%	-56.34%	37.71%	20.98%	-6.36%	-18.58%	-5.86%	-41.93%	-63.81%	-54.60%	-46.14%	-54.62%
JPEG XL s3 vs MozJPEG s0	36.12%	74.22%	-33.87%	67.93%	40.63%	12.00%	-7.82%	3.05%	-25.92%	-41.13%	-53.48%	-52.90%	-49.71%
AVIF s0 vs Turbo s0	-81.68%	-78.56%	-88.58%	-87.14%	-87.89%	-87.45%	-84.68%	-84.38%	-86.56%	-91.49%	-85.02%	-83.38%	-82.36%
AVIF s6 vs Turbo s0	-80.64%	-75.90%	-86.69%	-83.42%	-86.28%	-85.13%	-82.40%	-82.72%	-84.43%	-90.12%	-82.75%	-80.55%	-81.10%
AVIF s9 vs Turbo s0	-51.35%	-45.40%	-57.08%	-53.29%	-58.30%	-60.91%	-59.58%	-52.37%	-53.97%	-65.67%	-57.73%	-53.45%	-59.93%
JPEG XL s9 vs Turbo s0	-42.17%	-24.79%	-56.74%	-34.36%	-39.58%	-55.43%	-57.53%	-47.28%	-53.46%	-76.18%	-62.93%	-61.42%	-66.88%
JPEG XL s7 vs Turbo s0	-42.26%	-23.61%	-56.47%	-28.86%	-36.53%	-53.38%	-55.21%	-45.69%	-53.26%	-75.98%	-60.27%	-57.92%	-65.66%
JPEG XL s3 vs Turbo s0	4.16%	5.28%	-33.25%	-20.44%	-24.07%	-42.36%	-46.15%	-33.10%	-36.88%	-60.85%	-53.87%	-58.73%	-61.15%

Sample Images

emoji_u1f382.png

Source, 41.23 KB .	AVIF Speed 7, 7.98 KB PSNR 39.49, SSIM 0.99, MS-SSIM 0.9995, SSIMULACRA 0, Butteraugli 2.84	JPEG XL Effort 7, 7.65 KB PSNR 32.17, SSIM 0.92, MS-SSIM 0.9946, SSIMULACRA 0.02, Butteraugli 7
WebP Method 6, 7.83 KB PSNR 36.17, SSIM 0.97, MS-SSIM 0.9973, SSIMULACRA 0.02, Butteraugli 4.51	libjpeg-turbo, 9.01 KB PSNR 23.45, SSIM 0.805, MS-SSIM 0.932, SSIMULACRA 0.125, Butteraugli 26.14	MozJPEG, 8.08 KB PSNR 29.89, SSIM 0.93, MS-SSIM 0.99, SSIMULACRA 0.04, Butteraugli 9.62

The zoomed images are laid out in this order:

Source 2.0x Zoom	AVIF Speed 7 2.0x Zoom	JPEG XL Effort 7 2.0x Zoom
WebP Method 6 2.0x Zoom	libjpeg-turbo 2.0x Zoom	MozJPEG 2.0x Zoom

emoji_u1f602.png

Source, 37.45 KB .	AVIF Speed 7, 7.79 KB PSNR 34.41, SSIM 0.97, MS-SSIM 0.9991, SSIMULACRA 0.01, Butteraugli 5.12	JPEG XL Effort 7, 8.59 KB PSNR 27.81, SSIM 0.85, MS-SSIM 0.9917, SSIMULACRA 0.02, Butteraugli 7.24
WebP Method 6, 7.79 KB PSNR 32.3, SSIM 0.95, MS-SSIM 0.9972, SSIMULACRA 0.02, Butteraugli 6.39	libjpeg-turbo, 9.19 KB PSNR 23.05, SSIM 0.77, MS-SSIM 0.9388, SSIMULACRA 0.127, Butteraugli 27.52	MozJPEG, 8.78 KB PSNR 28.95, SSIM 0.86, MS-SSIM 0.99, SSIMULACRA 0.05, Butteraugli 9.46

The zoomed images are laid out in this order:

Source 2.0x Zoom	AVIF Speed 7 2.0x Zoom	JPEG XL Effort 7 2.0x Zoom
WebP Method 6 2.0x Zoom	libjpeg-turbo 2.0x Zoom	MozJPEG 2.0x Zoom