subset1 Coding Comparisons

There were 48 images used to calculate the data below. The average resolution for all of the images is 1212x918 or 1.1 Megapixels.

Updated 2022-12-14 (history)

Transcode Timing Graphs

Format	Best Quality(Slowest)	Default	On The Fly(Fastest)
AVIF	Speed 0	Speed 6	Speed 9
JPEG XL	Effort 9	Effort 7	Effort 3
WebP	Method 7	Method 4	Method 0

Source Images

The source images can be found here: subset1

Quality Table

To read the tables below you first look at the title column which will have image format 1 vs image format 2.
For example if the title is "AVIF s5 vs JPEG XL s8", then image format 1 would be "AVIF" and "s5" specifies speed 5, and image format 2 would be "JPEG XL" and "s8" specifies effort 8.

Image format 1 had a better overall rate if the percentages are shaded like this:

-51.0%	-41.0%	-31.0%	-21.0%	-11.0%	-1.0%

Image format 2 had a better overall rate if the percentages are shaded like this:

51.0%	41.0%	31.0%	21.0%	11.0%	1.0%

Notes:

BD-Rate calculation is not comprehensive. For a more comprehensive indication of how the image codec performed, please click on the links in the table below.
bpp range for quality is 0.1 to 3.
All of the timing was done on an Intel Xeon processor released in 2016, Intel Xeon Processor E5-2690 v4 clocked at 2.60GHz.
The CPU was in "ondemand" mode.
Compiler used was clang version 14.0.6-2.
JPEG XL effort 1 and 2 were not measured because the JPEG XL team discourages their use.

Metrics One Thread AVIF speed 0 vs Speed 6

These values depict the current best AVIF quality versus the default AVIF settings.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs AVIF s6	-8.10%	-8.04%	-8.95%	-8.88%	-9.90%	-8.32%	-8.46%	-6.73%	-8.93%	-8.11%	-9.66%	-7.08%	-8.04%

Metrics One Thread Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s5 vs JPEG XL s8	-25.01%	-11.92%	-27.08%	-6.98%	-27.20%	-13.08%	-9.89%	-14.67%	-15.08%	-10.94%	-3.00%	21.82%	9.07%
AVIF s7 vs JPEG XL s6	-13.10%	0.65%	-18.72%	6.84%	-16.95%	-0.78%	4.13%	1.80%	0.03%	2.48%	3.06%	42.01%	27.49%

Metrics Eight Threads Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-27.08%	-14.07%	-29.19%	-7.50%	-29.26%	-13.58%	-11.05%	-14.15%	-17.28%	-12.18%	-4.08%	20.22%	5.86%
AVIF s1 vs JPEG XL s8	-26.72%	-13.47%	-28.83%	-6.32%	-28.59%	-12.52%	-10.09%	-13.52%	-16.90%	-11.35%	-3.15%	19.70%	6.79%
AVIF s6 vs JPEG XL s7	-21.20%	-5.35%	-21.40%	3.97%	-22.03%	-3.94%	-2.68%	-6.16%	-10.09%	-4.71%	5.37%	25.21%	16.27%
AVIF s7 vs JPEG XL s6	-11.57%	2.46%	-17.11%	10.26%	-14.23%	2.54%	7.67%	4.21%	1.95%	5.43%	4.52%	43.18%	29.35%

Metrics Eight Threads Common Speeds/Efforts

The effort/speed for the transcodes listed below were selected because they should have the best quality (slowest), fastest (on the fly), default, or only option available (MozJPEG and libjpeg-turbo).

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-27.08%	-14.07%	-29.19%	-7.50%	-29.26%	-13.58%	-11.05%	-14.15%	-17.28%	-12.18%	-4.08%	20.22%	5.86%
AVIF s6 vs JPEG XL s7	-21.20%	-5.35%	-21.40%	3.97%	-22.03%	-3.94%	-2.68%	-6.16%	-10.09%	-4.71%	5.37%	25.21%	16.27%
AVIF s9 vs JPEG XL s3	-9.79%	6.73%	-11.16%	1.34%	-16.50%	-2.98%	8.30%	3.45%	-4.00%	-2.32%	16.47%	60.94%	29.87%

Metrics One Thread Common Speeds/Efforts

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-27.97%	-15.44%	-30.40%	-10.85%	-30.98%	-16.49%	-13.89%	-16.33%	-18.36%	-14.41%	-6.35%	19.00%	3.87%
AVIF s6 vs JPEG XL s7	-22.44%	-7.01%	-22.82%	0.92%	-23.99%	-6.68%	-5.29%	-8.31%	-11.35%	-6.69%	2.85%	22.38%	13.80%
AVIF s9 vs JPEG XL s3	-10.75%	5.41%	-12.48%	-0.82%	-18.16%	-5.03%	6.07%	1.29%	-5.19%	-4.01%	14.87%	58.57%	28.06%
AVIF s0 vs WebP s6	-28.54%	-25.78%	-31.05%	-30.26%	-34.16%	-30.89%	-30.37%	-29.39%	-30.06%	-31.67%	-28.25%	-17.57%	-23.24%
AVIF s6 vs WebP s4	-24.54%	-23.83%	-25.53%	-28.27%	-28.00%	-28.17%	-27.83%	-29.62%	-25.69%	-26.38%	-24.07%	-16.10%	-20.45%
AVIF s9 vs WebP s0	-21.08%	-23.66%	-23.47%	-32.03%	-26.92%	-30.97%	-29.20%	-28.87%	-24.09%	-27.95%	-18.09%	-18.04%	-23.18%
JPEG XL s9 vs WebP s6	0.16%	-11.67%	-1.13%	-20.21%	-4.61%	-16.31%	-17.95%	-15.20%	-12.85%	-19.00%	-22.03%	-31.07%	-25.10%
JPEG XL s7 vs WebP s4	-1.64%	-16.88%	-2.90%	-25.35%	-4.23%	-19.91%	-21.14%	-21.57%	-14.47%	-18.28%	-23.51%	-30.44%	-28.48%
JPEG XL s3 vs WebP s0	-9.30%	-25.44%	-10.99%	-27.68%	-8.48%	-23.51%	-29.23%	-27.85%	-17.68%	-21.37%	-25.59%	-44.82%	-37.44%
AVIF s0 vs MozJPEG s0	-47.74%	-12.29%	-54.79%	-27.34%	-49.40%	-32.23%	-32.88%	-23.78%	-45.53%	-40.58%	-36.35%	-18.51%	-27.65%
AVIF s6 vs MozJPEG s0	-43.03%	-5.83%	-49.96%	-20.79%	-44.13%	-26.43%	-27.16%	-18.48%	-40.40%	-35.56%	-30.34%	-12.60%	-21.56%
AVIF s9 vs MozJPEG s0	-27.79%	10.63%	-37.40%	-7.63%	-28.94%	-13.22%	-14.69%	-4.71%	-25.51%	-21.84%	-17.23%	18.06%	-3.28%
JPEG XL s9 vs MozJPEG s0	-24.48%	3.53%	-33.46%	-16.01%	-25.83%	-17.67%	-20.06%	-8.17%	-31.12%	-28.88%	-29.65%	-30.92%	-28.62%
JPEG XL s7 vs MozJPEG s0	-24.06%	4.69%	-34.27%	-15.04%	-25.01%	-17.23%	-18.20%	-7.78%	-29.94%	-28.28%	-27.26%	-28.13%	-29.01%
JPEG XL s3 vs MozJPEG s0	-16.78%	10.62%	-29.27%	3.27%	-10.54%	-1.85%	-10.70%	-0.31%	-17.99%	-14.12%	-20.20%	-26.98%	-21.82%
AVIF s0 vs Turbo s0	-57.68%	-36.81%	-64.24%	-58.59%	-63.64%	-58.82%	-60.77%	-49.77%	-58.14%	-58.74%	-53.53%	-51.83%	-55.67%
AVIF s6 vs Turbo s0	-54.26%	-32.78%	-60.68%	-55.20%	-60.16%	-55.54%	-57.78%	-46.66%	-54.64%	-55.42%	-49.91%	-48.92%	-52.26%
AVIF s9 vs Turbo s0	-43.39%	-22.62%	-51.95%	-49.91%	-50.96%	-49.54%	-52.55%	-39.76%	-44.35%	-47.45%	-43.60%	-37.08%	-44.25%
JPEG XL s9 vs Turbo s0	-40.19%	-25.57%	-48.24%	-50.38%	-48.02%	-48.89%	-51.68%	-39.59%	-46.73%	-49.69%	-47.99%	-55.02%	-52.90%
JPEG XL s7 vs Turbo s0	-38.64%	-22.43%	-47.62%	-47.49%	-45.77%	-46.26%	-48.31%	-36.30%	-44.89%	-47.53%	-44.58%	-50.78%	-50.74%
JPEG XL s3 vs Turbo s0	-31.75%	-17.34%	-43.05%	-36.63%	-35.34%	-36.54%	-42.42%	-30.05%	-35.80%	-37.56%	-39.09%	-47.37%	-44.29%

Sample Images

2011-03-05_03-13_Madeira_159_Funchal__Mercado_dos_Lavradores.png

Source, 2117.21 KB .	AVIF Speed 6, 116.91 KB PSNR 28.05, SSIM 0.872, MS-SSIM 0.985, SSIMULACRA 0.086, Butteraugli 4.93
JPEG XL Effort 7, 111.66 KB PSNR 26.12, SSIM 0.842, MS-SSIM 0.9838, SSIMULACRA 0.095, Butteraugli 4.22	WebP Method 6, 119.15 KB PSNR 27.17, SSIM 0.855, MS-SSIM 0.9837, SSIMULACRA 0.098, Butteraugli 5.57
libjpeg-turbo, 121.2 KB PSNR 25.38, SSIM 0.796, MS-SSIM 0.9759, SSIMULACRA 0.12, Butteraugli 6.82	MozJPEG, 120.48 KB PSNR 25.9, SSIM 0.821, MS-SSIM 0.9824, SSIMULACRA 0.109, Butteraugli 5.46

The zoomed images are laid out in this order:

Source 2.0x Zoom	AVIF Speed 6 2.0x Zoom
JPEG XL Effort 7 2.0x Zoom	WebP Method 6 2.0x Zoom
libjpeg-turbo 2.0x Zoom	MozJPEG 2.0x Zoom

Mural_in_Northeast_Pavillion__Thomas_Jefferson_Building_by_Elmer_E._Garnsey_11670u_edit.png

Source, 1886.67 KB .	AVIF Speed 6, 120.61 KB PSNR 31.16, SSIM 0.912, MS-SSIM 0.9908, SSIMULACRA 0.043, Butteraugli 3.93
JPEG XL Effort 7, 119.13 KB PSNR 29.69, SSIM 0.889, MS-SSIM 0.9892, SSIMULACRA 0.051, Butteraugli 4.16	WebP Method 6, 122.99 KB PSNR 30.37, SSIM 0.901, MS-SSIM 0.9903, SSIMULACRA 0.049, Butteraugli 3.52
libjpeg-turbo, 122.78 KB PSNR 28.38, SSIM 0.845, MS-SSIM 0.9832, SSIMULACRA 0.071, Butteraugli 5.13	MozJPEG, 122.85 KB PSNR 29.01, SSIM 0.867, MS-SSIM 0.9885, SSIMULACRA 0.06, Butteraugli 4.72

The zoomed images are laid out in this order:

Source 3.0x Zoom	AVIF Speed 6 3.0x Zoom
JPEG XL Effort 7 3.0x Zoom	WebP Method 6 3.0x Zoom
libjpeg-turbo 3.0x Zoom	MozJPEG 3.0x Zoom

Fruits_oranges__jardin_japonais_2.png

Source, 1521.46 KB .	AVIF Speed 6, 118.06 KB PSNR 40.96, SSIM 0.965, MS-SSIM 0.9971, SSIMULACRA 0.018, Butteraugli 1.6
JPEG XL Effort 7, 136.11 KB PSNR 41.35, SSIM 0.967, MS-SSIM 0.9975, SSIMULACRA 0.016, Butteraugli 1.27	WebP Method 6, 141.24 KB PSNR 40.75, SSIM 0.962, MS-SSIM 0.9966, SSIMULACRA 0.02, Butteraugli 1.54
libjpeg-turbo, 132.29 KB PSNR 38.99, SSIM 0.952, MS-SSIM 0.9957, SSIMULACRA 0.026, Butteraugli 3.71	MozJPEG, 127.7 KB PSNR 39.71, SSIM 0.958, MS-SSIM 0.9963, SSIMULACRA 0.024, Butteraugli 2.52

The zoomed images are laid out in this order:

Source 2.0x Zoom	AVIF Speed 6 2.0x Zoom
JPEG XL Effort 7 2.0x Zoom	WebP Method 6 2.0x Zoom
libjpeg-turbo 2.0x Zoom	MozJPEG 2.0x Zoom