Kodak Coding Comparisons

There were 24 images used to calculate the data below. The average resolution for all of the images is 704x576 or 0.4 Megapixels. Two of the reasons this test set was used:

It is well known
The resolutions of the images are closer to the median resolution of images on the web

Updated 2022-12-14 (history)

Transcode Timing Graphs

Format	Best Quality(Slowest)	Default	On The Fly(Fastest)
AVIF	Speed 0	Speed 6	Speed 9
JPEG XL	Effort 9	Effort 7	Effort 3
WebP	Method 7	Method 4	Method 0

Source Images

The source images can be found here: Kodak

Quality Table

To read the tables below you first look at the title column which will have image format 1 vs image format 2.
For example if the title is "AVIF s5 vs JPEG XL s8", then image format 1 would be "AVIF" and "s5" specifies speed 5, and image format 2 would be "JPEG XL" and "s8" specifies effort 8.

Image format 1 had a better overall rate if the percentages are shaded like this:

-51.0%	-41.0%	-31.0%	-21.0%	-11.0%	-1.0%

Image format 2 had a better overall rate if the percentages are shaded like this:

51.0%	41.0%	31.0%	21.0%	11.0%	1.0%

Notes:

BD-Rate calculation is not comprehensive. For a more comprehensive indication of how the image codec performed, please click on the links in the table below.
bpp range for quality is 0.1 to 3.
All of the timing was done on an Intel Xeon processor released in 2016, Intel Xeon Processor E5-2690 v4 clocked at 2.60GHz.
The CPU was in "ondemand" mode.
Compiler used was clang version 14.0.6-2.
JPEG XL effort 1 and 2 were not measured because the JPEG XL team discourages their use.

Metrics One Thread AVIF speed 0 vs Speed 6

These values depict the current best AVIF quality versus the default AVIF settings.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs AVIF s6	-7.88%	-8.44%	-8.50%	-7.71%	-9.10%	-7.74%	-8.08%	-6.85%	-8.65%	-7.28%	-7.99%	-8.12%	-8.69%

Metrics One Thread Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s3 vs JPEG XL s9	-31.45%	-16.83%	-30.23%	-24.01%	-31.46%	-19.12%	-16.08%	-23.57%	-23.46%	-19.07%	-7.32%	3.68%	-5.95%
AVIF s5 vs JPEG XL s8	-29.57%	-14.88%	-28.52%	-22.97%	-29.77%	-18.19%	-14.19%	-22.97%	-21.12%	-17.76%	-6.51%	5.49%	-3.44%

Metrics Eight Threads Same Transcode Performance

The effort and speed for JPEG XL and AVIF transcodes listed below were selected because the transcoding MP/s are within ~10% of each other.

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-31.32%	-16.30%	-29.89%	-22.12%	-30.32%	-17.24%	-14.26%	-21.07%	-23.56%	-17.97%	-6.29%	3.76%	-5.39%
AVIF s1 vs JPEG XL s8	-30.89%	-15.60%	-29.52%	-21.48%	-29.78%	-16.47%	-13.62%	-20.72%	-22.89%	-17.44%	-5.76%	4.49%	-4.44%
AVIF s6 vs JPEG XL s7	-25.52%	-8.08%	-22.73%	-13.91%	-23.53%	-8.67%	-6.44%	-13.44%	-16.29%	-11.61%	1.02%	7.81%	4.38%
AVIF s7 vs JPEG XL s6	-19.88%	-1.80%	-19.27%	-8.65%	-18.52%	-3.29%	2.11%	-5.49%	-7.84%	-4.50%	6.74%	21.34%	12.93%
AVIF s9 vs JPEG XL s3	-11.20%	6.46%	-12.16%	-8.71%	-16.18%	-5.35%	5.88%	0.15%	-4.65%	-9.09%	9.99%	36.43%	16.73%

Metrics Eight Threads Common Speeds/Efforts

The effort/speed for the transcodes listed below were selected because they should have the best quality (slowest), fastest (on the fly), default, or only option available (MozJPEG and libjpeg-turbo).

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-31.32%	-16.30%	-29.89%	-22.12%	-30.32%	-17.24%	-14.26%	-21.07%	-23.56%	-17.97%	-6.29%	3.76%	-5.39%
AVIF s6 vs JPEG XL s7	-25.52%	-8.08%	-22.73%	-13.91%	-23.53%	-8.67%	-6.44%	-13.44%	-16.29%	-11.61%	1.02%	7.81%	4.38%
AVIF s9 vs JPEG XL s3	-11.20%	6.46%	-12.16%	-8.71%	-16.18%	-5.35%	5.88%	0.15%	-4.65%	-9.09%	9.99%	36.43%	16.73%

Metrics One Thread Common Speeds/Efforts

title	psnr_magick	psnr_hvs	psnr_y	ssim	ssim_magick	msssim	dssim	vmaf	ciede2000	ssimulacra	ssimulacra2	butteraugli	p3norm
AVIF s0 vs JPEG XL s9	-32.44%	-18.09%	-31.44%	-25.16%	-32.58%	-20.82%	-17.65%	-23.83%	-24.68%	-20.63%	-9.41%	0.07%	-8.34%
AVIF s6 vs JPEG XL s7	-27.39%	-10.49%	-24.95%	-17.64%	-26.52%	-12.55%	-10.12%	-16.61%	-18.10%	-14.54%	-2.45%	3.43%	0.77%
AVIF s9 vs JPEG XL s3	-14.01%	3.06%	-14.90%	-13.18%	-19.94%	-9.96%	0.91%	-4.63%	-7.37%	-13.03%	5.77%	31.90%	12.56%
AVIF s0 vs WebP s6	-26.02%	-22.66%	-29.59%	-27.07%	-30.69%	-27.24%	-25.24%	-27.06%	-26.53%	-27.71%	-22.81%	-16.34%	-19.96%
AVIF s6 vs WebP s4	-21.55%	-20.51%	-24.35%	-24.00%	-24.91%	-25.11%	-23.40%	-27.98%	-22.06%	-23.01%	-20.60%	-13.46%	-16.60%
AVIF s9 vs WebP s0	-21.82%	-23.85%	-25.78%	-28.55%	-27.98%	-29.87%	-26.67%	-30.59%	-23.26%	-27.72%	-20.73%	-23.59%	-25.08%
JPEG XL s9 vs WebP s6	10.22%	-4.83%	3.59%	-2.41%	3.69%	-7.83%	-8.68%	-4.24%	-1.91%	-8.37%	-13.72%	-16.74%	-11.95%
JPEG XL s7 vs WebP s4	7.93%	-10.33%	1.06%	-5.51%	2.97%	-11.86%	-12.84%	-12.47%	-4.23%	-8.01%	-16.72%	-17.05%	-16.45%
JPEG XL s3 vs WebP s0	-8.31%	-24.84%	-12.04%	-15.92%	-9.06%	-20.33%	-25.36%	-26.55%	-16.31%	-15.49%	-22.69%	-41.08%	-32.75%
AVIF s0 vs MozJPEG s0	-49.52%	-14.98%	-55.35%	-35.79%	-48.44%	-33.84%	-33.24%	-30.97%	-44.51%	-39.46%	-33.88%	-24.37%	-30.16%
AVIF s6 vs MozJPEG s0	-45.31%	-9.35%	-50.96%	-31.41%	-43.97%	-29.54%	-29.38%	-27.37%	-39.95%	-35.36%	-30.00%	-18.67%	-24.62%
AVIF s9 vs MozJPEG s0	-33.27%	3.10%	-41.46%	-20.81%	-32.93%	-19.36%	-18.94%	-16.71%	-26.55%	-24.76%	-20.50%	2.03%	-11.71%
JPEG XL s9 vs MozJPEG s0	-22.81%	2.33%	-31.19%	-13.99%	-22.26%	-16.01%	-17.54%	-9.68%	-25.50%	-22.59%	-24.87%	-22.37%	-21.70%
JPEG XL s7 vs MozJPEG s0	-22.32%	3.24%	-31.80%	-14.08%	-22.10%	-15.53%	-15.14%	-8.92%	-24.17%	-21.85%	-22.13%	-18.44%	-21.26%
JPEG XL s3 vs MozJPEG s0	-20.40%	4.99%	-30.39%	-5.11%	-14.13%	-5.29%	-10.68%	-7.11%	-17.96%	-10.40%	-17.07%	-21.80%	-17.80%
AVIF s0 vs Turbo s0	-58.73%	-35.65%	-63.13%	-56.05%	-61.72%	-56.65%	-58.65%	-50.58%	-56.42%	-56.44%	-51.32%	-53.80%	-55.30%
AVIF s6 vs Turbo s0	-56.01%	-32.64%	-60.11%	-54.31%	-59.28%	-55.12%	-57.61%	-49.24%	-53.64%	-54.47%	-49.76%	-52.25%	-53.29%
AVIF s9 vs Turbo s0	-47.32%	-24.33%	-53.15%	-48.42%	-52.28%	-49.71%	-52.46%	-42.86%	-44.29%	-48.04%	-44.09%	-42.07%	-46.72%
JPEG XL s9 vs Turbo s0	-38.80%	-23.77%	-45.09%	-41.81%	-44.21%	-44.60%	-48.04%	-36.85%	-41.82%	-44.08%	-43.92%	-50.25%	-48.15%
JPEG XL s7 vs Turbo s0	-37.29%	-21.68%	-44.44%	-39.46%	-42.40%	-41.89%	-44.41%	-34.02%	-39.87%	-41.72%	-40.20%	-45.85%	-45.57%
JPEG XL s3 vs Turbo s0	-34.67%	-18.93%	-42.49%	-33.04%	-36.08%	-35.00%	-40.40%	-31.38%	-34.91%	-33.47%	-36.15%	-46.53%	-42.10%

Sample Images

kodim05.png

Source, 785.61 KB .	AVIF Speed 5, 45.09 KB PSNR 31.25, SSIM 0.924, MS-SSIM 0.9893, SSIMULACRA 0.052, Butteraugli 4.96
JPEG XL Effort 8, 45.52 KB PSNR 28.98, SSIM 0.89, MS-SSIM 0.9853, SSIMULACRA 0.062, Butteraugli 3.94	WebP Method 6, 46.46 KB PSNR 29.88, SSIM 0.904, MS-SSIM 0.9871, SSIMULACRA 0.06, Butteraugli 4.63
libjpeg-turbo, 45.72 KB PSNR 26.73, SSIM 0.826, MS-SSIM 0.9754, SSIMULACRA 0.097, Butteraugli 5.81	MozJPEG, 46.54 KB PSNR 27.76, SSIM 0.861, MS-SSIM 0.9829, SSIMULACRA 0.077, Butteraugli 4.68

The zoomed images are laid out in this order:

Source 2.0x Zoom	AVIF Speed 5 2.0x Zoom
JPEG XL Effort 8 2.0x Zoom	WebP Method 6 2.0x Zoom
libjpeg-turbo 2.0x Zoom	MozJPEG 2.0x Zoom

kodim14.png

Source, 692.2 KB .	AVIF Speed 5, 44.71 KB PSNR 32.67, SSIM 0.912, MS-SSIM 0.987, SSIMULACRA 0.055, Butteraugli 3.4
JPEG XL Effort 8, 46.86 KB PSNR 30.84, SSIM 0.883, MS-SSIM 0.9853, SSIMULACRA 0.064, Butteraugli 3.16	WebP Method 6, 46.83 KB PSNR 31.8, SSIM 0.897, MS-SSIM 0.9858, SSIMULACRA 0.059, Butteraugli 4.21
libjpeg-turbo, 45.32 KB PSNR 29.16, SSIM 0.829, MS-SSIM 0.9747, SSIMULACRA 0.094, Butteraugli 6.22	MozJPEG, 45.62 KB PSNR 30.09, SSIM 0.858, MS-SSIM 0.9821, SSIMULACRA 0.077, Butteraugli 4.46

The zoomed images are laid out in this order:

Source 3.0x Zoom	AVIF Speed 5 3.0x Zoom
JPEG XL Effort 8 3.0x Zoom	WebP Method 6 3.0x Zoom
libjpeg-turbo 3.0x Zoom	MozJPEG 3.0x Zoom