average normalized score | |
---|---|
fuzzer | |
aflplusplus | 97.40 |
libfuzzer | 93.35 |
libafl | 93.03 |
honggfuzz | 90.90 |
orchestra_honggfuzz | 88.71 |
afl | 85.34 |
eclipser | 84.54 |
mopt | 84.48 |
orchestra_libfuzzer | 84.24 |
aflsmart | 83.71 |
aflfast | 82.05 |
fairfuzz | 79.49 |
centipede | 68.13 |
orchestra_aflplusplus | 67.03 |
pastis | 34.36 |
average rank | |
---|---|
fuzzer | |
aflplusplus | 3.09 |
libafl | 4.87 |
libfuzzer | 5.52 |
honggfuzz | 5.96 |
eclipser | 6.13 |
aflsmart | 6.78 |
afl | 7.61 |
mopt | 7.78 |
orchestra_libfuzzer | 7.91 |
orchestra_honggfuzz | 8.09 |
orchestra_aflplusplus | 9.43 |
aflfast | 9.74 |
fairfuzz | 10.00 |
centipede | 10.26 |
pastis | 14.35 |
Note: The relative coverage summary table shows the median
relative performance of each fuzzer to the experiment maximum. Thus the
highest relative performance may not be 100%.
trial_relative_coverage = trial_coverage / experiment_max_coverage
aflplusplus | honggfuzz | libfuzzer | libafl | eclipser | orchestra_aflplusplus | orchestra_honggfuzz | orchestra_libfuzzer | afl | mopt | aflsmart | aflfast | centipede | fairfuzz | pastis | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
FuzzerMedian | 97.00 | 96.00 | 92.00 | 95.00 | 94.00 | 91.00 | 85.00 | 85.50 | 94.00 | 92.00 | 93.00 | 91.00 | 87.00 | 85.00 | 52.00 |
FuzzerMean | 93.91 | 91.95 | 90.09 | 89.70 | 89.10 | 87.12 | 85.70 | 85.05 | 82.65 | 81.70 | 81.13 | 79.57 | 79.21 | 76.91 | 47.62 |
bloaty_fuzz_target | 98.00 | 95.00 | 91.00 | 98.00 | 94.00 | 77.00 | 84.00 | 83.00 | 94.00 | 96.00 | 96.00 | 94.00 | nan | 80.00 | 67.00 |
curl_curl_fuzzer_http | 98.00 | 98.00 | 91.00 | 95.00 | 94.00 | 92.00 | 77.00 | 83.00 | 94.00 | 94.00 | 94.00 | 93.00 | nan | 83.00 | 62.00 |
freetype2_ftfuzzer | 90.00 | 91.00 | 78.00 | 75.00 | 74.00 | 91.00 | 71.00 | 58.00 | 67.00 | 67.00 | 66.00 | 63.00 | 57.00 | 62.00 | 26.00 |
harfbuzz_hb-shape-fuzzer | 98.00 | 95.00 | 94.00 | 99.00 | 97.00 | nan | 84.00 | nan | 96.00 | 96.00 | 97.00 | 95.00 | nan | 87.00 | 68.00 |
jsoncpp_jsoncpp_fuzzer | 99.00 | 99.00 | 100.00 | 98.00 | 98.00 | 98.00 | 100.00 | 100.00 | 98.00 | 98.00 | 98.00 | 98.00 | 98.00 | 98.00 | 40.00 |
lcms_cms_transform_fuzzer | 88.00 | 71.00 | 85.00 | 90.00 | 78.00 | 87.00 | 82.00 | 87.00 | 66.00 | 63.00 | 40.00 | 28.00 | 38.00 | 50.00 | 1.00 |
libjpeg-turbo_libjpeg_turbo_fuzzer | 99.00 | 99.00 | 99.00 | 99.00 | nan | nan | 95.00 | 96.00 | 99.00 | 82.00 | 82.00 | 82.00 | 82.00 | 82.00 | 81.00 |
libpcap_fuzz_both | 92.00 | nan | 79.00 | 76.00 | 79.00 | nan | 85.00 | 80.00 | 1.00 | 1.00 | 1.00 | 1.00 | 89.00 | 1.00 | 1.00 |
libpng_libpng_read_fuzzer | 95.00 | 95.00 | 96.00 | 95.00 | 94.00 | 95.00 | 96.00 | 96.00 | 94.00 | 94.00 | 95.00 | 93.00 | 96.00 | 94.00 | 70.00 |
libxml2_xml | 99.00 | 98.00 | 97.00 | 98.00 | 97.00 | nan | 87.00 | 86.00 | 97.00 | 96.00 | 97.00 | 96.00 | 92.00 | 89.00 | 54.00 |
libxslt_xpath | 98.00 | 97.00 | 92.00 | 96.00 | 95.00 | 86.00 | 74.00 | 74.00 | 94.00 | 93.00 | 95.00 | 93.00 | 93.00 | 96.00 | 51.00 |
mbedtls_fuzz_dtlsclient | 75.00 | 72.00 | 72.00 | 90.00 | 73.00 | 73.00 | 67.00 | 69.00 | 72.00 | 72.00 | 73.00 | 71.00 | 71.00 | 75.00 | 50.00 |
openh264_decoder_fuzzer | 99.00 | 99.00 | 98.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | nan | 90.00 | nan |
openssl_x509 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 99.00 | 98.00 |
openthread_ot-ip6-send-fuzzer | 79.00 | 78.00 | 79.00 | 89.00 | 78.00 | 79.00 | 75.00 | 79.00 | 75.00 | 75.00 | 75.00 | 75.00 | 74.00 | 71.00 | nan |
proj4_proj_crs_to_crs_fuzzer | 87.00 | 97.00 | 91.00 | 9.00 | 59.00 | nan | 79.00 | 76.00 | 9.00 | 9.00 | 9.00 | 9.00 | 9.00 | 9.00 | 3.00 |
re2_fuzzer | 99.00 | 98.00 | 99.00 | 98.00 | 99.00 | nan | 98.00 | 99.00 | 99.00 | 98.00 | 99.00 | 99.00 | 95.00 | 99.00 | nan |
sqlite3_ossfuzz | 89.00 | 71.00 | 80.00 | 91.00 | 93.00 | 58.00 | 52.00 | 56.00 | 91.00 | 92.00 | 93.00 | 90.00 | 64.00 | 65.00 | 37.00 |
stb_stbi_read_fuzzer | 95.00 | 91.00 | 87.00 | 94.00 | 91.00 | 85.00 | 90.00 | 85.00 | 87.00 | 86.00 | 87.00 | 86.00 | 85.00 | 86.00 | nan |
systemd_fuzz-link-parser | 99.00 | 97.00 | 80.00 | 93.00 | 92.00 | 69.00 | 83.00 | 69.00 | 91.00 | 91.00 | 91.00 | 91.00 | 97.00 | 85.00 | 53.00 |
vorbis_decode_fuzzer | 92.00 | 91.00 | 92.00 | 91.00 | 91.00 | 99.00 | 97.00 | 98.00 | 91.00 | 91.00 | 91.00 | 91.00 | 83.00 | 91.00 | nan |
woff2_convert_woff2ttf_fuzzer | 96.00 | 95.00 | 93.00 | 96.00 | nan | 99.00 | 98.00 | 99.00 | 91.00 | 91.00 | 92.00 | 89.00 | 87.00 | 80.00 | nan |
zlib_zlib_uncompress_fuzzer | 97.00 | 97.00 | 100.00 | 95.00 | 97.00 | 95.00 | 99.00 | 100.00 | 97.00 | 96.00 | 97.00 | 95.00 | 96.00 | 97.00 | nan |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libafl | 82800 | 20.0 | 6353.800000 | 71.997515 | 6140.0 | 6344.75 | 6371.5 | 6388.00 | 6442.0 |
aflplusplus | 82800 | 20.0 | 6356.000000 | 57.764495 | 6145.0 | 6345.50 | 6358.5 | 6393.00 | 6415.0 |
mopt | 82800 | 20.0 | 6236.050000 | 71.516266 | 6071.0 | 6226.50 | 6243.5 | 6268.50 | 6354.0 |
aflsmart | 82800 | 20.0 | 6198.450000 | 127.984981 | 5937.0 | 6102.25 | 6205.0 | 6295.25 | 6394.0 |
honggfuzz | 82800 | 20.0 | 6100.500000 | 209.354522 | 5744.0 | 5948.25 | 6131.5 | 6295.50 | 6391.0 |
eclipser | 82800 | 20.0 | 6110.200000 | 114.487232 | 5900.0 | 6066.75 | 6107.0 | 6144.50 | 6360.0 |
afl | 82800 | 20.0 | 6108.300000 | 77.916352 | 5889.0 | 6081.25 | 6106.0 | 6148.00 | 6291.0 |
aflfast | 82800 | 20.0 | 6080.100000 | 119.230824 | 5858.0 | 6033.50 | 6059.0 | 6136.50 | 6350.0 |
libfuzzer | 82800 | 20.0 | 5897.050000 | 169.163414 | 5559.0 | 5805.00 | 5890.5 | 5988.00 | 6182.0 |
orchestra_honggfuzz | 82800 | 9.0 | 5402.333333 | 281.298774 | 4717.0 | 5364.00 | 5474.0 | 5556.00 | 5700.0 |
orchestra_libfuzzer | 82800 | 19.0 | 5320.210526 | 196.682931 | 4715.0 | 5282.50 | 5355.0 | 5420.50 | 5659.0 |
fairfuzz | 82800 | 20.0 | 5217.750000 | 121.813868 | 5060.0 | 5145.00 | 5194.5 | 5272.75 | 5570.0 |
orchestra_aflplusplus | 82800 | 20.0 | 4954.450000 | 97.527580 | 4773.0 | 4888.75 | 4974.5 | 5028.25 | 5115.0 |
pastis | 82800 | 20.0 | 4364.000000 | 0.000000 | 4364.0 | 4364.00 | 4364.0 | 4364.00 | 4364.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 10864.950000 | 64.618292 | 10747.0 | 10829.75 | 10877.0 | 10894.75 | 11006.0 |
honggfuzz | 82800 | 20.0 | 10845.700000 | 108.334327 | 10689.0 | 10747.75 | 10861.0 | 10926.00 | 11036.0 |
libafl | 82800 | 20.0 | 10509.650000 | 42.703722 | 10446.0 | 10485.50 | 10501.0 | 10527.00 | 10604.0 |
eclipser | 82800 | 20.0 | 10463.900000 | 37.160959 | 10415.0 | 10437.00 | 10454.0 | 10491.00 | 10551.0 |
aflsmart | 82800 | 20.0 | 10456.750000 | 63.366831 | 10389.0 | 10399.00 | 10436.5 | 10486.75 | 10575.0 |
afl | 82800 | 20.0 | 10358.750000 | 115.808769 | 10055.0 | 10329.50 | 10384.5 | 10432.75 | 10482.0 |
mopt | 82800 | 20.0 | 10338.900000 | 115.764234 | 10036.0 | 10331.75 | 10376.0 | 10408.50 | 10441.0 |
aflfast | 82800 | 20.0 | 10272.850000 | 106.610592 | 9985.0 | 10221.25 | 10305.5 | 10346.25 | 10406.0 |
orchestra_aflplusplus | 82800 | 20.0 | 10151.550000 | 162.127460 | 9864.0 | 10046.25 | 10178.5 | 10229.75 | 10549.0 |
libfuzzer | 82800 | 20.0 | 9985.200000 | 396.894206 | 9224.0 | 9836.25 | 10063.0 | 10172.00 | 10585.0 |
fairfuzz | 82800 | 20.0 | 9200.800000 | 420.958005 | 7990.0 | 9035.75 | 9266.0 | 9472.50 | 9906.0 |
orchestra_libfuzzer | 82800 | 19.0 | 9156.473684 | 253.026869 | 8824.0 | 8949.00 | 9190.0 | 9329.50 | 9625.0 |
orchestra_honggfuzz | 82800 | 19.0 | 8641.315789 | 350.561938 | 8227.0 | 8460.00 | 8508.0 | 8611.00 | 9428.0 |
pastis | 82800 | 19.0 | 6932.894737 | 0.936586 | 6932.0 | 6932.00 | 6933.0 | 6934.00 | 6934.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
orchestra_aflplusplus | 82800 | 19.0 | 11379.052632 | 330.328704 | 10780.0 | 11166.50 | 11431.0 | 11499.00 | 12367.0 |
honggfuzz | 82800 | 20.0 | 11253.850000 | 623.984925 | 9786.0 | 10822.25 | 11416.5 | 11720.50 | 12085.0 |
aflplusplus | 82800 | 20.0 | 11391.200000 | 567.364229 | 10599.0 | 10947.00 | 11322.0 | 11623.50 | 12483.0 |
libfuzzer | 82800 | 20.0 | 9845.700000 | 650.336035 | 8730.0 | 9404.00 | 9806.0 | 10147.75 | 11277.0 |
libafl | 82800 | 20.0 | 9370.550000 | 445.269224 | 8602.0 | 9007.75 | 9460.0 | 9741.75 | 10175.0 |
eclipser | 82800 | 20.0 | 9242.100000 | 100.454703 | 9028.0 | 9198.75 | 9263.0 | 9316.75 | 9423.0 |
orchestra_honggfuzz | 82800 | 20.0 | 9056.750000 | 464.939371 | 8533.0 | 8603.75 | 8961.5 | 9416.50 | 10034.0 |
mopt | 82800 | 20.0 | 8332.400000 | 177.225815 | 7888.0 | 8320.75 | 8377.5 | 8442.00 | 8504.0 |
afl | 82800 | 20.0 | 8317.150000 | 168.047385 | 7931.0 | 8288.25 | 8365.0 | 8420.75 | 8496.0 |
aflsmart | 82800 | 20.0 | 8244.000000 | 202.383690 | 7800.0 | 8230.50 | 8304.5 | 8374.50 | 8524.0 |
aflfast | 82800 | 20.0 | 7976.350000 | 222.903159 | 7640.0 | 7820.50 | 7916.0 | 8204.75 | 8311.0 |
fairfuzz | 82800 | 20.0 | 7832.950000 | 112.700570 | 7683.0 | 7768.00 | 7816.0 | 7859.75 | 8213.0 |
orchestra_libfuzzer | 82800 | 19.0 | 7442.315789 | 499.151174 | 7053.0 | 7197.50 | 7291.0 | 7439.00 | 9181.0 |
centipede | 82800 | 20.0 | 7160.400000 | 177.924112 | 6873.0 | 7047.00 | 7140.5 | 7259.00 | 7535.0 |
pastis | 82800 | 20.0 | 3347.550000 | 3.440854 | 3344.0 | 3345.00 | 3345.0 | 3351.25 | 3352.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libafl | 82800 | 20.0 | 11091.70 | 21.812840 | 11042.0 | 11078.75 | 11088.5 | 11103.00 | 11139.0 |
aflplusplus | 82800 | 20.0 | 10907.05 | 305.379570 | 9630.0 | 10940.25 | 10973.0 | 11022.25 | 11067.0 |
aflsmart | 82800 | 20.0 | 10815.45 | 39.488139 | 10703.0 | 10800.25 | 10821.0 | 10841.25 | 10879.0 |
eclipser | 82800 | 20.0 | 10820.15 | 43.008292 | 10754.0 | 10778.50 | 10819.5 | 10861.50 | 10885.0 |
mopt | 82800 | 20.0 | 10796.70 | 40.874777 | 10699.0 | 10777.25 | 10801.5 | 10821.00 | 10864.0 |
afl | 82800 | 20.0 | 10749.75 | 54.151712 | 10644.0 | 10700.00 | 10766.0 | 10787.50 | 10833.0 |
honggfuzz | 82800 | 5.0 | 10670.60 | 74.214554 | 10560.0 | 10642.00 | 10682.0 | 10716.00 | 10753.0 |
aflfast | 82800 | 20.0 | 10670.70 | 51.265152 | 10567.0 | 10642.75 | 10669.0 | 10702.75 | 10770.0 |
libfuzzer | 82800 | 20.0 | 10539.65 | 52.400557 | 10425.0 | 10503.50 | 10541.5 | 10578.25 | 10630.0 |
fairfuzz | 82800 | 20.0 | 9728.25 | 323.424257 | 9130.0 | 9481.50 | 9724.0 | 9986.00 | 10218.0 |
orchestra_honggfuzz | 82800 | 20.0 | 9409.80 | 81.190225 | 9266.0 | 9370.25 | 9382.5 | 9473.00 | 9628.0 |
pastis | 82800 | 19.0 | 7659.00 | 0.000000 | 7659.0 | 7659.00 | 7659.0 | 7659.00 | 7659.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libfuzzer | 82800 | 20.0 | 524.95 | 0.223607 | 524.0 | 525.00 | 525.0 | 525.00 | 525.0 |
orchestra_honggfuzz | 82800 | 19.0 | 525.00 | 0.000000 | 525.0 | 525.00 | 525.0 | 525.00 | 525.0 |
orchestra_libfuzzer | 82800 | 19.0 | 525.00 | 0.000000 | 525.0 | 525.00 | 525.0 | 525.00 | 525.0 |
honggfuzz | 82800 | 20.0 | 522.45 | 1.356272 | 519.0 | 522.00 | 522.0 | 524.00 | 524.0 |
aflplusplus | 82800 | 20.0 | 520.00 | 0.000000 | 520.0 | 520.00 | 520.0 | 520.00 | 520.0 |
eclipser | 82800 | 20.0 | 518.90 | 1.252366 | 516.0 | 518.00 | 519.5 | 520.00 | 520.0 |
centipede | 82800 | 20.0 | 519.65 | 1.980829 | 517.0 | 518.75 | 519.0 | 520.00 | 524.0 |
orchestra_aflplusplus | 82800 | 18.0 | 519.00 | 0.000000 | 519.0 | 519.00 | 519.0 | 519.00 | 519.0 |
mopt | 82800 | 20.0 | 517.20 | 3.955010 | 505.0 | 518.00 | 518.0 | 519.00 | 520.0 |
aflsmart | 82800 | 20.0 | 517.90 | 1.165287 | 516.0 | 517.00 | 517.5 | 519.00 | 520.0 |
afl | 82800 | 20.0 | 517.65 | 0.812728 | 517.0 | 517.00 | 517.0 | 518.00 | 519.0 |
aflfast | 82800 | 20.0 | 513.90 | 10.622221 | 478.0 | 517.00 | 517.0 | 519.00 | 519.0 |
fairfuzz | 82800 | 20.0 | 517.45 | 0.998683 | 516.0 | 517.00 | 517.0 | 517.25 | 520.0 |
libafl | 82800 | 20.0 | 517.10 | 0.911910 | 516.0 | 517.00 | 517.0 | 517.00 | 519.0 |
pastis | 82800 | 20.0 | 214.00 | 0.000000 | 214.0 | 214.00 | 214.0 | 214.00 | 214.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libafl | 82800 | 20.0 | 2044.700000 | 142.437466 | 1553.0 | 2021.00 | 2057.5 | 2104.25 | 2284.0 |
aflplusplus | 82800 | 20.0 | 1935.250000 | 210.561124 | 1540.0 | 1898.75 | 2025.5 | 2071.50 | 2128.0 |
orchestra_libfuzzer | 82800 | 20.0 | 2008.100000 | 67.864338 | 1884.0 | 1961.50 | 2000.5 | 2041.50 | 2137.0 |
orchestra_aflplusplus | 82800 | 18.0 | 2015.944444 | 63.796987 | 1946.0 | 1976.25 | 1996.0 | 2041.00 | 2206.0 |
libfuzzer | 82800 | 20.0 | 1946.000000 | 97.029024 | 1790.0 | 1889.75 | 1947.5 | 1983.25 | 2140.0 |
orchestra_honggfuzz | 82800 | 19.0 | 1841.894737 | 170.828014 | 1329.0 | 1796.00 | 1888.0 | 1943.50 | 2010.0 |
eclipser | 82800 | 20.0 | 1736.000000 | 135.909025 | 1522.0 | 1573.00 | 1789.0 | 1838.50 | 1904.0 |
honggfuzz | 82800 | 20.0 | 1377.200000 | 536.015279 | 686.0 | 726.25 | 1623.5 | 1811.00 | 2030.0 |
afl | 82800 | 20.0 | 1260.100000 | 448.102890 | 648.0 | 795.50 | 1510.5 | 1612.75 | 1812.0 |
mopt | 82800 | 20.0 | 1230.000000 | 430.050425 | 651.0 | 845.25 | 1439.5 | 1604.00 | 1765.0 |
fairfuzz | 82800 | 20.0 | 1181.850000 | 428.681488 | 652.0 | 790.25 | 1148.5 | 1575.75 | 1919.0 |
aflsmart | 82800 | 20.0 | 1123.250000 | 441.957235 | 649.0 | 673.75 | 918.0 | 1575.50 | 1795.0 |
centipede | 82800 | 20.0 | 1058.500000 | 289.194617 | 762.0 | 797.75 | 890.0 | 1360.50 | 1542.0 |
aflfast | 82800 | 20.0 | 635.600000 | 19.277475 | 569.0 | 637.75 | 642.5 | 646.00 | 657.0 |
pastis | 82800 | 20.0 | 41.000000 | 0.000000 | 41.0 | 41.00 | 41.0 | 41.00 | 41.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libfuzzer | 82800 | 20.0 | 3086.200000 | 1.507874 | 3083.0 | 3085.00 | 3087.0 | 3087.00 | 3088.0 |
aflplusplus | 82800 | 20.0 | 3078.200000 | 15.763382 | 3013.0 | 3080.00 | 3081.5 | 3084.00 | 3087.0 |
libafl | 82800 | 20.0 | 3079.750000 | 8.872637 | 3044.0 | 3079.50 | 3081.5 | 3083.25 | 3086.0 |
afl | 82800 | 20.0 | 3071.500000 | 20.464346 | 3007.0 | 3071.75 | 3080.0 | 3083.00 | 3086.0 |
honggfuzz | 82800 | 20.0 | 3057.050000 | 19.465151 | 3007.0 | 3055.25 | 3064.0 | 3067.00 | 3074.0 |
orchestra_libfuzzer | 82800 | 17.0 | 2964.470588 | 69.917020 | 2853.0 | 2904.00 | 2976.0 | 3012.00 | 3079.0 |
orchestra_honggfuzz | 82800 | 20.0 | 2926.950000 | 81.392147 | 2767.0 | 2913.50 | 2940.5 | 2988.25 | 3023.0 |
centipede | 82800 | 20.0 | 2546.050000 | 0.686333 | 2545.0 | 2546.00 | 2546.0 | 2546.25 | 2547.0 |
aflsmart | 82800 | 20.0 | 2545.350000 | 1.980829 | 2543.0 | 2544.00 | 2545.0 | 2546.00 | 2551.0 |
mopt | 82800 | 20.0 | 2544.450000 | 1.099043 | 2543.0 | 2544.00 | 2544.0 | 2545.00 | 2547.0 |
aflfast | 82800 | 20.0 | 2543.900000 | 1.483240 | 2541.0 | 2543.00 | 2543.5 | 2545.00 | 2548.0 |
fairfuzz | 82800 | 20.0 | 2539.950000 | 4.795557 | 2533.0 | 2536.00 | 2542.0 | 2542.25 | 2550.0 |
pastis | 82800 | 20.0 | 2528.000000 | 0.000000 | 2528.0 | 2528.00 | 2528.0 | 2528.00 | 2528.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 2964.550000 | 109.551466 | 2790.0 | 2865.25 | 2970.5 | 3029.25 | 3218.0 |
centipede | 82800 | 20.0 | 2693.100000 | 641.869219 | 101.0 | 2738.50 | 2876.0 | 2976.00 | 3138.0 |
orchestra_honggfuzz | 82800 | 19.0 | 2725.473684 | 73.138657 | 2600.0 | 2675.00 | 2741.0 | 2772.00 | 2906.0 |
orchestra_libfuzzer | 82800 | 19.0 | 2582.368421 | 54.431619 | 2471.0 | 2537.00 | 2585.0 | 2611.00 | 2694.0 |
libfuzzer | 82800 | 20.0 | 2521.050000 | 151.141090 | 2104.0 | 2494.25 | 2562.5 | 2597.75 | 2712.0 |
eclipser | 82800 | 20.0 | 2506.050000 | 205.275547 | 1990.0 | 2411.75 | 2553.5 | 2590.75 | 2872.0 |
libafl | 82800 | 20.0 | 2397.800000 | 221.079790 | 1991.0 | 2324.50 | 2448.0 | 2513.25 | 2721.0 |
aflfast | 82800 | 20.0 | 40.300000 | 4.231461 | 34.0 | 34.00 | 43.0 | 43.00 | 43.0 |
fairfuzz | 82800 | 20.0 | 38.850000 | 4.404244 | 33.0 | 33.00 | 42.0 | 42.00 | 42.0 |
afl | 82800 | 20.0 | 37.650000 | 4.246051 | 34.0 | 34.00 | 34.0 | 43.00 | 43.0 |
mopt | 82800 | 20.0 | 37.400000 | 4.357691 | 34.0 | 34.00 | 34.0 | 43.00 | 43.0 |
aflsmart | 82800 | 20.0 | 34.800000 | 3.693522 | 33.0 | 33.00 | 33.0 | 33.00 | 42.0 |
pastis | 82800 | 19.0 | 33.000000 | 0.000000 | 33.0 | 33.00 | 33.0 | 33.00 | 33.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
orchestra_libfuzzer | 82800 | 18.0 | 2025.222222 | 1.165966 | 2023.0 | 2025.00 | 2025.0 | 2026.00 | 2027.0 |
libfuzzer | 82800 | 20.0 | 2018.000000 | 1.169795 | 2015.0 | 2018.00 | 2018.0 | 2019.00 | 2020.0 |
orchestra_honggfuzz | 82800 | 19.0 | 2018.368421 | 2.216367 | 2017.0 | 2017.00 | 2018.0 | 2018.00 | 2026.0 |
centipede | 82800 | 20.0 | 2015.200000 | 1.704483 | 2012.0 | 2013.75 | 2016.0 | 2017.00 | 2017.0 |
honggfuzz | 82800 | 20.0 | 2028.050000 | 33.887546 | 2003.0 | 2010.00 | 2012.5 | 2017.25 | 2099.0 |
orchestra_aflplusplus | 82800 | 19.0 | 2012.315789 | 17.201591 | 1985.0 | 2007.00 | 2012.0 | 2015.00 | 2060.0 |
aflplusplus | 82800 | 20.0 | 2012.050000 | 26.174465 | 1996.0 | 2002.50 | 2004.5 | 2006.25 | 2091.0 |
libafl | 82800 | 20.0 | 1998.750000 | 5.874790 | 1981.0 | 1998.75 | 2001.0 | 2002.00 | 2004.0 |
aflsmart | 82800 | 20.0 | 1995.400000 | 5.490662 | 1974.0 | 1994.00 | 1996.0 | 1998.25 | 2000.0 |
eclipser | 82800 | 20.0 | 1990.450000 | 11.250614 | 1972.0 | 1978.00 | 1994.0 | 1998.25 | 2003.0 |
afl | 82800 | 20.0 | 1976.450000 | 31.531897 | 1884.0 | 1971.75 | 1990.5 | 1995.25 | 2000.0 |
mopt | 82800 | 20.0 | 1978.850000 | 26.776413 | 1911.0 | 1975.00 | 1990.0 | 1993.50 | 2008.0 |
fairfuzz | 82800 | 20.0 | 1984.100000 | 13.814180 | 1945.0 | 1974.75 | 1988.5 | 1995.00 | 2000.0 |
aflfast | 82800 | 20.0 | 1967.600000 | 20.301413 | 1943.0 | 1948.25 | 1964.0 | 1989.50 | 1997.0 |
pastis | 82800 | 10.0 | 1495.800000 | 27.017690 | 1482.0 | 1482.00 | 1486.0 | 1486.00 | 1565.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 15738.100000 | 52.114146 | 15640.0 | 15711.50 | 15724.5 | 15782.00 | 15822.0 |
libafl | 82800 | 20.0 | 15592.550000 | 43.236772 | 15461.0 | 15573.50 | 15592.5 | 15618.75 | 15655.0 |
honggfuzz | 82800 | 20.0 | 15569.200000 | 46.622335 | 15492.0 | 15536.00 | 15573.0 | 15586.00 | 15655.0 |
eclipser | 82800 | 20.0 | 15423.450000 | 79.669366 | 15257.0 | 15387.50 | 15423.5 | 15463.75 | 15601.0 |
libfuzzer | 82800 | 20.0 | 15370.200000 | 103.283259 | 15096.0 | 15311.25 | 15382.0 | 15427.75 | 15537.0 |
aflsmart | 82800 | 20.0 | 15366.800000 | 68.816767 | 15248.0 | 15322.50 | 15366.5 | 15410.75 | 15497.0 |
afl | 82800 | 20.0 | 15346.600000 | 76.391237 | 15154.0 | 15289.75 | 15353.5 | 15401.25 | 15482.0 |
mopt | 82800 | 20.0 | 15318.600000 | 62.704319 | 15155.0 | 15285.50 | 15326.0 | 15366.25 | 15397.0 |
aflfast | 82800 | 20.0 | 15320.650000 | 78.755635 | 15159.0 | 15271.75 | 15318.0 | 15356.00 | 15509.0 |
centipede | 82800 | 20.0 | 14698.500000 | 140.327249 | 14480.0 | 14610.75 | 14689.0 | 14786.25 | 14984.0 |
fairfuzz | 82800 | 20.0 | 14146.650000 | 259.273738 | 13616.0 | 14060.75 | 14144.0 | 14227.25 | 14834.0 |
orchestra_honggfuzz | 82800 | 19.0 | 13909.736842 | 320.966222 | 13291.0 | 13736.00 | 13875.0 | 14078.50 | 14521.0 |
orchestra_libfuzzer | 82800 | 14.0 | 13606.500000 | 424.029707 | 12463.0 | 13591.00 | 13737.0 | 13816.50 | 14063.0 |
pastis | 82800 | 20.0 | 8702.600000 | 1.465390 | 8702.0 | 8702.00 | 8702.0 | 8702.00 | 8706.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 11207.200000 | 77.913988 | 11109.0 | 11143.25 | 11178.0 | 11268.00 | 11358.0 |
honggfuzz | 82800 | 20.0 | 11045.100000 | 108.722680 | 10855.0 | 10983.25 | 11050.5 | 11133.00 | 11226.0 |
libafl | 82800 | 20.0 | 10930.350000 | 68.430737 | 10825.0 | 10875.00 | 10953.0 | 10994.00 | 11018.0 |
fairfuzz | 82800 | 20.0 | 10883.250000 | 144.964197 | 10516.0 | 10827.75 | 10942.5 | 10959.25 | 11047.0 |
aflsmart | 82800 | 20.0 | 10894.550000 | 51.799690 | 10814.0 | 10859.25 | 10901.0 | 10915.00 | 11026.0 |
eclipser | 82800 | 20.0 | 10895.650000 | 65.938787 | 10729.0 | 10862.50 | 10897.5 | 10938.25 | 11010.0 |
afl | 82800 | 20.0 | 10658.800000 | 135.384676 | 10462.0 | 10529.00 | 10718.5 | 10770.25 | 10865.0 |
centipede | 82800 | 20.0 | 10707.650000 | 111.331782 | 10611.0 | 10631.75 | 10676.0 | 10724.25 | 11038.0 |
aflfast | 82800 | 20.0 | 10636.050000 | 92.919022 | 10363.0 | 10591.25 | 10649.5 | 10692.75 | 10786.0 |
mopt | 82800 | 20.0 | 10571.500000 | 126.561198 | 10325.0 | 10484.75 | 10580.0 | 10646.00 | 10781.0 |
libfuzzer | 82800 | 20.0 | 10508.200000 | 170.989258 | 10149.0 | 10417.50 | 10530.0 | 10632.75 | 10775.0 |
orchestra_aflplusplus | 82800 | 18.0 | 9827.222222 | 117.561276 | 9603.0 | 9762.00 | 9831.5 | 9911.75 | 10030.0 |
orchestra_libfuzzer | 82800 | 20.0 | 8492.550000 | 301.921299 | 8266.0 | 8334.75 | 8420.5 | 8488.25 | 9695.0 |
orchestra_honggfuzz | 82800 | 20.0 | 8456.150000 | 314.790202 | 8237.0 | 8280.00 | 8406.5 | 8470.00 | 9717.0 |
pastis | 82800 | 19.0 | 5868.000000 | 0.000000 | 5868.0 | 5868.00 | 5868.0 | 5868.00 | 5868.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libafl | 82800 | 20.0 | 3259.750000 | 386.054383 | 2723.0 | 2744.25 | 3327.5 | 3660.75 | 3694.0 |
aflplusplus | 82800 | 20.0 | 2793.150000 | 33.280744 | 2723.0 | 2769.25 | 2792.0 | 2819.50 | 2856.0 |
fairfuzz | 82800 | 20.0 | 2820.700000 | 203.472771 | 2730.0 | 2753.25 | 2779.0 | 2794.75 | 3676.0 |
eclipser | 82800 | 20.0 | 2774.450000 | 217.678052 | 2702.0 | 2715.25 | 2726.0 | 2733.25 | 3697.0 |
orchestra_aflplusplus | 82800 | 19.0 | 2720.947368 | 30.712780 | 2644.0 | 2707.00 | 2723.0 | 2742.50 | 2764.0 |
aflsmart | 82800 | 20.0 | 2722.050000 | 16.750412 | 2697.0 | 2712.50 | 2720.0 | 2728.25 | 2771.0 |
libfuzzer | 82800 | 20.0 | 2725.500000 | 145.014518 | 2654.0 | 2675.00 | 2692.5 | 2709.50 | 3331.0 |
afl | 82800 | 20.0 | 2695.700000 | 25.393949 | 2653.0 | 2680.75 | 2692.0 | 2716.50 | 2744.0 |
mopt | 82800 | 20.0 | 2644.600000 | 88.620658 | 2444.0 | 2562.50 | 2688.0 | 2699.50 | 2756.0 |
honggfuzz | 82800 | 20.0 | 2695.500000 | 41.359146 | 2647.0 | 2670.00 | 2681.0 | 2704.50 | 2802.0 |
centipede | 82800 | 20.0 | 2639.900000 | 12.531644 | 2621.0 | 2630.50 | 2639.0 | 2644.50 | 2673.0 |
aflfast | 82800 | 20.0 | 2638.300000 | 14.026666 | 2607.0 | 2630.75 | 2638.0 | 2643.50 | 2675.0 |
orchestra_libfuzzer | 82800 | 20.0 | 2552.600000 | 46.644682 | 2457.0 | 2520.25 | 2552.0 | 2584.50 | 2638.0 |
orchestra_honggfuzz | 82800 | 20.0 | 2479.150000 | 39.997730 | 2363.0 | 2453.75 | 2491.0 | 2508.00 | 2532.0 |
pastis | 82800 | 20.0 | 1881.000000 | 0.000000 | 1881.0 | 1881.00 | 1881.0 | 1881.00 | 1881.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
honggfuzz | 82800 | 20.0 | 9546.550000 | 6.549206 | 9535.0 | 9543.75 | 9545.0 | 9549.00 | 9559.0 |
mopt | 82800 | 20.0 | 9539.100000 | 13.540971 | 9517.0 | 9525.75 | 9540.5 | 9548.25 | 9563.0 |
libafl | 82800 | 20.0 | 9536.750000 | 15.095747 | 9482.0 | 9533.50 | 9539.5 | 9542.75 | 9553.0 |
aflsmart | 82800 | 20.0 | 9518.750000 | 42.213586 | 9433.0 | 9511.75 | 9533.5 | 9543.00 | 9582.0 |
aflplusplus | 82800 | 20.0 | 9535.400000 | 9.075125 | 9522.0 | 9528.75 | 9532.5 | 9544.00 | 9549.0 |
eclipser | 82800 | 20.0 | 9518.450000 | 26.296838 | 9441.0 | 9515.25 | 9526.5 | 9533.75 | 9541.0 |
aflfast | 82800 | 20.0 | 9509.100000 | 52.625689 | 9380.0 | 9493.00 | 9525.5 | 9551.00 | 9561.0 |
afl | 82800 | 20.0 | 9511.500000 | 35.952454 | 9444.0 | 9500.75 | 9524.5 | 9535.25 | 9555.0 |
orchestra_honggfuzz | 82800 | 19.0 | 9499.736842 | 27.485030 | 9450.0 | 9482.00 | 9498.0 | 9514.00 | 9560.0 |
orchestra_aflplusplus | 82800 | 19.0 | 9500.789474 | 29.085275 | 9461.0 | 9476.00 | 9497.0 | 9513.50 | 9570.0 |
orchestra_libfuzzer | 82800 | 2.0 | 9494.000000 | 67.882251 | 9446.0 | 9470.00 | 9494.0 | 9518.00 | 9542.0 |
libfuzzer | 82800 | 20.0 | 9424.800000 | 48.364406 | 9335.0 | 9394.00 | 9420.5 | 9455.00 | 9522.0 |
fairfuzz | 82800 | 20.0 | 8690.750000 | 181.798001 | 8400.0 | 8579.25 | 8713.0 | 8780.50 | 9055.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflsmart | 82800 | 20.0 | 5830.350000 | 2.539685 | 5827.0 | 5829.00 | 5830.0 | 5831.00 | 5840.0 |
eclipser | 82800 | 20.0 | 5829.450000 | 3.119970 | 5817.0 | 5829.00 | 5830.0 | 5831.00 | 5832.0 |
libfuzzer | 82800 | 20.0 | 5827.200000 | 5.615767 | 5817.0 | 5822.50 | 5829.0 | 5832.00 | 5833.0 |
mopt | 82800 | 20.0 | 5824.900000 | 6.290343 | 5810.0 | 5823.00 | 5828.0 | 5829.00 | 5829.0 |
afl | 82800 | 20.0 | 5826.200000 | 4.323741 | 5817.0 | 5824.25 | 5827.5 | 5829.25 | 5831.0 |
aflplusplus | 82800 | 20.0 | 5823.550000 | 6.863136 | 5807.0 | 5821.00 | 5825.0 | 5827.50 | 5834.0 |
centipede | 82800 | 20.0 | 5823.800000 | 5.863356 | 5810.0 | 5822.00 | 5825.0 | 5828.00 | 5833.0 |
libafl | 82800 | 20.0 | 5826.200000 | 3.968295 | 5821.0 | 5823.00 | 5825.0 | 5831.00 | 5831.0 |
fairfuzz | 82800 | 20.0 | 5821.500000 | 2.874571 | 5817.0 | 5819.00 | 5822.0 | 5823.00 | 5827.0 |
aflfast | 82800 | 20.0 | 5819.200000 | 6.304551 | 5804.0 | 5816.75 | 5820.5 | 5824.00 | 5827.0 |
honggfuzz | 82800 | 20.0 | 5817.450000 | 7.917170 | 5806.0 | 5810.00 | 5819.5 | 5822.00 | 5834.0 |
orchestra_aflplusplus | 82800 | 19.0 | 5815.947368 | 6.337487 | 5807.0 | 5811.50 | 5813.0 | 5821.00 | 5827.0 |
orchestra_libfuzzer | 82800 | 19.0 | 5802.894737 | 8.312606 | 5791.0 | 5797.50 | 5803.0 | 5809.50 | 5818.0 |
orchestra_honggfuzz | 82800 | 20.0 | 5785.200000 | 7.120024 | 5774.0 | 5780.75 | 5784.5 | 5789.75 | 5799.0 |
pastis | 82800 | 19.0 | 5774.000000 | 0.000000 | 5774.0 | 5774.00 | 5774.0 | 5774.00 | 5774.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libafl | 82800 | 20.0 | 3321.15 | 261.997243 | 2908.0 | 3038.00 | 3456.5 | 3534.25 | 3581.0 |
libfuzzer | 82800 | 20.0 | 3079.40 | 13.287905 | 3053.0 | 3070.00 | 3078.0 | 3090.00 | 3108.0 |
aflplusplus | 82800 | 20.0 | 3106.30 | 135.384870 | 3042.0 | 3053.75 | 3065.0 | 3075.50 | 3524.0 |
orchestra_aflplusplus | 82800 | 20.0 | 3189.35 | 189.022214 | 3039.0 | 3044.00 | 3065.0 | 3397.00 | 3533.0 |
orchestra_libfuzzer | 82800 | 20.0 | 3077.00 | 48.924216 | 3053.0 | 3059.50 | 3062.0 | 3076.50 | 3280.0 |
eclipser | 82800 | 20.0 | 3022.20 | 46.183387 | 2911.0 | 3010.75 | 3038.5 | 3046.75 | 3087.0 |
honggfuzz | 82800 | 20.0 | 3067.55 | 249.356957 | 2896.0 | 2918.75 | 3037.5 | 3047.50 | 3855.0 |
orchestra_honggfuzz | 82800 | 20.0 | 2923.00 | 16.179910 | 2901.0 | 2913.00 | 2916.0 | 2933.75 | 2959.0 |
mopt | 82800 | 20.0 | 2945.55 | 143.939854 | 2807.0 | 2902.25 | 2914.0 | 2923.75 | 3490.0 |
aflsmart | 82800 | 20.0 | 2889.60 | 38.982317 | 2826.0 | 2836.50 | 2909.5 | 2913.25 | 2934.0 |
afl | 82800 | 20.0 | 2889.20 | 52.609385 | 2819.0 | 2831.25 | 2904.5 | 2914.50 | 3006.0 |
aflfast | 82800 | 20.0 | 2877.30 | 39.174508 | 2824.0 | 2830.75 | 2892.5 | 2908.75 | 2927.0 |
centipede | 82800 | 20.0 | 2849.85 | 60.583370 | 2728.0 | 2787.00 | 2876.0 | 2896.75 | 2925.0 |
fairfuzz | 82800 | 20.0 | 2756.10 | 75.288847 | 2628.0 | 2724.25 | 2751.5 | 2788.50 | 2907.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
honggfuzz | 82800 | 20.0 | 7932.250000 | 219.503956 | 7504.0 | 7859.00 | 8002.0 | 8059.00 | 8245.0 |
libfuzzer | 82800 | 20.0 | 7556.850000 | 86.613038 | 7414.0 | 7485.75 | 7543.5 | 7608.50 | 7727.0 |
aflplusplus | 82800 | 20.0 | 7213.550000 | 197.000260 | 6897.0 | 7077.00 | 7247.5 | 7343.75 | 7639.0 |
orchestra_honggfuzz | 82800 | 20.0 | 6558.800000 | 156.587826 | 6187.0 | 6483.00 | 6564.5 | 6634.75 | 6839.0 |
orchestra_libfuzzer | 82800 | 19.0 | 6333.157895 | 155.275835 | 6062.0 | 6243.00 | 6309.0 | 6482.00 | 6607.0 |
eclipser | 82800 | 20.0 | 4890.400000 | 462.103247 | 3876.0 | 4703.25 | 4924.5 | 5103.75 | 5696.0 |
centipede | 82800 | 20.0 | 839.800000 | 73.863744 | 812.0 | 820.75 | 824.0 | 826.50 | 1153.0 |
libafl | 82800 | 20.0 | 809.500000 | 12.601170 | 763.0 | 806.50 | 808.5 | 817.00 | 826.0 |
fairfuzz | 82800 | 20.0 | 780.450000 | 74.632768 | 497.0 | 747.75 | 807.5 | 818.25 | 826.0 |
afl | 82800 | 20.0 | 802.200000 | 21.060314 | 740.0 | 804.00 | 807.0 | 809.75 | 819.0 |
aflsmart | 82800 | 20.0 | 784.000000 | 73.153767 | 497.0 | 805.00 | 806.5 | 818.00 | 819.0 |
mopt | 82800 | 20.0 | 770.300000 | 74.056948 | 497.0 | 740.75 | 806.5 | 815.00 | 820.0 |
aflfast | 82800 | 20.0 | 738.300000 | 115.000275 | 475.0 | 731.75 | 794.5 | 806.50 | 817.0 |
pastis | 82800 | 17.0 | 267.000000 | 0.000000 | 267.0 | 267.00 | 267.0 | 267.00 | 267.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libfuzzer | 82800 | 20.0 | 2884.000000 | 2.492093 | 2880.0 | 2882.00 | 2883.5 | 2885.00 | 2891.0 |
aflplusplus | 82800 | 20.0 | 2877.800000 | 4.926833 | 2866.0 | 2876.00 | 2878.0 | 2880.25 | 2885.0 |
orchestra_libfuzzer | 82800 | 19.0 | 2877.263158 | 2.578589 | 2872.0 | 2875.00 | 2878.0 | 2879.00 | 2883.0 |
aflsmart | 82800 | 20.0 | 2868.550000 | 4.936172 | 2860.0 | 2865.75 | 2868.5 | 2872.50 | 2876.0 |
eclipser | 82800 | 20.0 | 2860.850000 | 23.079439 | 2785.0 | 2861.50 | 2867.5 | 2872.25 | 2878.0 |
aflfast | 82800 | 20.0 | 2865.450000 | 6.270021 | 2849.0 | 2864.50 | 2866.5 | 2870.00 | 2873.0 |
fairfuzz | 82800 | 20.0 | 2834.650000 | 73.055332 | 2631.0 | 2856.25 | 2864.0 | 2869.00 | 2875.0 |
afl | 82800 | 20.0 | 2851.800000 | 33.783521 | 2758.0 | 2857.75 | 2863.5 | 2869.25 | 2873.0 |
mopt | 82800 | 20.0 | 2856.300000 | 7.947856 | 2843.0 | 2849.75 | 2858.5 | 2862.25 | 2869.0 |
libafl | 82800 | 20.0 | 2856.850000 | 7.761409 | 2846.0 | 2849.00 | 2857.5 | 2864.50 | 2868.0 |
honggfuzz | 82800 | 20.0 | 2851.850000 | 8.963523 | 2836.0 | 2846.50 | 2850.0 | 2856.25 | 2869.0 |
orchestra_honggfuzz | 82800 | 19.0 | 2848.684211 | 10.811787 | 2835.0 | 2838.50 | 2848.0 | 2857.00 | 2867.0 |
centipede | 82800 | 20.0 | 2772.600000 | 17.005881 | 2736.0 | 2764.75 | 2772.5 | 2785.00 | 2812.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflsmart | 82800 | 20.0 | 19264.550000 | 284.391590 | 18652.0 | 19128.25 | 19284.0 | 19399.00 | 19883.0 |
eclipser | 82800 | 20.0 | 19215.250000 | 317.380707 | 18729.0 | 18953.50 | 19191.5 | 19428.00 | 19939.0 |
mopt | 82800 | 20.0 | 19038.100000 | 288.714191 | 18474.0 | 18934.50 | 19060.5 | 19248.75 | 19483.0 |
afl | 82800 | 20.0 | 18945.550000 | 270.730294 | 18414.0 | 18732.25 | 18885.5 | 19180.25 | 19380.0 |
libafl | 82800 | 20.0 | 18853.950000 | 124.714189 | 18638.0 | 18775.75 | 18835.0 | 18946.75 | 19056.0 |
aflfast | 82800 | 20.0 | 18711.000000 | 281.495069 | 18104.0 | 18609.25 | 18713.5 | 18918.25 | 19183.0 |
aflplusplus | 82800 | 20.0 | 18666.050000 | 1523.443795 | 15066.0 | 17937.50 | 18494.0 | 20214.25 | 20568.0 |
libfuzzer | 82800 | 20.0 | 16541.150000 | 377.282426 | 15825.0 | 16287.00 | 16548.5 | 16731.00 | 17535.0 |
honggfuzz | 82800 | 20.0 | 14800.300000 | 476.602019 | 13799.0 | 14555.75 | 14765.0 | 15077.25 | 15724.0 |
fairfuzz | 82800 | 20.0 | 13246.650000 | 1692.282646 | 10991.0 | 11657.25 | 13522.5 | 14776.25 | 16178.0 |
centipede | 82800 | 18.0 | 13391.333333 | 312.381554 | 12856.0 | 13199.75 | 13329.0 | 13560.00 | 13974.0 |
orchestra_aflplusplus | 82800 | 20.0 | 11989.300000 | 391.214721 | 11187.0 | 11819.25 | 11948.5 | 12124.50 | 13262.0 |
orchestra_libfuzzer | 82800 | 19.0 | 11595.105263 | 139.408231 | 11371.0 | 11523.50 | 11610.0 | 11652.50 | 11875.0 |
orchestra_honggfuzz | 82800 | 18.0 | 10926.611111 | 355.409811 | 10592.0 | 10689.50 | 10800.5 | 11028.75 | 11881.0 |
pastis | 82800 | 20.0 | 7766.900000 | 1.970840 | 7765.0 | 7765.00 | 7766.0 | 7769.00 | 7769.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 2170.250000 | 55.177107 | 2112.0 | 2116.00 | 2194.5 | 2212.25 | 2299.0 |
libafl | 82800 | 20.0 | 2152.450000 | 42.371136 | 2078.0 | 2108.50 | 2178.0 | 2189.25 | 2195.0 |
honggfuzz | 82800 | 20.0 | 2129.600000 | 34.347144 | 2106.0 | 2112.00 | 2114.5 | 2117.25 | 2199.0 |
eclipser | 82800 | 20.0 | 2109.450000 | 30.165290 | 2080.0 | 2098.50 | 2106.0 | 2109.25 | 2192.0 |
orchestra_honggfuzz | 82800 | 19.0 | 2081.947368 | 14.912611 | 2053.0 | 2073.00 | 2082.0 | 2091.50 | 2108.0 |
libfuzzer | 82800 | 20.0 | 2036.150000 | 51.490699 | 1988.0 | 2005.50 | 2014.0 | 2079.00 | 2183.0 |
afl | 82800 | 20.0 | 2025.700000 | 53.595070 | 1982.0 | 2001.75 | 2005.5 | 2010.25 | 2192.0 |
aflsmart | 82800 | 20.0 | 2016.000000 | 29.568831 | 1983.0 | 2004.00 | 2005.5 | 2008.00 | 2090.0 |
mopt | 82800 | 20.0 | 2003.600000 | 38.368573 | 1953.0 | 1985.50 | 1994.0 | 2004.25 | 2088.0 |
aflfast | 82800 | 20.0 | 1983.900000 | 30.450823 | 1903.0 | 1974.00 | 1984.0 | 2000.25 | 2065.0 |
fairfuzz | 82800 | 20.0 | 1967.250000 | 49.496278 | 1854.0 | 1938.50 | 1983.0 | 1996.50 | 2086.0 |
orchestra_aflplusplus | 82800 | 20.0 | 1989.850000 | 27.189927 | 1960.0 | 1968.75 | 1976.0 | 2015.25 | 2040.0 |
orchestra_libfuzzer | 82800 | 19.0 | 1968.526316 | 16.314167 | 1938.0 | 1956.50 | 1969.0 | 1979.00 | 2000.0 |
centipede | 82800 | 20.0 | 1959.550000 | 4.547700 | 1952.0 | 1956.75 | 1958.5 | 1962.75 | 1967.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
aflplusplus | 82800 | 20.0 | 234.25 | 6.640189 | 223.0 | 226.0 | 239.0 | 239.00 | 240.0 |
centipede | 82800 | 20.0 | 234.95 | 0.223607 | 234.0 | 235.0 | 235.0 | 235.00 | 235.0 |
honggfuzz | 82800 | 20.0 | 233.45 | 3.440854 | 224.0 | 233.0 | 233.0 | 237.00 | 238.0 |
libafl | 82800 | 20.0 | 223.55 | 1.394538 | 221.0 | 223.0 | 224.0 | 224.00 | 226.0 |
eclipser | 82800 | 20.0 | 220.65 | 1.496487 | 219.0 | 219.0 | 221.0 | 222.00 | 223.0 |
afl | 82800 | 20.0 | 220.20 | 1.609184 | 217.0 | 219.0 | 219.5 | 222.00 | 223.0 |
aflfast | 82800 | 20.0 | 220.35 | 1.496487 | 219.0 | 219.0 | 219.5 | 222.00 | 223.0 |
aflsmart | 82800 | 20.0 | 220.10 | 1.586124 | 217.0 | 219.0 | 219.0 | 221.25 | 223.0 |
mopt | 82800 | 20.0 | 220.20 | 1.542384 | 219.0 | 219.0 | 219.0 | 222.00 | 223.0 |
fairfuzz | 82800 | 20.0 | 208.85 | 9.653333 | 189.0 | 202.0 | 206.0 | 219.00 | 222.0 |
orchestra_honggfuzz | 82800 | 17.0 | 203.00 | 7.929376 | 187.0 | 201.0 | 201.0 | 207.00 | 219.0 |
libfuzzer | 82800 | 20.0 | 198.45 | 37.134854 | 156.0 | 156.0 | 193.5 | 238.00 | 238.0 |
orchestra_aflplusplus | 82800 | 20.0 | 179.80 | 32.424163 | 140.0 | 160.5 | 166.0 | 223.50 | 230.0 |
orchestra_libfuzzer | 82800 | 20.0 | 173.85 | 21.599890 | 140.0 | 166.0 | 166.0 | 166.00 | 216.0 |
pastis | 82800 | 19.0 | 128.00 | 0.000000 | 128.0 | 128.0 | 128.0 | 128.00 | 128.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
orchestra_aflplusplus | 82800 | 20.0 | 1348.350000 | 15.967978 | 1311.0 | 1340.00 | 1355.0 | 1360.00 | 1364.0 |
orchestra_libfuzzer | 82800 | 19.0 | 1346.631579 | 13.606414 | 1302.0 | 1343.00 | 1348.0 | 1353.00 | 1367.0 |
orchestra_honggfuzz | 82800 | 20.0 | 1311.300000 | 44.753242 | 1180.0 | 1303.75 | 1326.5 | 1341.25 | 1353.0 |
libfuzzer | 82800 | 20.0 | 1272.000000 | 16.270736 | 1264.0 | 1266.00 | 1267.0 | 1269.00 | 1336.0 |
aflplusplus | 82800 | 20.0 | 1266.350000 | 2.996050 | 1259.0 | 1265.00 | 1266.0 | 1268.25 | 1271.0 |
aflsmart | 82800 | 20.0 | 1255.000000 | 2.919986 | 1250.0 | 1253.00 | 1254.5 | 1257.25 | 1262.0 |
mopt | 82800 | 20.0 | 1250.200000 | 12.722132 | 1199.0 | 1250.00 | 1254.0 | 1255.25 | 1258.0 |
afl | 82800 | 20.0 | 1252.500000 | 3.831998 | 1244.0 | 1250.50 | 1252.0 | 1255.25 | 1258.0 |
aflfast | 82800 | 20.0 | 1246.800000 | 15.340349 | 1196.0 | 1248.50 | 1252.0 | 1254.00 | 1256.0 |
eclipser | 82800 | 20.0 | 1251.950000 | 4.358597 | 1244.0 | 1249.75 | 1252.0 | 1255.25 | 1259.0 |
libafl | 82800 | 20.0 | 1251.350000 | 3.513508 | 1247.0 | 1249.00 | 1251.0 | 1252.00 | 1261.0 |
fairfuzz | 82800 | 20.0 | 1234.700000 | 28.252806 | 1160.0 | 1222.50 | 1249.5 | 1253.50 | 1258.0 |
honggfuzz | 82800 | 20.0 | 1249.400000 | 4.805698 | 1235.0 | 1248.00 | 1249.0 | 1253.00 | 1258.0 |
centipede | 82800 | 20.0 | 1149.150000 | 17.263515 | 1122.0 | 1138.50 | 1145.5 | 1161.75 | 1181.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
orchestra_libfuzzer | 82800 | 19.0 | 1213.578947 | 4.549918 | 1200.0 | 1213.00 | 1214.0 | 1215.00 | 1221.0 |
orchestra_aflplusplus | 82800 | 19.0 | 1212.736842 | 4.759109 | 1204.0 | 1210.00 | 1211.0 | 1217.00 | 1220.0 |
orchestra_honggfuzz | 82800 | 20.0 | 1206.550000 | 4.097175 | 1197.0 | 1205.75 | 1207.0 | 1208.00 | 1218.0 |
libafl | 82800 | 20.0 | 1174.100000 | 13.364919 | 1142.0 | 1167.75 | 1174.0 | 1182.50 | 1194.0 |
aflplusplus | 82800 | 20.0 | 1176.650000 | 12.261514 | 1153.0 | 1170.25 | 1173.5 | 1184.50 | 1200.0 |
honggfuzz | 82800 | 20.0 | 1165.800000 | 25.071687 | 1106.0 | 1159.75 | 1172.0 | 1183.00 | 1196.0 |
libfuzzer | 82800 | 20.0 | 1135.500000 | 65.774335 | 1002.0 | 1097.00 | 1139.0 | 1195.00 | 1214.0 |
aflsmart | 82800 | 20.0 | 1133.600000 | 7.036746 | 1116.0 | 1130.75 | 1134.5 | 1138.25 | 1144.0 |
afl | 82800 | 20.0 | 1114.600000 | 21.315673 | 1072.0 | 1103.50 | 1119.5 | 1131.00 | 1145.0 |
mopt | 82800 | 20.0 | 1114.450000 | 16.040984 | 1089.0 | 1102.50 | 1116.0 | 1128.25 | 1136.0 |
aflfast | 82800 | 20.0 | 1083.300000 | 26.647998 | 1025.0 | 1076.00 | 1089.5 | 1101.50 | 1114.0 |
centipede | 82800 | 20.0 | 1076.800000 | 12.033287 | 1056.0 | 1070.25 | 1073.0 | 1085.75 | 1099.0 |
fairfuzz | 82800 | 20.0 | 996.000000 | 26.789629 | 966.0 | 983.00 | 988.5 | 998.50 | 1080.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
libfuzzer | 82800 | 20.0 | 468.650000 | 4.487116 | 462.0 | 463.00 | 472.0 | 472.00 | 472.0 |
orchestra_libfuzzer | 82800 | 19.0 | 471.947368 | 0.229416 | 471.0 | 472.00 | 472.0 | 472.00 | 472.0 |
orchestra_honggfuzz | 82800 | 19.0 | 467.684211 | 4.243330 | 462.0 | 462.00 | 471.0 | 471.00 | 472.0 |
aflplusplus | 82800 | 20.0 | 462.750000 | 5.580747 | 456.0 | 459.75 | 460.0 | 468.50 | 472.0 |
fairfuzz | 82800 | 20.0 | 460.200000 | 4.162489 | 455.0 | 457.50 | 460.0 | 461.25 | 469.0 |
honggfuzz | 82800 | 20.0 | 460.150000 | 3.513508 | 456.0 | 458.00 | 459.0 | 461.25 | 471.0 |
aflsmart | 82800 | 20.0 | 458.350000 | 3.082634 | 455.0 | 456.00 | 458.5 | 459.25 | 468.0 |
afl | 82800 | 20.0 | 457.100000 | 3.210181 | 449.0 | 455.75 | 458.0 | 459.25 | 461.0 |
eclipser | 82800 | 20.0 | 456.400000 | 7.556106 | 427.0 | 455.75 | 458.0 | 460.25 | 462.0 |
mopt | 82800 | 20.0 | 454.150000 | 9.804805 | 419.0 | 453.75 | 455.0 | 458.50 | 468.0 |
centipede | 82800 | 20.0 | 454.500000 | 3.804430 | 451.0 | 451.00 | 454.0 | 457.00 | 464.0 |
orchestra_aflplusplus | 82800 | 20.0 | 454.300000 | 4.426000 | 450.0 | 450.00 | 453.0 | 459.00 | 461.0 |
aflfast | 82800 | 20.0 | 451.050000 | 5.266328 | 437.0 | 448.75 | 451.0 | 454.25 | 459.0 |
libafl | 82800 | 20.0 | 450.350000 | 5.153180 | 443.0 | 448.00 | 448.5 | 451.25 | 460.0 |