🎨 PBF-Bench
Evaluating AI Models on Visual Understanding and Comic Explanations🏆 Leaderboard
| Rank | Model | Avg | Best | Worst |
|---|
📊 Detailed Scores by Comic
| Comic ↕ | Gpt 4o Mini | O3 Mini | Gpt 4.1 | O4 Mini | Gpt 4o | Gemini 2.0 Flash | Gemini 2.5 Flash | Claude 4 Sonnet | Average ↕ |
|---|---|---|---|---|---|---|---|---|---|
| Kitty Stuck | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 6.4 | 4.7 | 2.4 | 7.17 |
| New Herald of Galactus | 8.8 | 8.1 | 7.2 | 6.5 | 7.3 | 6.3 | 3.5 | 3.5 | 6.39 |
| The Blue Hair | 4.5 | 2.4 | 5.5 | 3.5 | 3.5 | 4.3 | 3.5 | 2.2 | 3.67 |
| The Green Menace | 8.8 | 8.8 | 8.5 | 8.7 | 8.8 | 4.8 | 4.8 | 5.5 | 7.33 |
| Keep on Truckin’ | 8.8 | 7.8 | 7.0 | 7.8 | 8.8 | 7.7 | 7.4 | 5.1 | 7.56 |
| Krabzaam | 8.8 | 7.2 | 7.8 | 7.8 | 8.8 | 7.2 | 7.7 | 2.4 | 7.18 |
| 0 Percent Chance | 6.3 | 5.9 | 6.5 | 6.4 | 5.7 | 6.6 | 6.1 | 3.5 | 5.88 |
| A Fit of the Vapours | 9.0 | 8.2 | 8.8 | 8.8 | 8.5 | 9.2 | 8.1 | 7.0 | 8.45 |
| Agresion | 5.4 | 4.6 | 3.7 | 3.7 | 4.7 | 4.3 | 4.2 | 2.4 | 4.11 |
| All Purpose Flour | 8.8 | 9.0 | 8.8 | 8.8 | 8.8 | 9.2 | 8.8 | 7.2 | 8.66 |
| An End to Gopher Trouble | 3.1 | 2.7 | 3.7 | 3.5 | 3.5 | 4.8 | 3.7 | 2.5 | 3.45 |
| Clicked | 8.8 | 8.8 | 8.5 | 8.8 | 8.1 | 8.5 | 8.5 | 4.4 | 8.03 |
| Arise | 8.8 | 8.8 | 8.8 | 8.8 | 7.4 | 4.3 | 6.3 | 5.5 | 7.32 |
| Astronaut Fall | 7.2 | 7.8 | 7.2 | 7.8 | 7.2 | 8.8 | 8.1 | 2.8 | 7.09 |
| Barkelangelo | 8.8 | 8.5 | 8.8 | 8.8 | 8.2 | 7.7 | 8.8 | 6.8 | 8.30 |
| Battleship | 7.9 | 8.8 | 8.8 | 8.8 | 8.8 | 4.2 | 4.8 | 2.4 | 6.79 |
| Big Numbers | 7.3 | 7.2 | 6.2 | 7.2 | 8.8 | 8.8 | 8.8 | 2.8 | 7.11 |
| Billy the Bunny | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 9.0 | 8.8 | 3.7 | 8.16 |
| Bip | 8.5 | 8.5 | 8.5 | 8.5 | 8.2 | 8.5 | 8.8 | 6.9 | 8.29 |
| Bird Chef | 8.8 | 8.8 | 8.8 | 8.5 | 8.5 | 8.8 | 8.1 | 3.5 | 7.95 |
| Blocked | 4.8 | 7.1 | 3.9 | 4.5 | 4.3 | 4.3 | 4.3 | 4.4 | 4.70 |
| Book World | 8.5 | 9.0 | 9.0 | 9.2 | 8.8 | 8.8 | 8.2 | 3.7 | 8.14 |
| Bright | 7.5 | 8.8 | 8.8 | 8.8 | 8.8 | 6.5 | 7.2 | 4.6 | 7.59 |
| Brushed | 7.8 | 6.8 | 8.8 | 8.5 | 8.8 | 8.8 | 7.0 | 4.3 | 7.60 |
| Bubbled | 7.6 | 7.7 | 7.7 | 7.5 | 7.7 | 8.8 | 8.1 | 2.8 | 7.21 |
| Caring for Your Turtle | 8.3 | 7.1 | 7.0 | 8.8 | 7.8 | 7.2 | 4.2 | 3.5 | 6.72 |
| Charged | 8.8 | 8.8 | 8.5 | 6.9 | 8.8 | 8.8 | 8.8 | 6.3 | 8.19 |
| Primate Checkmate | 7.1 | 4.3 | 5.9 | 3.9 | 6.2 | 8.8 | 7.4 | 3.5 | 5.87 |
| Clear Boundaries | 8.5 | 8.8 | 8.8 | 8.8 | 8.8 | 9.2 | 8.8 | 3.7 | 8.14 |
| Clear Message | 7.0 | 7.2 | 6.2 | 4.4 | 7.0 | 4.7 | 5.4 | 4.1 | 5.74 |
| Command Respect | 7.8 | 8.8 | 7.1 | 7.8 | 7.2 | 6.4 | 7.2 | 2.7 | 6.85 |
| Connections | 7.1 | 6.3 | 6.1 | 5.9 | 6.8 | 7.2 | 7.2 | 3.5 | 6.26 |
| Cranky Baby | 8.5 | 8.8 | 7.8 | 9.2 | 9.2 | 6.8 | 5.5 | 3.4 | 7.39 |
| Cupid Mistake | 7.5 | 7.2 | 7.2 | 6.8 | 7.8 | 7.0 | 7.5 | 3.7 | 6.84 |
| Spaced Out | 8.8 | 8.8 | 8.8 | 8.2 | 8.8 | 9.2 | 8.8 | 7.2 | 8.55 |
| Deeply-Held Beliefs | 7.2 | 4.4 | 5.1 | 3.7 | 4.7 | 4.5 | 4.7 | 2.8 | 4.64 |
| Dinosaur Sheriff | 3.5 | 7.0 | 3.5 | 3.5 | 5.5 | 8.8 | 8.8 | 2.4 | 5.37 |
| Disgusting Ted | 3.5 | 7.2 | 5.5 | 2.9 | 3.7 | 4.3 | 6.4 | 1.9 | 4.42 |
| Ditty | 9.0 | 9.2 | 9.2 | 9.0 | 7.2 | 8.8 | 8.1 | 2.9 | 7.89 |
| Don’t be a Statistic | 6.7 | 9.1 | 7.5 | 6.7 | 7.0 | 7.0 | 8.4 | 6.7 | 7.38 |
| Dragon | 8.8 | 8.8 | 8.8 | 8.5 | 7.8 | 7.2 | 6.9 | 2.9 | 7.44 |
| Executive Decision | 8.8 | 8.8 | 8.8 | 8.2 | 8.2 | 9.2 | 7.8 | 3.5 | 7.91 |
| Deep Impact | 9.0 | 8.8 | 6.8 | 7.0 | 9.2 | 8.8 | 8.5 | 4.3 | 7.79 |
| Friendly | 8.8 | 7.9 | 8.8 | 7.7 | 7.2 | 8.2 | 7.2 | 2.6 | 7.28 |
| Game Boy | 7.8 | 8.8 | 8.8 | 8.8 | 8.8 | 7.2 | 8.3 | 3.5 | 7.73 |
| Gingerbread Man | 6.5 | 5.5 | 4.4 | 4.5 | 3.5 | 4.2 | 4.9 | 2.5 | 4.49 |
| Gnome Bubbles | 7.1 | 6.1 | 6.8 | 6.8 | 5.9 | 4.3 | 5.3 | 3.5 | 5.74 |
| The Good Knight | 8.8 | 8.8 | 8.8 | 9.2 | 8.8 | 9.2 | 8.8 | 4.4 | 8.31 |
| Goodbye Stanley | 2.4 | 2.8 | 2.9 | 2.4 | 2.4 | 4.5 | 4.6 | 2.4 | 3.05 |
| Gordrag’s Bane | 9.2 | 8.1 | 7.5 | 8.8 | 8.8 | 8.8 | 8.8 | 3.5 | 7.91 |
| Gotcha the Clown | 8.8 | 8.8 | 8.8 | 5.5 | 8.8 | 7.7 | 7.0 | 2.4 | 7.19 |
| Grammar Wizard | 8.8 | 7.5 | 8.2 | 7.5 | 8.5 | 8.8 | 5.0 | 2.4 | 7.08 |
| Grandpa’s Couch | 8.8 | 7.8 | 7.5 | 7.8 | 8.5 | 8.5 | 7.5 | 2.6 | 7.39 |
| Grandpa’s Silly Mustache | 3.2 | 3.5 | 3.5 | 3.5 | 3.7 | 6.4 | 8.8 | 2.4 | 4.37 |
| Growing Together | 7.6 | 6.5 | 5.5 | 7.3 | 6.3 | 8.8 | 8.5 | 2.8 | 6.66 |
| Happy Place | 7.8 | 7.5 | 7.8 | 7.9 | 7.9 | 6.5 | 6.3 | 3.5 | 6.91 |
| Harlot’s Web | 8.8 | 7.2 | 8.8 | 7.8 | 7.8 | 6.2 | 4.7 | 3.5 | 6.84 |
| High Noon | 9.0 | 8.8 | 8.8 | 8.8 | 8.8 | 5.9 | 8.8 | 4.8 | 7.94 |
| Hobbitos™ | 7.8 | 8.7 | 8.5 | 7.8 | 8.8 | 8.8 | 8.8 | 3.5 | 7.81 |
| Introvertebrate | 3.5 | 3.5 | 4.8 | 3.1 | 3.4 | 7.1 | 7.1 | 2.6 | 4.39 |
| Hug Bot | 8.8 | 8.8 | 8.8 | 8.8 | 9.2 | 8.4 | 8.3 | 2.9 | 7.99 |
| Life Sentence | 8.8 | 9.2 | 8.8 | 8.8 | 9.0 | 5.9 | 7.8 | 6.6 | 8.09 |
| Lucky Day | 5.7 | 6.4 | 7.2 | 6.3 | 7.5 | 5.4 | 4.9 | 3.5 | 5.85 |
| Marthas Orphanage | 9.0 | 8.8 | 8.5 | 8.8 | 9.0 | 9.2 | 8.8 | 6.1 | 8.51 |
| Master Yoshi | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 7.2 | 8.8 | 6.2 | 8.24 |
| Me Ow | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.1 | 9.2 | 3.3 | 8.04 |
| Memorabilia | 7.0 | 3.7 | 7.8 | 7.2 | 6.3 | 7.8 | 8.5 | 2.4 | 6.34 |
| Missing School | 7.0 | 7.8 | 8.8 | 8.8 | 8.8 | 8.5 | 4.9 | 3.5 | 7.24 |
| Mittens | 7.0 | 8.8 | 8.8 | 8.8 | 6.2 | 6.8 | 7.2 | 6.2 | 7.46 |
| Monkey Photographer | 4.2 | 4.3 | 6.0 | 4.3 | 4.4 | 7.0 | 7.8 | 2.3 | 5.05 |
| Mr. Scoop | 3.5 | 4.3 | 2.5 | 4.3 | 3.5 | 8.9 | 8.5 | 4.3 | 4.97 |
| Negative Space | 7.1 | 7.8 | 7.2 | 5.1 | 6.9 | 6.2 | 3.5 | 3.7 | 5.93 |
| Nice Shirt | 7.7 | 7.8 | 7.0 | 7.1 | 7.5 | 8.8 | 7.8 | 2.6 | 7.04 |
| Night Shift | 8.8 | 8.8 | 8.5 | 6.8 | 8.1 | 8.8 | 8.8 | 2.9 | 7.69 |
| Not a Wolf | 8.5 | 7.6 | 7.8 | 6.9 | 7.8 | 6.8 | 7.0 | 2.4 | 6.86 |
| Now Showing | 8.1 | 8.8 | 7.8 | 7.8 | 8.8 | 7.7 | 8.4 | 7.2 | 8.07 |
| Obscenery | 7.8 | 7.2 | 5.5 | 6.8 | 5.5 | 4.6 | 5.5 | 2.9 | 5.71 |
| Party Time Flies | 5.2 | 7.2 | 8.5 | 6.5 | 5.2 | 6.0 | 4.8 | 3.5 | 5.86 |
| Please | 8.8 | 8.8 | 8.8 | 8.8 | 8.1 | 7.2 | 5.5 | 5.7 | 7.67 |
| Pop | 8.8 | 8.8 | 8.8 | 8.8 | 8.5 | 8.1 | 8.8 | 4.8 | 8.16 |
| Prehistoric Park | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 9.2 | 3.7 | 8.17 |
| Preserves | 8.8 | 8.5 | 8.8 | 8.8 | 8.8 | 9.0 | 7.8 | 3.4 | 7.98 |
| Holiday Flavor | 3.5 | 6.8 | 4.2 | 3.7 | 3.9 | 4.2 | 4.1 | 2.6 | 4.11 |
| Punch Bout | 6.3 | 6.5 | 7.3 | 5.9 | 8.2 | 8.5 | 8.2 | 4.2 | 6.88 |
| Puzzled | 7.2 | 6.3 | 7.2 | 7.0 | 7.1 | 4.5 | 3.7 | 6.2 | 6.14 |
| Quiz Kid | 7.8 | 8.8 | 8.8 | 5.9 | 7.8 | 6.8 | 5.3 | 3.5 | 6.84 |
| Returned Mail | 8.8 | 7.8 | 8.1 | 8.8 | 7.0 | 6.5 | 6.2 | 2.7 | 6.97 |
| Robin Hood | 8.1 | 7.8 | 8.8 | 8.8 | 8.8 | 7.0 | 7.2 | 2.4 | 7.35 |
| Rubbed | 6.4 | 7.7 | 7.7 | 8.8 | 8.8 | 4.8 | 4.3 | 3.2 | 6.44 |
| Geopardy | 7.2 | 8.2 | 8.5 | 8.8 | 8.2 | 8.8 | 8.5 | 2.4 | 7.56 |
| Scorchy | 6.8 | 7.0 | 5.9 | 6.5 | 6.2 | 7.7 | 7.2 | 3.7 | 6.37 |
| Secret Mutant Hero Team | 8.8 | 9.0 | 8.8 | 8.8 | 8.1 | 8.8 | 8.8 | 2.7 | 7.95 |
| Seltzer | 8.8 | 8.8 | 8.5 | 8.8 | 8.5 | 8.7 | 8.5 | 3.9 | 8.04 |
| Sex Show | 5.3 | 4.3 | 4.4 | 5.2 | 4.1 | 5.9 | 6.5 | 2.1 | 4.72 |
| Sir Leopold | 9.2 | 8.8 | 8.8 | 7.8 | 8.8 | 7.7 | 5.7 | 2.3 | 7.37 |
| Sisyphus Myth | 7.3 | 7.2 | 7.3 | 7.4 | 7.3 | 8.8 | 8.8 | 7.2 | 7.66 |
| Skub | 8.1 | 8.8 | 8.8 | 8.8 | 9.2 | 9.2 | 8.8 | 8.1 | 8.72 |
| Slamasaurus | 5.3 | 5.4 | 6.1 | 5.1 | 4.9 | 5.9 | 6.2 | 3.7 | 5.32 |
| Sloshed | 7.8 | 7.2 | 7.2 | 7.8 | 7.5 | 7.2 | 7.5 | 2.9 | 6.88 |
| Snow Globe | 8.3 | 8.8 | 4.7 | 7.2 | 4.7 | 7.2 | 6.5 | 4.3 | 6.45 |
| Solved | 5.5 | 4.5 | 4.4 | 4.3 | 6.5 | 6.8 | 5.1 | 4.3 | 5.17 |
| Spared | 8.8 | 8.8 | 9.2 | 8.8 | 9.0 | 8.8 | 9.2 | 5.1 | 8.42 |
| Splash Down | 6.2 | 8.8 | 8.8 | 8.8 | 6.5 | 3.7 | 4.3 | 2.9 | 6.22 |
| Standards | 7.3 | 7.3 | 7.3 | 7.2 | 7.3 | 8.8 | 9.2 | 6.4 | 7.59 |
| Styled | 8.2 | 7.1 | 7.2 | 7.2 | 7.3 | 8.8 | 8.8 | 4.3 | 7.34 |
| Substitute | 6.3 | 8.8 | 8.8 | 7.2 | 8.5 | 8.1 | 7.8 | 3.7 | 7.39 |
| Super League | 8.2 | 8.3 | 7.3 | 8.3 | 8.8 | 8.2 | 8.8 | 3.5 | 7.66 |
| The Ants Dance | 5.1 | 5.7 | 3.7 | 6.6 | 3.9 | 6.3 | 5.3 | 2.9 | 4.92 |
| The Golden Ticket | 8.8 | 8.8 | 8.8 | 8.8 | 8.5 | 9.2 | 8.8 | 2.4 | 7.99 |
| The Hare and the Tortoise | 8.5 | 8.8 | 7.5 | 8.8 | 8.5 | 8.8 | 8.2 | 3.5 | 7.81 |
| The Order | 6.3 | 7.3 | 7.3 | 7.3 | 7.3 | 8.8 | 8.8 | 5.9 | 7.37 |
| The Treat | 7.8 | 7.2 | 8.8 | 8.8 | 4.7 | 7.2 | 7.2 | 3.3 | 6.86 |
| The Extraction | 8.8 | 8.8 | 8.5 | 8.8 | 8.8 | 7.5 | 7.4 | 3.7 | 7.77 |
| The Flight | 8.5 | 8.8 | 8.5 | 8.8 | 8.8 | 9.2 | 8.8 | 4.2 | 8.18 |
| The Forbidden Cave | 8.3 | 7.7 | 8.0 | 6.8 | 7.4 | 8.4 | 8.8 | 3.2 | 7.31 |
| Invasion | 4.8 | 4.9 | 4.8 | 4.3 | 6.1 | 4.3 | 4.4 | 3.7 | 4.67 |
| The Report | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 7.8 | 3.5 | 7.99 |
| The Shrink Ray | 4.2 | 4.3 | 3.9 | 3.9 | 4.3 | 5.2 | 6.2 | 2.3 | 4.28 |
| The Talk | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 7.2 | 8.55 |
| There’s Something About Him | 8.8 | 8.8 | 7.2 | 8.8 | 8.8 | 7.5 | 6.8 | 2.8 | 7.42 |
| Tickle Monster | 7.7 | 8.8 | 7.3 | 6.9 | 6.8 | 4.3 | 4.3 | 3.5 | 6.19 |
| Today I am Going to Fly | 4.5 | 6.3 | 8.5 | 8.5 | 6.2 | 8.2 | 8.1 | 6.5 | 7.09 |
| Today’s My Birthday | 6.3 | 7.0 | 6.3 | 6.3 | 6.4 | 6.3 | 5.4 | 3.5 | 5.96 |
| Trauma Trooper | 7.2 | 8.8 | 8.8 | 7.8 | 9.2 | 8.1 | 8.4 | 3.9 | 7.76 |
| Treatment | 3.5 | 3.5 | 5.4 | 4.3 | 4.2 | 5.8 | 5.9 | 2.2 | 4.34 |
| Turn That Frown | 9.0 | 8.8 | 8.8 | 9.0 | 8.8 | 7.7 | 8.8 | 4.1 | 8.12 |
| The Lost Mitten: Part 1 | 8.3 | 6.3 | 6.0 | 6.4 | 7.3 | 8.5 | 8.5 | 3.7 | 6.88 |
| Uncle Duncan | 9.0 | 8.8 | 8.8 | 8.1 | 8.8 | 8.8 | 7.9 | 3.4 | 7.92 |
| Us | 6.5 | 6.8 | 4.1 | 6.8 | 8.8 | 7.2 | 7.2 | 4.4 | 6.47 |
| Way Too Much (Apologies to Bil Keane) | 8.8 | 9.4 | 8.8 | 7.2 | 8.8 | 8.8 | 7.9 | 3.5 | 7.87 |
| Wise Shitashi | 5.5 | 4.5 | 5.4 | 7.0 | 4.3 | 8.8 | 7.6 | 4.6 | 5.96 |
| Worm Squish | 8.8 | 8.8 | 8.1 | 8.5 | 7.8 | 5.2 | 6.2 | 3.5 | 7.09 |
| You’ll Be OK | 5.5 | 5.7 | 5.7 | 6.5 | 5.7 | 7.2 | 6.1 | 4.2 | 5.80 |
| Stiff Breeze | 6.9 | 6.4 | 4.4 | 7.4 | 6.5 | 7.3 | 4.2 | 2.6 | 5.71 |
| Dad and Monster | 4.7 | 6.1 | 6.4 | 6.7 | 6.4 | 7.9 | 5.5 | 7.0 | 6.33 |
| Billiards in Heaven | 8.3 | 8.5 | 8.8 | 9.0 | 8.5 | 8.8 | 7.8 | 4.4 | 8.02 |
| Instant Bacon | 3.5 | 2.4 | 5.2 | 2.7 | 3.7 | 8.8 | 8.8 | 2.5 | 4.69 |
| Doomsday News | 8.5 | 8.8 | 8.5 | 8.8 | 9.2 | 8.2 | 7.2 | 4.4 | 7.92 |
| Space Helmet | 3.5 | 5.1 | 4.2 | 3.5 | 5.2 | 4.7 | 3.7 | 2.4 | 4.02 |
| Puppy Wish | 8.2 | 8.2 | 7.2 | 7.9 | 8.3 | 8.5 | 8.5 | 3.5 | 7.53 |
| Rainbow | 8.8 | 8.8 | 8.8 | 7.8 | 8.1 | 9.2 | 8.8 | 2.4 | 7.82 |
| Butterflies | 3.7 | 5.5 | 5.5 | 6.4 | 6.5 | 5.9 | 3.7 | 3.5 | 5.09 |
| Dinner Time Machine | 5.6 | 5.5 | 5.5 | 5.7 | 5.7 | 8.1 | 8.8 | 3.5 | 6.04 |
| Gopher Girlfriend | 2.8 | 4.3 | 3.1 | 3.5 | 3.1 | 5.2 | 7.0 | 3.5 | 4.06 |
| Bear Boy | 6.9 | 5.5 | 6.5 | 6.5 | 5.9 | 8.8 | 8.1 | 3.2 | 6.42 |
| Pyro Billy | 4.3 | 4.5 | 3.5 | 5.5 | 3.8 | 7.6 | 7.8 | 5.5 | 5.32 |
| Nude Beach | 7.6 | 7.2 | 6.2 | 6.9 | 7.0 | 8.8 | 8.8 | 3.5 | 6.99 |
| Sun Love | 8.8 | 8.5 | 8.5 | 7.5 | 8.8 | 8.8 | 8.8 | 3.5 | 7.88 |
| Falling Dream | 6.4 | 8.8 | 8.5 | 9.2 | 7.0 | 6.8 | 3.9 | 2.1 | 6.58 |
| Suicide Train | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 3.7 | 8.15 |
| Kinder Interview | 5.5 | 5.2 | 4.3 | 4.4 | 4.2 | 4.4 | 4.3 | 2.4 | 4.32 |
| Small Man | 6.1 | 5.7 | 7.0 | 6.1 | 5.2 | 4.4 | 3.7 | 2.9 | 5.14 |
| Penguin Enemy | 8.2 | 8.8 | 8.2 | 7.9 | 9.2 | 8.8 | 7.8 | 3.5 | 7.78 |
| Turtle City | 5.5 | 5.5 | 6.5 | 7.0 | 6.4 | 5.5 | 6.3 | 6.2 | 6.12 |
| Better Luck | 8.8 | 8.8 | 9.2 | 9.2 | 7.2 | 7.6 | 8.8 | 4.3 | 7.96 |
| Not Today | 7.1 | 8.5 | 8.5 | 8.5 | 7.6 | 7.2 | 4.5 | 3.5 | 6.92 |
| Weeaboo | 8.8 | 8.0 | 7.8 | 7.8 | 8.8 | 6.1 | 6.0 | 5.2 | 7.31 |
| Barb and Rudy | 7.1 | 6.9 | 7.0 | 5.2 | 7.0 | 8.5 | 8.8 | 4.3 | 6.86 |
| Bunny Pit | 8.8 | 8.3 | 8.8 | 8.3 | 8.8 | 8.8 | 8.8 | 4.8 | 8.16 |
| Christmas Surgery | 4.2 | 3.4 | 4.1 | 3.9 | 3.5 | 4.9 | 4.8 | 3.5 | 4.03 |
| QPI Interview | 6.5 | 5.9 | 7.0 | 6.5 | 6.5 | 7.3 | 8.5 | 3.5 | 6.47 |
| Snail Harassment | 8.8 | 8.8 | 5.2 | 8.8 | 8.8 | 8.2 | 8.5 | 8.8 | 8.21 |
| No Survivors | 7.8 | 7.3 | 8.2 | 7.9 | 7.7 | 8.2 | 8.5 | 6.2 | 7.71 |
| Mrs. Hammer | 3.7 | 6.3 | 4.1 | 6.5 | 3.7 | 6.5 | 6.5 | 2.4 | 4.97 |
| Freaking Vortex | 5.5 | 6.1 | 5.1 | 6.1 | 6.1 | 6.8 | 6.8 | 3.5 | 5.75 |
| Sgt. Grumbles | 8.1 | 7.0 | 8.8 | 8.1 | 7.2 | 5.7 | 5.4 | 4.2 | 6.81 |
| Genius Sir | 7.9 | 9.0 | 7.8 | 8.1 | 8.8 | 3.7 | 3.9 | 4.4 | 6.69 |
| Reset | 7.8 | 8.8 | 8.1 | 9.0 | 8.8 | 6.2 | 8.8 | 3.5 | 7.61 |
| Mr. Rex | 7.1 | 7.0 | 8.2 | 7.8 | 8.5 | 7.2 | 7.7 | 2.9 | 7.04 |
| Shotgun | 8.8 | 8.8 | 7.0 | 6.3 | 8.8 | 7.1 | 7.0 | 3.1 | 7.11 |
| Mime City | 3.7 | 3.5 | 3.5 | 3.7 | 4.3 | 5.4 | 4.3 | 3.5 | 3.99 |
| Colonel Sweeto | 7.2 | 6.2 | 6.5 | 6.2 | 6.5 | 6.2 | 4.7 | 3.5 | 5.86 |
| Lord Gloom | 4.6 | 3.5 | 3.1 | 3.1 | 3.1 | 5.5 | 7.1 | 3.7 | 4.21 |
| Love Lizard | 7.7 | 7.9 | 3.3 | 8.8 | 3.7 | 7.0 | 6.2 | 3.5 | 6.01 |
| Satans Hell | 7.5 | 6.5 | 8.8 | 8.8 | 6.3 | 6.2 | 9.2 | 2.4 | 6.94 |
| Kids Are Thursty | 8.5 | 7.3 | 8.8 | 6.8 | 8.8 | 8.2 | 7.9 | 6.5 | 7.84 |
| A Hit for Bobby | 6.1 | 6.9 | 6.3 | 5.5 | 5.7 | 3.9 | 3.8 | 2.4 | 5.07 |
| b | 8.2 | 7.3 | 7.8 | 8.8 | 3.9 | 4.3 | 5.3 | 2.4 | 6.00 |
| Scorpy the Forest Friend | 4.1 | 4.8 | 5.8 | 6.5 | 6.4 | 3.7 | 3.9 | 3.5 | 4.84 |
| Zuthulus Resurrection | 8.8 | 8.8 | 8.8 | 9.4 | 8.8 | 8.8 | 9.0 | 6.2 | 8.55 |
| Disassemble | 6.0 | 7.2 | 7.1 | 7.2 | 7.2 | 5.1 | 5.0 | 3.5 | 6.03 |
| Slim | 7.1 | 3.5 | 7.0 | 7.0 | 3.7 | 3.9 | 4.1 | 2.8 | 4.89 |
| The Dreamcatcher 3000 | 7.0 | 7.9 | 7.2 | 8.8 | 7.8 | 8.3 | 8.8 | 4.3 | 7.49 |
| Cave Explorer | 5.7 | 3.7 | 5.5 | 5.2 | 4.4 | 5.2 | 6.3 | 2.9 | 4.86 |
| Prank Dragon | 3.7 | 3.9 | 3.9 | 2.9 | 3.7 | 3.9 | 3.1 | 2.4 | 3.44 |
| Boss | 6.2 | 5.5 | 6.8 | 7.2 | 6.2 | 3.9 | 7.1 | 3.5 | 5.79 |
| Truancy bot | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 6.9 | 7.1 | 6.2 | 8.00 |
| Food Fight | 7.3 | 7.3 | 7.4 | 7.3 | 7.3 | 8.8 | 8.8 | 6.2 | 7.54 |
| Durab Inc. | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 8.2 | 5.2 | 8.24 |
| Tunnel of Love | 4.4 | 3.5 | 2.8 | 3.3 | 4.3 | 5.7 | 4.3 | 3.1 | 3.92 |
| Guntron | 4.2 | 3.5 | 3.7 | 5.1 | 3.5 | 3.5 | 3.5 | 3.5 | 3.81 |
| Boy Scouts | 7.2 | 6.9 | 6.1 | 5.7 | 6.9 | 4.5 | 4.5 | 2.8 | 5.57 |
| The Pacific Council | 7.2 | 7.2 | 7.7 | 8.8 | 7.2 | 8.8 | 8.1 | 4.4 | 7.39 |
| Cover Blown | 2.8 | 2.6 | 2.6 | 2.6 | 2.8 | 3.7 | 3.9 | 2.5 | 2.94 |
| Les Douleurs de la Morte | 7.5 | 6.9 | 2.9 | 4.2 | 6.0 | 4.5 | 5.5 | 3.7 | 5.14 |
| Toad Race | 4.4 | 3.5 | 4.1 | 4.2 | 5.7 | 3.3 | 4.5 | 3.7 | 4.17 |
| Post Apocalyptic | 8.8 | 8.8 | 8.8 | 8.8 | 8.1 | 8.8 | 8.8 | 7.7 | 8.56 |
| Eggnancy | 8.8 | 8.1 | 8.8 | 8.2 | 8.1 | 7.2 | 8.8 | 3.1 | 7.62 |
| Wishing Well | 6.6 | 7.2 | 6.8 | 6.5 | 6.9 | 4.3 | 3.9 | 3.5 | 5.70 |
| Atlantis | 8.8 | 8.8 | 9.1 | 9.2 | 8.8 | 8.8 | 9.0 | 3.5 | 8.22 |
| Kitty Photographer | 8.5 | 8.8 | 8.5 | 8.8 | 8.5 | 6.2 | 4.7 | 2.6 | 7.08 |
| Thwack Ye Mole | 8.8 | 8.8 | 8.8 | 8.8 | 8.2 | 6.5 | 6.4 | 2.5 | 7.33 |
| Magic Eyes | 7.0 | 6.4 | 3.7 | 5.5 | 4.5 | 7.8 | 7.8 | 2.5 | 5.67 |
| The Great Circle | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 9.2 | 8.8 | 7.0 | 8.61 |
| Transfer Patient | 7.5 | 7.8 | 8.8 | 7.8 | 8.5 | 8.8 | 7.1 | 3.7 | 7.51 |
| Passed On | 7.3 | 8.5 | 7.5 | 6.8 | 7.3 | 7.2 | 8.8 | 2.6 | 7.01 |
| Gamblin Man | 7.7 | 8.8 | 8.8 | 7.8 | 8.8 | 8.8 | 8.8 | 3.4 | 7.83 |
| Commander Crisp | 8.8 | 8.1 | 7.8 | 8.8 | 8.8 | 8.8 | 8.1 | 7.7 | 8.33 |
| The Masculator | 8.8 | 8.8 | 8.8 | 8.8 | 8.8 | 7.2 | 7.9 | 3.3 | 7.78 |
| Miggs | 5.9 | 3.5 | 4.4 | 6.3 | 3.7 | 4.9 | 4.9 | 2.4 | 4.50 |
| Baby | 7.5 | 7.3 | 7.7 | 7.8 | 7.0 | 8.8 | 7.6 | 2.4 | 7.01 |
| Psychoanalyst | 7.5 | 5.5 | 6.8 | 7.3 | 3.7 | 8.5 | 8.8 | 3.5 | 6.46 |
| Finneas | 8.8 | 8.5 | 8.8 | 8.8 | 8.8 | 8.8 | 5.2 | 2.4 | 7.49 |
| Lyle’s Constant | 7.9 | 7.3 | 8.2 | 7.3 | 7.3 | 8.2 | 5.9 | 2.4 | 6.81 |
| Capital Punishment | 5.5 | 7.9 | 7.0 | 5.1 | 5.5 | 5.7 | 3.5 | 2.6 | 5.34 |
| Trunkle | 3.5 | 2.6 | 2.1 | 2.5 | 2.5 | 4.3 | 3.5 | 2.1 | 2.89 |
| Bee | 6.2 | 7.2 | 7.9 | 6.3 | 6.8 | 4.1 | 6.2 | 3.5 | 6.03 |
| Transmission | 6.3 | 3.4 | 5.5 | 3.1 | 4.4 | 6.7 | 7.2 | 3.7 | 5.03 |
| Evolving to Fly | 5.7 | 5.7 | 5.7 | 3.9 | 5.7 | 5.8 | 5.7 | 3.1 | 5.14 |
| The Last Unicorns | 7.3 | 7.3 | 7.5 | 7.6 | 7.3 | 8.8 | 8.8 | 7.2 | 7.71 |
| Roxanne | 7.2 | 6.2 | 7.0 | 6.2 | 7.1 | 5.9 | 8.2 | 3.4 | 6.39 |
| Different | 5.2 | 3.5 | 5.2 | 3.7 | 5.5 | 6.1 | 4.7 | 2.4 | 4.53 |
| For Baskins | 7.2 | 5.2 | 7.8 | 8.5 | 7.8 | 7.0 | 4.3 | 3.1 | 6.36 |
| One Time Thing | 7.0 | 8.3 | 6.1 | 7.3 | 5.7 | 8.5 | 7.8 | 3.5 | 6.78 |
| Honk | 7.2 | 7.5 | 8.5 | 7.2 | 8.8 | 5.8 | 5.4 | 2.4 | 6.59 |
| Beach Closing | 8.8 | 8.6 | 9.1 | 8.7 | 8.7 | 7.9 | 8.7 | 4.2 | 8.07 |
| The Drift | 8.8 | 7.8 | 8.8 | 8.5 | 8.8 | 4.5 | 3.9 | 3.5 | 6.81 |
| Shop | 7.6 | 5.5 | 4.8 | 7.5 | 7.0 | 6.2 | 6.3 | 4.3 | 6.15 |
| Dreamcatcher | 7.2 | 8.8 | 8.8 | 8.8 | 8.8 | 7.7 | 7.0 | 3.7 | 7.58 |
| Harmony | 5.2 | 5.7 | 4.5 | 5.2 | 6.5 | 3.7 | 3.5 | 2.8 | 4.62 |
| Matched | 5.5 | 6.5 | 6.5 | 6.5 | 6.5 | 7.2 | 7.2 | 3.4 | 6.15 |
| Caught | 7.0 | 8.8 | 7.5 | 8.8 | 8.8 | 7.5 | 8.8 | 2.5 | 7.45 |
| The Breakthrough | 8.8 | 8.8 | 8.8 | 8.5 | 8.8 | 3.3 | 6.2 | 2.9 | 6.99 |
| Cats | 8.8 | 8.8 | 9.0 | 8.8 | 6.8 | 8.8 | 9.2 | 2.7 | 7.84 |
| The Jubilee | 7.8 | 8.5 | 8.8 | 8.5 | 8.2 | 7.2 | 7.2 | 3.4 | 7.42 |
| Spelling | 8.5 | 8.8 | 8.5 | 8.5 | 8.8 | 8.8 | 9.2 | 2.6 | 7.96 |
| Bully | 8.8 | 8.8 | 8.8 | 8.5 | 8.5 | 5.4 | 5.4 | 1.9 | 7.00 |
| Adam 2.0 | 8.8 | 7.8 | 8.8 | 8.5 | 8.8 | 7.9 | 8.1 | 2.6 | 7.66 |
| Lamb of God | 6.1 | 5.6 | 5.9 | 4.2 | 5.8 | 4.9 | 5.5 | 3.3 | 5.16 |
| Splitting Up | 8.8 | 7.7 | 8.8 | 8.8 | 6.5 | 5.5 | 6.9 | 3.3 | 7.02 |
| Metamorph-Assist | 6.2 | 7.2 | 7.0 | 6.2 | 6.8 | 8.8 | 7.8 | 3.5 | 6.67 |
| Technorgy | 7.8 | 7.7 | 7.2 | 7.8 | 8.7 | 7.2 | 6.8 | 3.7 | 7.11 |
| Smile | 8.2 | 8.8 | 8.2 | 8.8 | 8.8 | 9.4 | 8.8 | 6.2 | 8.38 |
| Shocked | 4.6 | 6.8 | 6.1 | 6.5 | 5.5 | 6.2 | 8.5 | 3.5 | 5.96 |
| News Puppy | 8.8 | 7.1 | 9.0 | 7.9 | 8.8 | 7.2 | 9.2 | 3.3 | 7.64 |
| Amends | 9.2 | 8.5 | 8.5 | 8.5 | 7.7 | 8.1 | 9.0 | 2.4 | 7.72 |
| Electro Sutra | 3.3 | 3.5 | 3.5 | 3.5 | 3.5 | 4.4 | 3.7 | 2.4 | 3.48 |
| Dick | 7.2 | 7.0 | 7.5 | 7.8 | 7.2 | 9.0 | 8.8 | 2.4 | 7.09 |
| Gentleworms | 5.2 | 5.2 | 6.1 | 7.0 | 6.3 | 6.6 | 5.7 | 5.7 | 5.98 |
| Putting Out | 8.1 | 7.7 | 8.8 | 8.1 | 7.8 | 7.2 | 7.2 | 3.5 | 7.28 |
| Casting Call | 8.8 | 8.5 | 9.2 | 9.2 | 8.8 | 7.3 | 7.0 | 2.7 | 7.67 |
| Horny Cloud | 2.8 | 2.9 | 3.7 | 2.9 | 2.4 | 7.2 | 6.3 | 2.8 | 3.87 |
| The Mission | 8.8 | 7.8 | 8.5 | 8.8 | 7.8 | 8.8 | 9.2 | 5.7 | 8.14 |
| Carolyn | 8.8 | 8.5 | 7.2 | 7.7 | 6.8 | 8.8 | 8.8 | 2.4 | 7.35 |
Example: "Trunkle" - A wordless comic requiring pure visual understanding
The PBF Comics Benchmark evaluates AI models on 285 comics from Nicholas Gurewitch's Perry Bible Fellowship. These comics are ideal for testing visual understanding because:
- Highly visual: Unlike text-heavy comics (XKCD, SMBC), many PBF comics contain no words at all
- Diverse styles: Mix of black-and-white, watercolor, cartoon, and realistic art
- Complex themes: From slapstick humor to pop culture subversions
- Not memorized: Individual comics lack enough online discussion for models to memorize explanations
📊 Methodology
Ground Truth Creation
Each comic received a human-curated explanation by:
- Generating candidate explanations from GPT-4o, Claude 3.5 Sonnet, and Gemini 2.0 Flash
- Human labeler selecting the best candidate or writing a custom explanation
- Most labels received moderate to significant human modifications
Scoring Methodology
Models explain each comic with: "Explain this comic. Describe what's happening and explain the humor or message."
Claude 4 Opus judges each explanation on:
- Accuracy (40%): Correctly identifies what's happening
- Completeness (25%): Covers all important visual elements
- Insight (25%): Understands the humor or message
- Clarity (10%): Well-written and easy to understand