ArtificialAnalysis benchmarks: Major LLMs are roughly equivalent in most aspects, but Claude rules in Julia knowledge

I just discovered that ArtificialAnalysis (major independent LLM benchmarking org) actually has a Julia-specific benchmark now, so I had to post it here: Some observations: This benchmark measures language knowledge, NOT coding skill. It’s basically a Q&A test, with hallucinations deducted from correct answers (so the score ranges from -100 to +100). Claude obliterates the field here, especially in comparison with GPT. Apparently Anthropic makes a dedicated effort to train on Julia code (t...