Artificial Analysis - Independent AI Benchmarking
When picking a model for a particular use case we need to have some kind of data points like what’s the speed, cost, accuracy & how it does better than X model and things like that.
As you might have already known official benchmarks are kind of sketchy there days with manuplulating graph and things.
That’s where indepedent AI benchmarking like ArtificialAnalysis.ai comes in.
The have some many data points across various things. For example, here is the benchmark on coding models
Happy benchmarking AI!