Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

It all starts with data. Morningstar was founded on the idea that quality investment data should be available to everyone. Our licensed data gives clients independent, comprehensive, and timely data ...