Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Moving beyond the traditional paradigms of "Thinking with Text" (e.g., Chain-of-Thought) and "Thinking with Images", we propose "Thinking with Video"—a new paradigm that unifies visual and textual ...

bTranslational Obstetrics Group, Department of Obstetrics and Gynaecology, Mercy Hospital for Women, University of Melbourne, Melbourne, Australia cRegion Västra Götaland, Sahlgrenska University ...