Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
This README file provides the description of the code and data used in my final year project. The content is sectioned into folders with corresponding names. Descriptions of the folders and their ...