GitXplorerGitXplorer
j

inspect-llm-workshop

public
49 stars
10 forks
0 issues

Commits

List of commits on branch main.
Unverified
86d00ca6d79b4754266ba36c10be6d5a108a1695

use name == main in notebook

jjjallaire committed 8 months ago
Verified
902f580d7145ccf5f564040c001b385f1438d5ec

Update README.md

jjjallaire committed 8 months ago
Unverified
b130cc8c78a33e97e94a9357761a2563a36a80ae

tweak slides

jjjallaire committed 8 months ago
Unverified
af78af935d69e10612651efbbf1ce0f6d3b79a6d

link to requirements

jjjallaire committed 8 months ago
Unverified
e0cac36eb8716eea0c24b9c143591bb318c5107e

truncate

jjjallaire committed 8 months ago
Unverified
ac9c2d94277b3585b798cda76a0a34d6d6db310f

raw link for slides

jjjallaire committed 8 months ago

README

The README file for this repository.

Inspect: An OSS framework for LLM evals

This repository includes the slides and code for the workshop on Inspect given at Mastering LLMs: A Conference for Developers and Data Scientists.

Slides

Intro to Inspect: Open Source Framework for LLM Evals

Code

Directory Description
honeycomb Evals for for Honeycomb Natural Langaguge Query generator
langchain Demonstrates evaluating a LangChain Agent using Inspect
benchmarks Implemetnations of some popular benchmarks using Inspect
slides Source code and PDF version of workshop slides

To ensure that you can run the example code in this repo, please install the dependencies using the requirements.txt file in the root directory.