# lm-evaluation-harness-pt

> Open-source fork of EleutherAI's LM Evaluation Harness for evaluating Portuguese LLMs and chatbots. It is the evaluation suite for the Open Portuguese LLM Leaderboard and runs few-shot Portuguese tasks through a local lm_eval CLI, including direct-response scoring, chat-template

- Slug: lm-evaluation-harness-pt
- Record: cmp_lm-evaluation-harness-pt
- Kind: harness
- Functions: evaluate, extract, memory, rank, generate, reason, test
- Score: 3
- Observed sample: This component is not in Leyline's observed sample.

JSON: https://staging.leyline.ahensya.com/api/v1/components/lm-evaluation-harness-pt