Large Language Model

Once LLM API keys have been added to your account, the course can use the created keys.

LLMs Course settings

When enabled, you can set limits for the students in the course.

Reset LLM Keys

LLMs Course Reset

If students exceed any of the limits set above, they will appear in the Reset LLM Keys area where instructors can reset their keys to allow them to continue working.

If a student exceeds more than one limit at the same time, they will only appear once and resetting will apply to all exceeded limits.

Note

Students will need to restart their box after limits are reset (Project > Restart Box). If the top menu has been hidden for students, instructors will need to do this for them by opening the student assignment and selecting Project > Restart Box before letting the student know they can continue.

LLM Course Usage

LLMs Course Usage

Note

The names shown in this screenshot are examples only. The values shown are estimates and may not reflect exact numbers.

Usage is shown for:

  • Daily, weekly, monthly, annual, and total usage for the course.

  • Daily and monthly top 10 consumers for the course.

TA Access to LLM Statistics and Limits

Teaching Assistants (TAs) can view LLM usage statistics and reset LLM limits for individual students in the same way as teachers and instructors.

If no usage data has been recorded yet, the following message will be displayed:

There is currently no LLM usage data available for this course.