The Examinations page includes 2 components:

  1. Examinations Table. This searchable table includes a list of all of the examinations that have been submitted by the user. Each row contains the name of the examined model, the service and test performed in the examination, the date on which the examination was submitted, and the status of the examination (Queued, Running, Completed). The actions related to the examination include: viewing the examination report, modifying the visibility of the examination (private/public), and deleting the examination.
  2. Examination Creation. Users can create a new examination by clicking the blue rocket button.

examinations.png

Users can create a new examination by clicking on the blue rocket button and following these 4 simple steps:

  1. Select Model Source. We support models published on Hugging Face, or models published through any OpenAI-Compatible API.

    model-source.png

  2. Provide Model Information

    1. For Hugging Face models, the Hugging Face ****path of the model is required. Since many models are published in repositories with restricted access, a read-only Hugging Face token with access to the model repositories is also required. Hugging Face provides a tutorial for generating access tokens.

      hf-info.png

    2. For OpenAI-Compatible API models, the name of the model, API endpoint, and API tokens are required.

      api-info.png

  3. Set Visibility. Users can opt to make the results of the examination either public or private. For public examinations, the reports and results are included in public leaderboards and can be viewed by other users. The reports and results of private examinations do not appear anywhere outside of the user’s account.

    visibility.png

  4. Select Tests. Users can make a selection from a dropdown of all tests, categorized under the different services. An examination will be created for each selected test.

    select-tests.png