​
Overview

ModelBench offers access to a variety of free models for testing and benchmarking. However, to use paid models and run extensive benchmarks, you’ll need to connect your OpenRouter account.

​
Free vs Paid Models

  • Free Models: Available to all users without any additional setup.
  • Paid Models: Require an OpenRouter account connection to access.

​
Connecting Your OpenRouter Account

To use paid models and run benchmarks with your own usage allowance, follow these steps:
  1. Click on the team menu dropdown in the top left corner of the ModelBench interface.
  2. Select “Settings” from the dropdown menu.
  3. Look for the “Connect to OpenRouter” button and click it.
  4. You’ll be redirected to complete the OAuth process with OpenRouter.
  5. Follow the prompts to authorize the connection between ModelBench and your OpenRouter account.

​
Benefits of Connecting

Once you’ve connected your OpenRouter account:
  • Access to paid models for testing and benchmarking.
  • Ability to run extensive benchmarks using your own usage allowance.
  • Seamless integration of your OpenRouter credits within ModelBench.

​
Usage and Billing

  • Your OpenRouter account will be billed directly for any usage of paid models through ModelBench.
  • You can monitor your usage and remaining credits through your OpenRouter dashboard.

​
Disconnecting Your Account

If you need to disconnect your OpenRouter account:
  1. Go to the Settings page in ModelBench.
  2. Look for the OpenRouter connection section.
  3. Click on “Disconnect” or “Remove Connection”.
Remember, disconnecting will limit your access to paid models and extensive benchmarking capabilities. By connecting your OpenRouter account, you unlock the full potential of ModelBench, allowing you to test and benchmark a wide range of advanced language models.