---
title: "Inference service model performance indicators"
sidebar_label: "Model performance indicators"
sidebar_position: 3
description: "Description of the inference service model performance indicators"
---

import { CustomTable } from '@selectel/docux/components';
import Formbricks from '@theme/MDXComponents/Formbricks';

# Inference service model performance indicators

You can compare model performance indicators across different configurations and choose the one you need. Performance indicators are displayed in the card of each [configuration](/foundation-models-catalog/create/configurations.mdx) when [creating an inference service](/foundation-models-catalog/create/create-inference-service.mdx).

<CustomTable>
  <table>
    <tbody>
      <tr>
        <th>Avg Time to First Token</th>

        <td>
          Average time from receiving a request to generating the first token in milliseconds
        </td>
      </tr>

      <tr>
        <th>Avg Request Throughput</th>

        <td>
          Average number of processed requests per second
        </td>
      </tr>

      <tr>
        <th>Output Token Throughput</th>

        <td>
          Average number of generated tokens per second
        </td>
      </tr>

      <tr>
        <th>Request Latency</th>

        <td>
          Average time from receiving a request to full response completion in seconds
        </td>
      </tr>
    </tbody>
  </table>
</CustomTable>

<Formbricks />