LLM_PROVIDER and never replaces your LLM for those features.
How it differs from the LLM path
The LLM path sends a batch of transactions in one request. Jev sends one request per transaction, run concurrently. At roughly 400–550 ms per transaction, throughput depends on concurrency rather than batch size.
Prerequisites
- A TypeSafe account with a Jev API key
- Preview features enabled for the families that will use Jev (the provider selector is hidden until preview is on)
Setup
1. Get a Jev API key
Sign in at typesafe.ai and create an API key. Jev requires an explicit key — it does not fall back to any other key you have configured (for example, an OpenRouter key).2. Configure the environment variables
Add these to your.env file:
3. Select Jev as the categorization provider
Each family chooses their own provider. OnceJEV_API_KEY is set and preview features are enabled:
- Go to Settings > Self-Hosting > Categorization provider.
- Select Jev (TypeSafe).
- Save.
Confidence threshold
Jev returns a confidence score between 0 and 1 for each answer. Sure uses this to decide whether to apply the category or leave the transaction uncategorized for a later retry. The default threshold is 0.7. Measured against a 200-sample golden set, this threshold:- Categorizes 91.5% of transactions
- Reduces the error rate on applied answers from 4.5% to 1.6%
Shadow mode
Shadow mode runs the unselected provider alongside the active one. It applies only the selected provider’s answers but records where the two providers disagreed. This lets you compare providers on real traffic without switching over. Shadow mode is off by default because it doubles categorization spend. Turn it on by setting a sampling rate:1.0 shadows every run. Results appear in Settings > Self-Hosting under the categorization panel.
Using a gateway
Jev’s API is compatible with OpenRouter’s Decisions API. To route through OpenRouter, set both variables:Environment variable reference
JEV_REQUEST_TIMEOUT and JEV_CONCURRENCY are environment-only controls. Jev credentials, endpoint, and model can be configured in Settings > Self-Hosting when preview features are enabled; those are instance settings. Categorization provider, confidence threshold, and shadow rate have family preferences. Their corresponding environment variables take precedence when set.