Inference API / Rank
Rank allowed answers
Score a caller-defined set of candidate answers against shared context without allowing the model to create a new option.POST
/api/v1/rankRequest
Provide between 2 and 100 unique, non-empty answers. The optional question narrows the ranking task; context may be any JSON value.
cURLbash
curl -sS https://api.neosyntropy.com/api/v1/rank \
-H "Authorization: Bearer $NEOSYNTROPY_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"context": {"ticket": "Customer cannot sign in"},
"question": "Which queue should own this ticket?",
"answers": ["account", "billing", "technical"],
"model": "clm-latest"
}'Response
- Read candidates in ranked order.
- Keep the answer identifiers in your application; do not execute arbitrary generated labels.
- Handle inference_warming and other service errors before retrying.