Llama 3.3 70B (mock)

meta/llama-3.3-70b

text in · text out · 131,072 context · 8,192 max output

toolsschemano-train
Effective cost per 1k requests

cost = p_in·(input − cached) + p_cache_read·cached + p_out·output + p_req; cached tokens are the prefix a sticky endpoint already holds (part2b §9.3), which is why the cheapest list price is not always the cheapest request.

ProviderRegion · quantContext / max outInput / MOutput / MCache read / writeMarkupPer 1k reqUptime 30 dTTFT p50 / p95FidelityDataCapabilitiesStatus
Mock (AWS Bedrock Converse)us · none131,072 / 8,192$0.720$0.720 / +10.0%$1.800 no-train model defaultactive

Quick start

curl https://api.ai.ml/v1/chat/completions \
  -H "Authorization: Bearer $AIML_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta/llama-3.3-70b","messages":[{"role":"user","content":"Say hello"}]}'
Get a key in the console

Changelog

  • No changes recorded.