Top 5 models: Use GPT 4o, Gemini 1.5 Pro, or Claude 3.5 Sonnet, but not GPT 4 Turbo nor GPT 4. One step below is Llama 3, but you could save up to 90% compared to the Top 5. You could replace GPT 3.5 Turbo with DeepSeekV2 and save 75%.
+--------------+-----------------+--------------------+---------------------+------------------+ | Platform | Model | Input: $/1M Tokens | Output: $/1M Tokens | Avg: $/1M Tokens | +--------------+-----------------+--------------------+---------------------+------------------+ | Cohere | Command-R | 0.50 | 1.50 | 1.00 | | Cohere | Command-Light | 0.30 | 0.60 | 0.45 | | Athropic | Claude 3 Haiku | 0.25 | 1.25 | 0.25 | | Athropic | Claude Instant | 0.80 | 2.40 | 1.60 | +--------------+-----------------+--------------------+---------------------+------------------+
+---------------+--------------+--------------------+---------------------+------------------+ | Model | Platform | Input: $/1M Tokens | Output: $/1M Tokens | Avg: $/1M Tokens | +---------------+--------------+--------------------+---------------------+------------------+ | Mistral 7B | DeepInfra | 0.10 | 0.10 | 0.10 | | Mistral 7B | Anyscale | 0.15 | 0.15 | 0.15 | | Mistral 7B | OctoAI | 0.10 | 0.25 | 0.18 | | Mistral 7B | Fireworks.ai | 0.20 | 0.20 | 0.20 | | Mistral 7B | Together.ai | 0.20 | 0.20 | 0.20 | | Mistral 7B | Mistral | 0.25 | 0.25 | 0.25 | | Mixtral 8x7B | DeepInfra | 0.27 | 0.27 | 0.27 | | Mixtral 8x7B | OctoAI | 0.30 | 0.50 | 0.40 | | Mixtral 8x7B | Anyscale | 0.50 | 0.50 | 0.50 | | Mixtral 8x7B | Fireworks.ai | 0.50 | 0.50 | 0.50 | | Mixtral 8x7B | Together.ai | 0.60 | 0.60 | 0.60 | | Mixtral 8x7B | Mistral | 0.70 | 0.70 | 0.70 | | Mixtral 8x22B | DeepInfra | 0.65 | 0.65 | 0.65 | | Mixtral 8x22B | Together.ai | 1.20 | 1.20 | 1.20 | +---------------+--------------+--------------------+---------------------+------------------+
+--------------+----------------------------+----------------+-------------+ | Platform | Model | Context Window | $/1M Tokens | +--------------+----------------------------+----------------+-------------+ | Together.ai | m2-bert-80M-32k-retrieval | 32768 | 0.01 | | Together.ai | m2-bert-80M-8k-retrieval | 8192 | 0.01 | | Fireworks.ai | nomic-embed-text-v1.5 | 8192 | 0.01 | | OpenAI | text-embedding-3-small | 8192 | 0.02 | | Jinaai | jina-embeddings-v2-base-en | 8192 | 0.02 | | Mistral | mistral-medium | 8192 | 0.10 | | Nomic | nomic-embed-text-v1.5 | 8192 | 0.10 | | Voyage AI | voyage-2 | 4000 | 0.10 | | Voyage AI | voyage-large-2 | 16000 | 0.12 | | OpenAI | text-embedding-3-large | 8192 | 0.13 | +--------------+----------------------------+----------------+-------------+
+--------------+------------------+ | Platform | Free Credit $ | +--------------+------------------+ | Cohere | 75 | | Nomic | 50 | | Together.ai | 25 | | Anyscale | 10 | | OctoAI | 10 | | OpenAI | 10 | | VoyageAI | 5 | | Anthropic | 5 | | DeepInfra | 1.8 | | Fireworks.ai | Free for 2 weeks | +--------------+------------------+