pairwiseLLM implements request and response handling for
six backends. The package generally forwards model
identifiers to the selected provider; it does not maintain an exhaustive
model allowlist.
| Backend | Provider surface | Live | Batch | Credential |
|---|---|---|---|---|
openai |
OpenAI | yes | yes | OPENAI_API_KEY |
anthropic |
Anthropic | yes | yes | ANTHROPIC_API_KEY |
gemini |
Gemini Developer API | yes | yes | GEMINI_API_KEY |
vertex |
Vertex AI Gemini API | yes | no | VERTEX_API_KEY |
together |
Together AI | yes | no | TOGETHER_API_KEY |
ollama |
Local Ollama server | yes | no | none |
Backend implementation is not the same as compatibility with every model. Endpoint compatibility depends on the request shape a model accepts; maintainer testing covers only the exact configurations below; and current availability is controlled by the provider. Preview identifiers and reasoning controls can change independently of this package.
Check current availability in the official catalogs for OpenAI, Anthropic, Gemini Developer API, Vertex AI, and Together AI. Ollama tags depend on what is installed on the local server.
The machine-readable source is installed at
inst/extdata/model_compatibility.csv. Absence from this
registry does not imply incompatibility. A true value
records a successful maintained smoke test for that exact mode; a live
success is not evidence of batch success. The dated detailed result
artifacts are
inst/extdata/model_smoke_results_2026-09-05.csv and
inst/extdata/model_batch_smoke_results_2026-09-05.csv.
Standard configurations omit temperature and
top_p, so their model/provider defaults apply.
registry_path <- system.file(
"extdata",
"model_compatibility.csv",
package = "pairwiseLLM"
)
if (!nzchar(registry_path)) {
source_paths <- c(
file.path("inst", "extdata", "model_compatibility.csv"),
file.path("..", "inst", "extdata", "model_compatibility.csv")
)
registry_path <- source_paths[file.exists(source_paths)][1]
}
registry <- utils::read.csv(registry_path, check.names = FALSE)
registry[c(
"backend", "model_id", "endpoint", "live_tested", "batch_tested",
"reasoning_mode", "package_version", "test_date", "status"
)]
#> backend model_id endpoint
#> 1 openai gpt-5.6-sol responses
#> 2 openai gpt-5.6-terra responses
#> 3 openai gpt-5.6-luna responses
#> 4 openai gpt-5.5 responses
#> 5 openai gpt-5.4 responses
#> 6 openai gpt-5.4-mini responses
#> 7 openai gpt-5.4-nano responses
#> 8 openai gpt-5.3-codex responses
#> 9 openai gpt-5.2 responses
#> 10 openai gpt-5.1 responses
#> 11 openai gpt-5 responses
#> 12 openai gpt-5-mini responses
#> 13 openai gpt-5-nano responses
#> 14 openai o3 responses
#> 15 openai gpt-4.1 responses
#> 16 openai gpt-4.1 chat.completions
#> 17 openai gpt-4.1-mini responses
#> 18 openai gpt-4o-mini responses
#> 19 openai gpt-4o responses
#> 20 anthropic claude-fable-5-1 messages
#> 21 anthropic claude-opus-5 messages
#> 22 anthropic claude-sonnet-5 messages
#> 23 anthropic claude-haiku-4-5-20251001 messages
#> 24 anthropic claude-haiku-4-5-20251001 messages
#> 25 gemini gemini-3.8-flash generateContent
#> 26 gemini gemini-3.8-flash batchGenerateContent
#> 27 gemini gemini-3.7-flash generateContent
#> 28 gemini gemini-3.7-flash batchGenerateContent
#> 29 gemini gemini-3.6-flash generateContent
#> 30 gemini gemini-3.6-flash batchGenerateContent
#> 31 gemini gemini-3.5-flash generateContent
#> 32 gemini gemini-3.5-flash batchGenerateContent
#> 33 gemini gemini-3.5-flash-lite generateContent
#> 34 gemini gemini-3.5-flash-lite batchGenerateContent
#> 35 gemini gemini-3.1-flash-lite generateContent
#> 36 gemini gemini-3.1-flash-lite batchGenerateContent
#> 37 gemini gemini-3.1-pro-preview generateContent
#> 38 gemini gemini-3.1-pro-preview batchGenerateContent
#> 39 gemini gemini-3-flash-preview generateContent
#> 40 gemini gemini-3-flash-preview batchGenerateContent
#> 41 gemini gemini-2.5-flash generateContent
#> 42 gemini gemini-2.5-flash batchGenerateContent
#> 43 gemini gemini-2.5-flash-lite generateContent
#> 44 gemini gemini-2.5-flash-lite batchGenerateContent
#> 45 gemini gemini-2.5-pro generateContent
#> 46 gemini gemini-2.5-pro batchGenerateContent
#> 47 vertex gemini-3.8-flash generateContent
#> 48 vertex gemini-3.7-flash generateContent
#> 49 vertex gemini-3.6-flash generateContent
#> 50 vertex gemini-3.5-flash generateContent
#> 51 vertex gemini-3.5-flash-lite generateContent
#> 52 vertex gemini-3.1-flash-lite generateContent
#> 53 vertex gemini-3.1-pro-preview generateContent
#> 54 vertex gemini-3-flash-preview generateContent
#> 55 vertex gemini-2.5-flash generateContent
#> 56 vertex gemini-2.5-flash-lite generateContent
#> 57 vertex gemini-2.5-pro generateContent
#> 58 together thinkingmachines/Inkling chat.completions
#> 59 together MiniMaxAI/MiniMax-M3 chat.completions
#> 60 together Qwen/Qwen3.8-2.4T-A95B chat.completions
#> 61 together Qwen/Qwen3.7-Max chat.completions
#> 62 together Qwen/Qwen3.6-Plus chat.completions
#> 63 together Qwen/Qwen3.5-9B chat.completions
#> 64 together moonshotai/Kimi-K3 chat.completions
#> 65 together zai-org/GLM-5.3 chat.completions
#> 66 together zai-org/GLM-5.3-Flash chat.completions
#> 67 together zai-org/GLM-5.2 chat.completions
#> 68 together openai/gpt-oss-120b chat.completions
#> 69 together deepseek-ai/DeepSeek-V4-Flash-0731 chat.completions
#> 70 together deepseek-ai/DeepSeek-V4-Pro-0813 chat.completions
#> 71 together meta-llama/Llama-3.3-70B-Instruct-Turbo chat.completions
#> 72 together Qwen/Qwen3.7-Plus chat.completions
#> 73 together Prism-ML/Ternary-Bonsai-27B chat.completions
#> 74 together meta-models/Muse-Glimmer-30B chat.completions
#> 75 together Qwen/Qwen3.8-Flash chat.completions
#> 76 gemini gemini-3-pro-preview generateContent
#> live_tested batch_tested reasoning_mode package_version test_date
#> 1 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 2 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 3 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 4 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 5 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 6 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 7 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 8 TRUE FALSE provider-default 1.3.1 2026-09-05
#> 9 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 10 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 11 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 12 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 13 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 14 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 15 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 16 TRUE FALSE provider-default 1.3.1 2026-09-05
#> 17 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 18 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 19 TRUE TRUE provider-default 1.3.1 2026-09-05
#> 20 TRUE TRUE none 1.3.1 2026-09-05
#> 21 TRUE TRUE none 1.3.1 2026-09-05
#> 22 TRUE TRUE none 1.3.1 2026-09-05
#> 23 TRUE TRUE none 1.3.1 2026-09-05
#> 24 TRUE FALSE enabled 1.3.1 2026-09-05
#> 25 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 26 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 27 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 28 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 29 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 30 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 31 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 32 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 33 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 34 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 35 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 36 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 37 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 38 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 39 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 40 FALSE TRUE thinking_level=low 1.3.1 2026-09-05
#> 41 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 42 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 43 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 44 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 45 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 46 FALSE FALSE thinking_level=low 1.3.1 2026-09-05
#> 47 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 48 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 49 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 50 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 51 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 52 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 53 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 54 TRUE FALSE thinking_level=low 1.3.1 2026-09-05
#> 55 TRUE FALSE thinking_budget=0 1.3.1 2026-09-05
#> 56 TRUE FALSE thinking_budget=0 1.3.1 2026-09-05
#> 57 FALSE FALSE thinking_budget=0 1.3.1 2026-09-05
#> 58 TRUE FALSE none 1.3.1 2026-09-05
#> 59 TRUE FALSE none 1.3.1 2026-09-05
#> 60 FALSE FALSE none 1.3.1 2026-09-05
#> 61 FALSE FALSE none 1.3.1 2026-09-05
#> 62 FALSE FALSE none 1.3.1 2026-09-05
#> 63 TRUE FALSE none 1.3.1 2026-09-05
#> 64 TRUE FALSE none 1.3.1 2026-09-05
#> 65 TRUE FALSE none 1.3.1 2026-09-05
#> 66 TRUE FALSE none 1.3.1 2026-09-05
#> 67 TRUE FALSE none 1.3.1 2026-09-05
#> 68 TRUE FALSE none 1.3.1 2026-09-05
#> 69 TRUE FALSE none 1.3.1 2026-09-05
#> 70 TRUE FALSE none 1.3.1 2026-09-05
#> 71 TRUE FALSE none 1.3.1 2026-09-05
#> 72 FALSE FALSE none 1.3.1 2026-09-05
#> 73 TRUE FALSE none 1.3.1 2026-09-05
#> 74 TRUE FALSE none 1.3.1 2026-09-05
#> 75 FALSE FALSE none 1.3.1 2026-09-05
#> 76 false false thinking_level=low 1.3.1 2026-09-02
#> status
#> 1 tested-current
#> 2 tested-current
#> 3 tested-current
#> 4 tested-current
#> 5 tested-current
#> 6 tested-current
#> 7 tested-current
#> 8 tested-current
#> 9 tested-current
#> 10 tested-current
#> 11 tested-current
#> 12 tested-current
#> 13 tested-current
#> 14 tested-current
#> 15 tested-current
#> 16 tested-current
#> 17 tested-current
#> 18 tested-current
#> 19 tested-current
#> 20 tested-current
#> 21 tested-current
#> 22 tested-current
#> 23 tested-current
#> 24 tested-current
#> 25 tested-current
#> 26 tested-current
#> 27 tested-current
#> 28 tested-current
#> 29 tested-current
#> 30 tested-current
#> 31 tested-current
#> 32 tested-current
#> 33 tested-current
#> 34 tested-current
#> 35 tested-current
#> 36 tested-current
#> 37 tested-current
#> 38 tested-current
#> 39 tested-current
#> 40 tested-current
#> 41 unverified
#> 42 unverified
#> 43 unverified
#> 44 unverified
#> 45 unverified
#> 46 unverified
#> 47 tested-current
#> 48 tested-current
#> 49 tested-current
#> 50 tested-current
#> 51 tested-current
#> 52 tested-current
#> 53 tested-current
#> 54 tested-current
#> 55 tested-current
#> 56 tested-current
#> 57 unverified
#> 58 tested-current
#> 59 tested-current
#> 60 unverified
#> 61 unverified
#> 62 unverified
#> 63 tested-current
#> 64 tested-current
#> 65 tested-current
#> 66 tested-current
#> 67 tested-current
#> 68 tested-current
#> 69 tested-current
#> 70 tested-current
#> 71 tested-current
#> 72 unverified
#> 73 tested-current
#> 74 tested-current
#> 75 unverified
#> 76 retiredRegistry statuses mean:
tested-current: the recorded configuration passed on
the stated date and was current in the provider catalog when
checked.tested-legacy: a successful dated test whose identifier
is now legacy.retired: the provider has retired the identifier; it is
retained only as historical evidence.unverified: availability or a partial response was
observed, but no successful parsed package result was established.The opt-in inst/scripts/smoke_model_compatibility.R
harness can re-test selected live or batch configurations and write a
dated result artifact. It makes billable network calls and is
intentionally excluded from the package test suite. For example:
PAIRWISELLM_RUN_PROVIDER_SMOKE=true \
Rscript inst/scripts/smoke_model_compatibility.R \
--mode=live --providers=openai,anthropicSelected providers must have their recorded API-key environment
variables set; otherwise the harness records skipped-no-key
and exits unsuccessfully. Use --allow-missing-keys=true
only when those skipped rows are intentional.
Claude 5 reasoning is not advertised here: that family uses
adaptive-thinking semantics that this package does not currently
implement and test. Likewise, Ollama names such as
qwen3:32b, gemma3:27b, and
mistral-small3.2:24b are only dated, environment-dependent
local examples, not claims about what another Ollama installation
provides.
Mercer, S. H. (2026). Backends and tested model configurations [R package vignette]. Comprehensive R Archive Network. https://doi.org/10.32614/CRAN.package.pairwiseLLM