Modeladopt
Multi-model architecture
Route each task to the model that fits it rather than picking a single one. Pricing tiers now span a factor of twenty-five: routing is a cost lever as much as a quality one.
GPT-5.6 has shipped in three tiers since July 2026, from $0.20 to $5 per million input tokens.
Modeladopt
Proprietary frontier models
Claude Opus 5, GPT-5.6 and Gemini 3.7 lead on long-horizon reasoning and agentic work. Keep them for the tasks that warrant it: their token cost stays an order of magnitude above open models.
Claude Opus 5 shipped on 24 July 2026; Gemini 3.7 Flash reached general availability on 13 August 2026.
Modeladopt
Mistral Large 3 and Small 4
Open weights under Apache 2.0: downloadable, modifiable, self-hostable with no per-token fee. The default choice whenever data must not leave your perimeter.
Mistral Large 3 is the largest open-weight mixture-of-experts model released by a major lab.
Frameworkadopt
MCP : Model Context Protocol
The protocol that plugs tools into models. It has moved beyond one vendor's specification to become the market's interoperability layer, which settles the lock-in question on tooling.
Now under Linux Foundation stewardship, backed by Anthropic, OpenAI, Google, Microsoft and AWS; 41 % of surveyed organisations in production in 2026.
Frameworkadopt
Hybrid RAG
Vector and keyword retrieval combined, with reranking. It is the backbone of enterprise document services, provided it is treated as one building block rather than the whole architecture.
77 % of IT and data leaders consider RAG alone insufficient for a reliable production deployment.
Platformadopt
LangGraph
Stateful orchestration for agents that reach production: failure recovery, checkpoints, human-in-the-loop. The longest real production track record among market orchestrators.
Generally available since October 2025, with public deployments at Klarna, Uber, LinkedIn, BlackRock and JPMorgan.
Tooladopt
pgvector
Vector search inside the PostgreSQL you already run: transactions, backups and access control are your database's own. One less system to maintain, as long as volume allows.
Past roughly ten million vectors a dedicated engine becomes relevant again, that is the threshold we observe.
Tooladopt
OpenTelemetry GenAI conventions
Standardised gen_ai.* attributes to trace model calls, tokens consumed and latencies. Make it a buying requirement: it is what lets you change observability tools without re-instrumenting.
The four most widespread LLM observability platforms now export in OpenTelemetry format.
Frameworktrial
Context engineering
Governing everything that enters the context window, instructions, memory, tools, token budget, compression, instead of polishing a wording. The prompt becomes a subset of the discipline.
82 % of IT and data leaders say prompt engineering alone is no longer enough; 95 % consider context engineering important at scale.
Tooltrial
Qdrant and Weaviate
Dedicated vector engines that hold up when metadata filtering gets demanding, because filtering sits inside indexing rather than being applied afterwards. Test them on your real filter set.
Managed costs 1.5 to 3 times self-hosted around ten million vectors, but removes the scaling workload.
Platformtrial
Langfuse, LangSmith, Arize Phoenix
Tracing, prompt versioning and continuous evaluation. Without this layer a quality regression goes unnoticed until the customer complains. Langfuse self-hosts under an MIT licence.
Langfuse passes 28,000 GitHub stars and self-hosts with no licence restriction.
Frameworktrial
A2A : Agent-to-Agent
The counterpart to MCP between agents: capability discovery, delegation, response. Still young, but already one of the two interoperability signals vendors point to.
MCP and A2A are the two protocols cited as interoperability signals in the 2026 agent framework market.
Modeltrial
Self-hosted open models
Llama, Qwen and DeepSeek now stand comparison on a good share of benchmarks. On a scoped use case at steady volume, in-house inference changes the business case.
Open-weight models rival proprietary alternatives on many benchmarks in 2026.
Tooltrial
vLLM and Ollama
Serving an open model on your own hardware, from developer workstation to GPU cluster. The building block that makes sovereign inference operable rather than theoretical.
Test first on low-variability workloads, where GPU sizing can actually be computed.
Frameworkassess
Multi-agent systems
Several specialised agents splitting a task. Demonstrations convince; tuning cost and the difficulty of reproducing an incident still keep production at arm's length.
Handle in the lab with a capped token budget and a full trace of every exchange.
Toolassess
Targeted fine-tuning and distillation
Useful when context cannot carry the knowledge: house style, business terminology, latency reduction on a repeated action. The prerequisite is still an evaluation set that proves the gain.
Without a prior evaluation set, fine-tuning is indistinguishable from an expensive hunch.
Platformassess
Autonomous coding agents
Agents that take a ticket and return a merge request. The gain shows on scoped, well-tested tickets; it collapses as soon as the specification is vague.
Measure against your own DORA metrics before any rollout.
Modelassess
Persistent agent memory
Keeping an agent's state between sessions rather than rebuilding it on every call. The topic raises as many compliance questions as efficiency gains: what is remembered becomes data to govern.
Memory is one of the four pillars of context engineering, alongside instructions, retrieval and tools.
Modelhold
Retired model generations
GPT-4, Claude 3, Gemini 1: these generations are no longer served, or will not be for long. If one is still called in production, migration is a planning matter, not a watch item.
Every retired generation takes its tuning with it: plan the evaluation campaign before the switch, not after.
Frameworkhold
Fully autonomous agents without supervision
A loop that decides and executes with no human checkpoint and no audit log. The risk is not model performance but the absence of any way to regain control when the chain drifts.
The AI Act has been fully enforceable for general-purpose models since 2 August 2026, with fines up to 3 % of global turnover or €15 million.
Frameworkhold
Shipping without prompt-injection detection
As soon as a model reads content it did not produce, a web page, an email, an uploaded file, that content can carry instructions. Without a detection layer and permission partitioning, the agent becomes an attack surface.
Partitioning the agent's permissions matters as much as the filter: an agent that cannot write cannot be diverted into writing.
Platformhold
Single provider with no abstraction layer
Calling a single model from across the application code. The day pricing changes, the generation is retired or the service goes down, there is no fallback path.
Models already on the market have a compliance window until 2 August 2027: abstraction is also what will make that switch manageable.
Toolhold
Rule-based automation sold as AI
Decision trees and scripts, renamed. Nothing wrong with them as tools, the problem is the AI budget they consume and the expectation they create without ever being able to meet it.
The test fits in one question: does behaviour change when the data changes, without a rule being rewritten?