vllm.models.mistral.mistral_large4.amd.specialized_decode.mono.common.runtime
¶
Host-side mechanisms of a mono runner, one module each (imported directly, so
the ones without an AITER dependency load without it): consensus (TP-uniform
decisions), peer_memory (symmetric peer buffers), abi (kernel argument
tables), compile (compile-only builds).
Modules:
-
consensus–Decisions every TP rank must take alike.
-
hip_ipc–Small ctypes wrapper for HIP allocation and IPC memory operations.
-
peer_memory–Symmetric peer memory for in-kernel TP reductions.
-
step_begin–A step's beginning (
DESIGN_v3I1), one launch: every mailbox buffer