CUDA: skip graph compat check when graph is being reused (#32004)

mtmd: share compute buffer among subcontext (#31945)

• shared compute buffer

• add load-time alloc for audio gen

mtmd: add kimi K3.1 vision (#31980)

• mtmd: support kimi k3.1 vision

• fix preproc (both k2.5 and k3.1) and projector mlp

• small renaming

CUDA: move graph and concurrent stream state out of common.cuh (#32001)

ggml_cuda_graph, ggml_cuda_concurrent_event and ggml_cuda_stream_context
are only used by ggml-cuda.cu, but keeping them in common.cuh meant any
change to them rebuilt every CUDA translation unit. Move them to graph.cuh
and leave forward declarations in common.cuh. The context constructor,
cuda_graph() and any_cuda_graph_*() are now defined in ggml-cuda.cu, and
the stream context is held through a unique_ptr.

Also define ggml_cuda_kernel_can_use_pdl once in ggml-cuda.cu instead of
as a static function in the header, so there is one PDL cache instead of
one per translation unit, and fold the GGML_CUDA_PDL env check into it.

model : stop renaming the recurrent cache tensors in plamo2 (#31984)

common/json-schema : fix allOf with plain types (e.g. integer) generating an empty object grammar (#31834)

• common/json-schema : fix allOf with plain types (e.g. integer) generating an empty object grammar

• Fix empty range error and incorporated bot review feedback

common : escape control characters in tool argument strings (#31937)

normalize_quotes_to_json copies raw control characters verbatim while
converting pythonic tool arguments to JSON, so calls like
python(code='ab') produce invalid JSON in the arguments returned to
clients; replaying that history then fails hard. Escape C0 control
characters inside quoted strings via escape_json_string_inner.

cann: fail early when checking if buffer type is supported (#31270)

vulkan: add tiled-transpose concat shader for Qwen models (#30591)

• vulkan: tiled transpose for dim-0 concat with a transposed source

The delta-net conv-state path does ggml_transpose() straight into a dim-0
ggml_concat(), so the generic concat kernel reads src1 with the transposed
stride, one element per thread, and neighbouring lanes land on different cache
lines. Stage a 32x32 tile through shared memory instead, which keeps both the
load and the store coalesced. 33 columns pads away the bank conflicts.

Gated narrowly: dim 0, 2D, unquantized 4-byte elements, contiguous src0/dst
rows, and src1 actually transposed. Everything else falls through to the
existing kernel.

Qwen3.6-35B-A3B on gfx1151/RADV, 30 gated-delta-net layers: the CONCAT op goes
11877 us -> 957 us, and pp2048 at ub2048 goes 1224 -> 1628 t/s. Generated text
is unchanged.

The approach follows the tiled transposed concat Gaetan Puleo wrote for the HIP
backend in his Strix Halo fork.

Co-Authored-By: Claude Opus 5 noreply@anthropic.com

• enable by default, add smaller shader sizes

• clean up comments

• improve shader

• Add non-contiguous concat tests

Co-authored-by: ravel7524 58877666+ravel7524@users.noreply.github.com

• handle x or y axis overflow

Co-authored-by: Nathan Wilson nath.flagman151@passmail.com
Co-authored-by: Claude Opus 5 noreply@anthropic.com
Co-authored-by: ravel7524 58877666+ravel7524@users.noreply.github.com

ggml-rpc : fail gracefully on unreachable endpoints and failed handshakes (#30415)

• ggml-rpc: fail gracefully on unreachable endpoints and failed handshakes

rpc_dispatcher::start() aborted the whole process (GGML_ABORT -> SIGABRT) when
the endpoint could not be parsed, the transport failed to initialise, the socket
could not connect, or the HELLO handshake failed. A typo in --rpc or a
temporarily down node killed the host application, and the reason went to a log
stream the host may never see.

Make the connect-time failure reportable instead of fatal: start() returns bool
(LOG_ERROR + false; the dispatcher thread only starts after a successful
handshake), negotiate_hello() returns false on a half-open socket,
get_dispatcher() returns nullptr and does not cache failed attempts, and every
consumer treats nullptr as "endpoint did not answer" with the conservative
behaviour of its domain (allocation -> nullptr, alloc-size -> lower bound,
device memory -> 0/0, events -> no-op, device count -> 0, and add_server()
already maps 0 devices to nullptr).

Mid-stream failures keep the existing RPC_STATUS_ASSERT by design (fail fast
against silent corruption) and are intentionally out of scope.

Field motivation: on Android (llama.rn + phone RPC cluster) an unreachable
worker crashed the app; the crash buffer showed
abort <- ggml_abort <- rpc_dispatcher::start <- ggml_backend_rpc_add_server.

• tests : add a regression test for unreachable rpc endpoints

Calls ggml_backend_rpc_add_server with a socket that nothing listens on and with a
malformed endpoint, and expects nullptr from both. Without the fix in this branch
the first call aborts the process, so the test cannot even fail cleanly.

• ggml-rpc remove low-value comments

• tests : drop the internal device-count check after the rpc registry refactor

Co-authored-by: figkcoci-debug figkcoci-debug@users.noreply.github.com