vllm.model_executor.kernels.attention.dsa.dcp_indexer_rocm
¶
ROCm DCP candidates ordered by descending FP32 score, then ascending token id.
Functions:
-
pack_dcp_candidates–Pack each local candidate into one sortable int64 collective element.
-
select_dcp_candidates–Select global candidates without floating-point conversion of token ids.
pack_dcp_candidates(logits, indices, rank, world_size, interleave, row_starts=None)
¶
Pack each local candidate into one sortable int64 collective element.
Source code in vllm/model_executor/kernels/attention/dsa/dcp_indexer_rocm.py
select_dcp_candidates(gathered, out)
¶
Select global candidates without floating-point conversion of token ids.
The selected set follows the packed (score, token id) order, but the ids are written in no particular order within a row.