Fix causal masking for multi-token KV cache appends - #542

Fix causal masking for multi-token KV cache appends#542

mmshad wants to merge 1 commit into

mainKempnerInstitute/KempnerForge:mainfrom

fix/kv-cache-multi-token-appendKempnerInstitute/KempnerForge:fix/kv-cache-multi-token-appendCopy head branch name to clipboard