Fall back to legacy pipeline when CB model lacks PagedAttention (e.g. Gemma)#4336
Open
exzile wants to merge 4 commits into
Open
Fall back to legacy pipeline when CB model lacks PagedAttention (e.g. Gemma)#4336exzile wants to merge 4 commits into
exzile wants to merge 4 commits into