Rotary Positional Embedding (RoPE)
2026/3/9小于 1 分钟
Rotary Positional Embedding (RoPE)
题面
实现 RoPE:对查询向量按 y = x ⊙ cos + rotate_half(x) ⊙ sin 进行旋转编码,其中 rotate_half 将前后两半交换并对前半取负,D 保证为偶数。
Implementation Requirements
- External libraries are not permitted
- The solve function signature must remain unchanged
- Q、cos、sin 形状均为 (M, D),输出同形状
Examples
见页面示例(第一行保持不变,第二行发生旋转)。
Constraints
- D 为偶数;1 ≤ M,D ≤ 10,000
- Performance: D = 128, M = 1,048,576