Dylan Patel 认为 Trainium 已在推理上得到验证,Anthropic 在其上跑生产推理和 RL rollout,但历史上不适合研究型训练。
Trainium 已在推理领域证明了自己。Anthropic 正在 Trainium2 和 Trainium3 上运行生产推理和 RL rollout。一直以来,Trainium 很适合推理,但不太适合研究型训练。原文 (en)
Trainium has already proven itself in the realm of inference. Anthropic is running production inference and RL rollouts on Trainium2 and Trainium3. Historically, Trainium has been great for inference but not the best fit for research training.