Patel 拆解实验室算力:约 50% 研究、10% 开发(正式训练)、40% 推理。
实际上 50% 的算力用于研究,10% 用于开发,40% 用于推理。我所说的研究和开发是指:研究人员产生想法、测试新架构、新数据配比、新超参数、新注意力技术等等。原文 (en)
Actually 50% of the compute is research, 10% of the compute is development, and then 40% is inference. What I mean by research and development is: researchers are generating ideas, testing new architectures, testing new data mixes, testing new hyperparameters, new attention techniques, blah, blah, blah.