https://elated-raman-42e0c2.netlify.app/tags/transformers/Recent content in Transformers on Sawyer Zheng's BlogHugozh-cnFri, 05 Jan 2024 13:18:49 +0800https://elated-raman-42e0c2.netlify.app/post/notes/ai/huggingface/transformers/Tue, 08 Aug 2023 00:00:00 +0000https://elated-raman-42e0c2.netlify.app/post/notes/ai/huggingface/transformers/<div id="outline-container-headline-1" class="outline-2"> <h2 id="headline-1"> 参考 </h2> <div id="outline-text-headline-1" class="outline-text-2"> <div id="outline-container-headline-2" class="outline-3"> <h3 id="headline-2"> 模型训练 GPU、 多 GPU、 CPU、多 CPU 等 </h3> <div id="outline-text-headline-2" class="outline-text-3"> <ul> <li><a href="https://huggingface.co/docs/transformers/perf_train_gpu_many">Efficient Training on Multiple GPUs</a></li> <li><a href="https://huggingface.co/docs/transformers/performance">Performance and Scalability</a></li> </ul> </div> </div> <div id="outline-container-headline-3" class="outline-3"> <h3 id="headline-3"> 多机器并行训练方法 </h3> <div id="outline-text-headline-3" class="outline-text-3"> <ul> <li><a href="https://zhuanlan.zhihu.com/p/462722054">Transformers多机多卡的炼丹实践 - 知乎</a></li> </ul> <div id="outline-container-headline-4" class="outline-4"> <h4 id="headline-4"> 速度慢分析 </h4> <div id="outline-text-headline-4" class="outline-text-4"> <ol> <li><a href="https://github.com/huggingface/accelerate/issues/192">huggingface/accelerate#192 The more GPU I use, the slower the training speed.</a></li> <li><a href="https://github.com/huggingface/transformers/issues/19918">huggingface/transformers#19918 Why training on Multiple GPU is slower than tr…</a></li> </ol> </div> </div> </div> </div> </div> </div> <div id="outline-container-headline-5" class="outline-2"> <h2 id="headline-5"> 模型转换 </h2> <div id="outline-text-headline-5" class="outline-text-2"> <div id="outline-container-headline-6" class="outline-3"> <h3 id="headline-6"> 转换成 huggingface transformers 格式 </h3> <div id="outline-text-headline-6" class="outline-text-3"> <p>参考：</p>