Running HuggingFace DeepSeek V2 on Single Node A800
0x0. Background Trying to run the DeepSeek V2 released on HuggingFace, I encountered several issues. Here are the solutions. The open-source DeepSeek V2 repo link provided by HuggingFace is: https://huggingface.co/deepseek-ai/DeepSeek-V2 0x1. Error 1: KeyError: ‘sdpa’ This issue has also been reported by the community. https://huggingface.co/deepseek-ai/DeepSeek-V2/discussions/3 Insert image description here The solution is quite simple; just … Read more