How to Use Xinference for Custom Inference of Phi-4

How to Use Xinference for Custom Inference of Phi-4

Click 👇🏻 to follow, article from “ A couple of days ago, Microsoft open-sourced the 14B dense model phi-4, which is called the strongest 14B model available. How strong is the model? What others say doesn’t count; only trying it yourself will tell. However, when you want to get hands-on, you find that most current … Read more

Microsoft’s ‘Little Cannon’: Phi-4 – A Model for Complex Inference Driven by Synthetic Data

Microsoft's 'Little Cannon': Phi-4 - A Model for Complex Inference Driven by Synthetic Data

Follow us to stay updated! Recently, the LLM community has been immersed in the shock brought by DeepSeek-V3. This model is not only open-source but also performs well. However, such a large-scale LLM is beyond our reach (the GPU memory can’t handle it). If we can’t afford that, let’s take a look at Microsoft’s open-source … Read more