Prometheus

Monitoring and Alerting Traefik with Prometheus

by
Monitoring and Alerting Traefik with Prometheus

The monitoring system is one of the core rules defined by Google for SRE. When we use Traefik as the Ingress controller for Kubernetes, it is naturally essential for us to monitor it. In this article, we will explore how to use Prometheus and Grafana to monitor and alert based on the metrics provided by … Read more

Unveiling the Tech Stack Behind ChatGPT: How OpenAI Scaled Kubernetes to 7500 Nodes

by
Unveiling the Tech Stack Behind ChatGPT: How OpenAI Scaled Kubernetes to 7500 Nodes

Author | OpenAI Translator | Sambodhi Editor | Xu Qian In this article, OpenAI’s engineering team shares various challenges and solutions they encountered during the Kubernetes cluster scaling process, as well as the performance and effects they achieved. We have scaled our Kubernetes cluster to 7500 nodes, creating a scalable infrastructure for large models like … Read more