Trends in AIGC The future LLM foundation models will become increasingly powerful, and many small models (huggingface models) are also thriving. When integrated with current enterprise applications or privatized data, new AI applications will emerge. In autonomous agent systems driven by LLM technology, LLM plays the role of the intelligent brain and includes three components … Read more
Previously, we mentioned that Traefik 2.0 has officially been released, and it now supports TCP services. However, the official documentation for Traefik is somewhat confusing, especially regarding its use in Kubernetes, where the details are even less comprehensive. In my spare time, I have been trying to translate the official documentation. You can find it … Read more
<img alt="Using Kubernetes Gateway API in Traefik" src="https://statedai.com/wp-content/uploads/2025/02/6fdbb7d0-d162-4a00-bbd2-7284d2967ba3.png"/>Gateway API (formerly known as Service API) is an open-source project managed by the SIG-NETWORK community, with the project address: https://gateway-api.sigs.k8s.io/. The primary reason for its development is that the Ingress resource object does not adequately meet network requirements. In many scenarios, Ingress controllers need to extend functionality … Read more
The monitoring system is one of the core rules defined by Google for SRE. When we use Traefik as the Ingress controller for Kubernetes, it is naturally essential for us to monitor it. In this article, we will explore how to use Prometheus and Grafana to monitor and alert based on the metrics provided by … Read more
Previously, we introduced most of the usage methods in Traefik version 2.3.x, and starting from version 2.2, Traefik has provided support for UDP, allowing us to provide load for services such as DNS resolution. First, deploy a UDP service as shown below: apiVersion: v1 kind: Service metadata: name: whoamiudp spec: ports: – protocol: UDP name: … Read more
Previously, we introduced the use of URL Rewrite in ingress-nginx, where the path rewriting is mostly similar to the traditional nginx method. However, if we are using the more cloud-native Traefik as our gateway, how do we handle URL Rewrite requirements? In an earlier article, we discussed the basic functionalities of Traefik 2.1, but we … Read more
In the previous article, we implemented Traefik 2.0 to expose Redis (TCP) services. We learned that using TCP routing configuration in Traefik requires SNI, which relies on TLS, so we need to configure certificates for normal access to TCP services. In fact, Traefik not only supports manually configuring TLS certificates but also supports automatically generating … Read more
Machine learning is rapidly integrating into business operations, becoming a cornerstone of enterprise operations. The emergence of this technology has brought many tangible impacts to various enterprises, such as improving processes, increasing efficiency, and accelerating innovation. The development of machine learning technology is changing rapidly, combined with high-performance computing options and vast amounts of data, … Read more
Author | OpenAI Translator | Sambodhi Editor | Xu Qian In this article, OpenAI’s engineering team shares various challenges and solutions they encountered during the Kubernetes cluster scaling process, as well as the performance and effects they achieved. We have scaled our Kubernetes cluster to 7500 nodes, creating a scalable infrastructure for large models like … Read more
Traefik is a modern and flexible reverse proxy and load balancer that allows developers and operations teams to easily manage microservices! Whether you are a cloud computing and microservices enthusiast or looking for an efficient network architecture management tool, this article will take you deep into the installation and usage of Traefik, making everything a … Read more