RestAI: An Open Source AIaaS Platform Using LlamaIndex, Ollama, and HF Pipelines

RestAI: An Open Source AIaaS Platform Using LlamaIndex, Ollama, and HF Pipelines

Project Introduction Project: There are various types of agents (projects), each with its own functionality. (rag, ragsql, inference, vision) User: Users represent the system’s users. It is used for authentication and authorization (basic authentication). Each user can access multiple projects. LLMs: Supports any public or local LLM supported by LlamaIndex or Ollama. VRAM: Automatic VRAM … Read more