ONNX

Embedding Models in LlamaIndex

by
Embedding Models in LlamaIndex

You may have heard of the concept of word embedding, which represents semantics using numerical vectors. The closer the numerical vectors are, the more similar the corresponding statements or words are in meaning. LlamaIndex also uses embeddings to represent documents. The embedding model takes text as input and returns a long string of numbers that … Read more

Deploying PyTorch Models Using C++

by
Deploying PyTorch Models Using C++

↑ ClickBlue Text Follow the Jishi Platform Author丨Civ@Zhihu (Authorized) Source丨https://www.zhihu.com/question/66532235/answer/2782357337 Editor丨Jishi Platform Jishi Guide This article uses the C++ inference framework ncnn as an example to introduce the general deployment process. The approach is similar for other C++ inference frameworks, with the only learning cost being the API of the inference framework itself. >> Join … Read more