From Dev.to Community
Tech Articles
Curated developer articles, tutorials, and guides — auto-updated hourly
ANKUSH CHOUDHARY JOHAL5d ago • 14 min read
The setup Guide to RAG with OpenVINO 2024.3 and ONNX Runtime 1.18
RAG pipelines built with OpenVINO 2024.3 and ONNX Runtime 1.18 deliver 42% lower p99 latency and 37%...
#setup#guide#openvino#20243
0 0
ANKUSH CHOUDHARY JOHAL4d ago • 13 min read
Why We Switched from OpenVINO 2024.3 to LangChain 0.2 for quantization
In Q3 2024, our inference pipeline’s p99 latency hit 2.1 seconds for 7B parameter LLMs quantized to....
#switched#openvino#20243#langchain
0 0