Yaacov Zamir
Yaacov is a software engineer at Red Hat, he is a long time contributor to free software projects, volunteer at the Nitzanim project, and like cats.
Sessions
09-09
15:00
20min
Private LLMs and RAG Pipelines in Python
Yaacov Zamir
This talk will show how to set up a private LLM + RAG system using Python in an "air-gaped" environment. We’ll cover choosing efficient open-source models, setting up local vector databases, and optimizing retrieval in resource-limited environments.
Hall 7