Raghunath T

Custom RAG Server Development Using Open-Source Multimodal LLM Technologies

Confidential • Freelance

Aug 2025 - Present • 9 mos

Designed and developed a custom RAG server to leverage enterprise IP in the form of documents, specifications, policies, drawings, and knowledge bases. The work included parsing documents and images and storing them in vector databases. I am a strong advocate of open-source LLMs and CPU-based architectures, where enterprise data is securely deployed within the customer's network. This eliminates additional token-usage costs and ensures customers do not need to worry about IP information being exchanged over the internet. This solution involves text and multimodal LLMs with best-in-class open-source libraries for embedding, parsing, and training LLMs that are multimodal and provide multilingual support for customer knowledge-base utilization and end-user assistance. The various technologies and components in which I have expertise include RAG, Python, Ollama, Llama, LLaVA, Mistral, front-end development, fine-tuning, MCP, and GPT-OSS.