AI/MLLLM IntegrationFull-Stack Application
Rule-based LLMs — AI Chatbot with IBM Decision Services
Accurate, policy-driven AI with rule engine integration
Integrate Large Language Models with IBM ODM/ADS rule engines (Oct 2024 – Feb 2025). Chatbot demo combining LLM intelligence with business rules for reliable, compliant answers. Supports dual LLM backends (Ollama local, IBM Watsonx.ai cloud), LangChain orchestration, and Docker deployment. HR automation demo shows rule-based accuracy for vacation policies.
Tech Stack
PythonLangChainReactTypeScriptViteIBM ODMIBM ADSOllamaIBM WatsonxDockerFlaskGit/GitHub
Technical Highlights
- Dual LLM backend support: Ollama (local) and IBM Watsonx.ai (cloud) with seamless switching
- LangChain-based Python backend orchestrating LLM calls and IBM ODM/ADS decision service integration
- React + TypeScript + Vite frontend with Carbon Design System for modern chatbot UI
- Docker-based deployment with docker-compose for ODM, backend, and frontend services
Challenges & Solutions
- LLM hallucinations on policy questions → Integrated IBM ODM/ADS rule engines for accurate, compliant answers
- Complex deployment → Containerized entire stack with Docker Compose for one-command setup
Gallery