How I built an Air-gapped LLM-based AI Chatbot in Containers Step-by-Step

As AI tools become increasingly popular, they play an important role in boosting our productivity in everyday tasks. However, it also brings risks where data private faces challenges because chatbots need internet access, and some company policies simply do not allow them to avoid any data privacy and security issues. Thanks to AI boom, the private cloud is making a comeback, and build a real air-gapped AI and make it up and running locally or in containers will become more and more popular as the solution forward.