The author of this web content discusses the implementation of a custom AI solution using an open source AI model for a client with sensitive customer information. The goal is to maintain a high level of security by not passing the data to proprietary models. The author highlights the abundance of open source AI models in the market that are showing impressive performance. They recommend Mistral as the best option for running the model locally due to its size and performance. The article also explains the concept of parameter size in large language models and introduces Ollama as a software to run open source models locally. The author emphasizes the ability of Ruby developers to integrate with and customize these models. The web content concludes by outlining practical use cases and the benefits of using open source models for companies with data security concerns.
https://reinteractive.com/articles/running-open-source-AI-models-locally-with-ruby