Running CrewAI with Local Models: Observations and Insights
April 7, 2024
CrewAI
AI Agents
Local LLMs
Python
Introduction
While exploring CrewAI and running agents locally, I came across a post on Twitter claiming it’s possible to run CrewAI with Gemma and use it to generate a small book. I replicated most of the code and tried running it locally. Initially, it didn’t work, but with some minor modifications, I managed to get it running successfully.