Home
NEW

Running CrewAI with Local Models: Observations and Insights

April 7, 2024 CrewAI AI Agents Local LLMs Python

Introduction

While exploring CrewAI and running agents locally, I came across a post on Twitter claiming it’s possible to run CrewAI with Gemma and use it to generate a small book. I replicated most of the code and tried running it locally. Initially, it didn’t work, but with some minor modifications, I managed to get it running successfully.

Ajay NadathurAjay Nadathur is a seasoned engineer and entrepreneur with 18+ years in software development focused on mobile apps, AI, and SaaS. Founder of SonicText.xyz & PDFMagix, xoogler, expert in LLMs, Android, and cloud-based AI solutions.

» More about Ajay Nadathur