Introduction

Day 6 of my GenAI Learning Challenge.

Today, I integrated a local LLM with FastAPI to build a usable AI backend. Instead of running the model separately, user input is sent through an API and processed by llama.cpp.

This is a key step toward building real AI applications …

Introduction

In Generative AI systems, most models are accessed through APIs. However, running models locally is becoming increasingly important for privacy, cost efficiency, and offline usage.

To understand how local inference works, I ran a Large Language Model (LLM) on my system using llama.cpp.

In this session, I focused …

Introduction

In real-world AI systems, models alone are not enough. They need memory, structured outputs, and backend logic to work effectively.

To understand this, I built a simple end-to-end AI pipeline using a local model (llama.cpp) and MongoDB.

In this session, I focused on:

• Running a local AI model …