Viktoria Semaan

Beyond Prompting: Building Scalable AI with Multi-Agent Systems and MCP

Stop building monolithic LLM agents. Learn how a microservices approach using multi-agent systems creates truly scalable and powerful AI.

Beyond Prompting: Building Scalable AI with Multi-Agent Systems and MCP
#1about 4 minutes

Understanding LLMs, context windows, and RAG

Large language models use tokens to process text, but their limited context window requires retrieval-augmented generation (RAG) to access large or real-time datasets.

#2about 3 minutes

Transitioning from monolithic agents to multi-agent systems

Giving a single LLM agent too many tools leads to confusion and failure, so a multi-agent architecture with specialized agents improves performance and scalability.

#3about 3 minutes

Why AI projects fail and the need for evaluation

Most AI proofs-of-concept fail in production due to a lack of business context, highlighting the need for robust evaluation frameworks like MLflow.

#4about 4 minutes

Demo: Evaluating an agent's RAG tool using MLflow

A practical demonstration shows how to use MLflow with custom metrics like relevance and specificity to identify and fix agent hallucinations in a RAG tool.

#5about 3 minutes

Introducing the Model Context Protocol for tool integration

The Model Context Protocol (MCP) standardizes how agents connect to tools, creating a reusable ecosystem of servers and clients to avoid redundant integration work.

#6about 6 minutes

Demo: Automating workflows with MCP servers and clients

This demo showcases connecting local files, GitHub, and Databricks Genie as MCP servers to a client, enabling complex, automated workflows from a single chat interface.

#7about 2 minutes

Exploring the current limitations and future of MCP

The current challenges for MCP include tool discovery, agent confusion from overlapping server functions, and the lack of a centralized security gateway.

Related jobs
Jobs that call for the skills explored in this talk.

test

Milly
Vienna, Austria

Intermediate

test

Milly
Vienna, Austria

Intermediate

Featured Partners

Related Articles

View all articles
DC
Daniel Cranney
Stephan Gillich - Bringing AI Everywhere
In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a recent session titled "Bringing AI Everywhere," sheddi...
Stephan Gillich - Bringing AI Everywhere
EM
Eli McGarvie
13 AI Tools You Have to Try
First, it was NFTs, then it was Web3, and now it’s generative AI… it’s probably time to stop collecting pictures of monkeys and kitties. Chatbots and generative AI are the next big thing. This time we’ve jumped on a trend that has real-world applicat...
13 AI Tools You Have to Try

From learning to earning

Jobs that call for the skills explored in this talk.