Daniel Töws

Using LLMs in your Product

What if your LLM could call your application's code? Learn how function calling connects models to proprietary data and transforms them into intelligent agents.

Using LLMs in your Product
#1about 2 minutes

Three pillars for integrating LLMs in products

The talk will cover three key areas for product integration: using the API, mastering prompt engineering, and implementing function calls for external data.

#2about 3 minutes

Making your first OpenAI API chat completion call

This section covers the basic code structure for making a chat completion request, including the different message roles and the stateless nature of the API.

#3about 3 minutes

Choosing the right LLM for your use case

Key factors for selecting a model include its training dataset cutoff date, context length measured in tokens, and the number of model parameters.

#4about 5 minutes

Best practices for effective prompt engineering

Improve LLM outputs by writing clear instructions, providing context with personas and references, and breaking down complex tasks into smaller steps.

#5about 4 minutes

Understanding and defending against prompt injection

Prevent users from bypassing system instructions by reinforcing the original rules with a post-prompt at the end of the message history.

#6about 4 minutes

Giving LLMs new abilities with function calling

Function calling allows the LLM to request help from your own code to access external data or perform actions like searching a database.

#7about 2 minutes

Summary and resources for further learning

The talk concludes with a recap of core concepts and provides resources for advanced prompting techniques and retrieval-augmented generation (RAG).

#8about 7 minutes

Audience Q&A on practical LLM implementation

The Q&A covers practical concerns like managing context length, prompt testing costs, implementing function call logic, and ensuring reliable JSON output.

Related jobs
Jobs that call for the skills explored in this talk.

test

Milly
Vienna, Austria

Intermediate

test

Milly
Vienna, Austria

Intermediate

Matching moments

The rapid evolution and adoption of LLMs
03:36 MIN

The rapid evolution and adoption of LLMs

Building Blocks of RAG: From Understanding to Implementation

Using large language models to improve customer support
19:07 MIN

Using large language models to improve customer support

Unlocking the potential of Digital & IT at Vodafone

Using large language models for voice-driven development
07:45 MIN

Using large language models for voice-driven development

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Building custom applications with the OpenAI chat API
10:29 MIN

Building custom applications with the OpenAI chat API

Develop AI-powered Applications with OpenAI Embeddings and Azure Search

Using large language models as a learning tool
28:51 MIN

Using large language models as a learning tool

Google Gemini: Open Source and Deep Thinking Models - Sam Witteveen

Integrating generative AI for dynamic responses
33:08 MIN

Integrating generative AI for dynamic responses

Creating bots with Dialogflow CX

Defining key GenAI concepts like GPT and LLMs
23:35 MIN

Defining key GenAI concepts like GPT and LLMs

Enter the Brave New World of GenAI with Vector Search

Understanding the core capabilities of large language models
01:31 MIN

Understanding the core capabilities of large language models

Data Privacy in LLMs: Challenges and Best Practices

Featured Partners

Related Videos

See all videos
Three years of putting LLMs into Software - Lessons learned26:30

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

Bringing the power of AI to your application.32:26

Bringing the power of AI to your application.

Krzysztof Cieślak

AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

Make it simple, using generative AI to accelerate learning26:54

Make it simple, using generative AI to accelerate learning

Duan Lightfoot

Prompt Engineering - an Art, a Science, or your next Job Title?33:28

Prompt Engineering - an Art, a Science, or your next Job Title?

Maxim Salnikov

Creating Industry ready solutions with LLM Models58:00

Creating Industry ready solutions with LLM Models

Vijay Krishan Gupta & Gauravdeep Singh Lotey

Exploring LLMs across clouds28:38

Exploring LLMs across clouds

Tomislav Tipurić

OpenAPI meets OpenAI29:50

OpenAPI meets OpenAI

Christopher Walles

Related Articles

View all articles
EM
Eli McGarvie
16 Ways Developers Can Use ChatGPT-4 and GPT-4o
ChatGPT has been busy getting new designations. If you’ve been scrolling on 𝕏 over the last week, then you’ve seen the ChatGPT-4o announcement and probably thought of Joaquin Phoenix’s virtual girlfriend on Her.Beyond the references to flicks, the la...
16 Ways Developers Can Use ChatGPT-4 and GPT-4o
EM
Eli McGarvie
13 NEW AI Tools That Use ChatGPT 🤯
Our dear friend Bill Gates has recently suggested that the ChatGPT revolution is as big as the invention of mobile phones and the internet. So we thought it would be interesting to put together a list of all the useful applications that are powered b...
13 NEW AI Tools That Use ChatGPT 🤯
AB
Adrien Book
Top 5 ChatGPT Plugins for Developers
The last few weeks have been very interesting in the AI space. We saw the release of a new updated version of ChatGPT from GPT-3.5 to GPT-4. Within a couple of days, Google soft-launched their competitor AI chatbot, Bard (available in the US and UK)....
Top 5 ChatGPT Plugins for Developers
DC
Daniel Cranney
Stephan Gillich - Bringing AI Everywhere
In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a recent session titled "Bringing AI Everywhere," sheddi...
Stephan Gillich - Bringing AI Everywhere

From learning to earning

Jobs that call for the skills explored in this talk.