Develop generative AI apps in Azure (AI-3016)

AI Engineers, Data Scientists,

After completing this course you should be able to:

• Plan and prepare to develop AI solutions on Azure
• Choose and deploy models from the model catalog in Azure AI Foundry portal
• Develop an AI app with the Azure AI Foundry SDK
• Get started with prompt flow to develop language model apps in the Azure AI Foundry
• Develop a RAG-based solution with your own data using Azure AI Foundry
• Fine-tune a language model with Azure AI Foundry
• Implement a responsible generative AI solution in Azure AI Foundry
• Evaluate generative AI performance in Azure AI Foundry portal

Module1: Plan and Prepare to develop AI solutions on Azure

• Introduction
• What is AI
• Azure AI Services
• Azure AI Foundry
• Developer Tools and SDKs
• Responsible AI
• Exercise - Prepare for an AI Development Project
• Module Assessment

Module 2: Choose and Deploy Models from the Model Catalog in Azure AI Foundry Portal

• Introduction
• Explore the Model Catalog
• Deploy a Model to an Endpoint
• Optimize Model Performance
• Exercise - Explore, deploy and Chat with Language Models
• Module Assessment

Module 3 : Develop an AI App with the Azure Foundry SDK

• Introduction
• What is the Azure AI Foundry SDK
• Work with Project Connections
• Create a Chat Client
• Exercise- Create a Generative AI Chat App
• Module Assessment

Module 4 : Get Started with Prompt Flow to Develop Language Model Apps in the Azure AI Foundry

• Introduction
• Understand the Development Lifecycle of a Large Language Model (LLM) App
• Understand Core Components and Explore Flow Types
• Explore Connections and Runtimes
• Explore Varaints and Monitoring Options
• Exercise - Get Started with Prompt Flow
• Module Assessment

Module 5: Develop a RAG-based Solution with your own Data using Azure AI Foundry

• Introduction
• Understand how to Ground your Language Model
• Make your Data Searchable
• Create a RAG-based Client Application
• Implement RAG in a Prompt Flow
• Exercise - Create a Generative AI App that uses your own Data
• Module Assessment

Module 6: Fine-tune a Language Model with Azure AI Foundry

• Introduction
• Understand when to Fine-tune a Language Model
• Prepare your Data to Fine-tune a Chat Completion Model
• Explore Fine-tuning Language Models in Azure AI Foundry Portal
• Exercise - Fine-tune a Language Model
• Module Assessment

Module 7: Implement a Responsible Generative AI Solution in Azure AI Foundry

• Introduction
• Plan a responsible Generative AI Solution
• MAP Potential Harms
• Measure Potential Harms
• Mitigate Potential Harms
• Manage a Responsible Generative AI Solution
• Exercise - Apply content Filters to Prevent the Output of Harmful Content
• Module Assessment

Module 8: Evaluate Generative AI Performance in Azure AI Foundry Portal

• Introduction
• Assess the Model Performance
• Manually Evaluate the Performance of a Model
• Automated Evaluations
• Exercise - Evaluate Generative AI Model Performance
• Module Assessment

Attendees should meet the following pre-requisites:

• Familiar with fundamental AI concepts and services in Azure.
• Consider completing the Get started with artificial intelligence learning path first.

Recommended as preparation for the following exams:

• There is no exam linked to this course although assessments are incorporated into the class.