Zaid Zaim
Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
#1about 4 minutes
Combining spatial computing and drones for new interactions
The speaker shares his vision for controlling a Tello drone with a HoloLens to create more engaging and exciting coding experiences.
#2about 3 minutes
Exploring the tools for drone and MR development
An overview of the key technologies used, including the Unity 3D game engine, ChatGPT for code inspiration, and the Mixed Reality Toolkit (MRTK) for HoloLens.
#3about 2 minutes
A closer look at the programmable Tello drone
The Tello drone is introduced as a lightweight, programmable device comparable to a flying Raspberry Pi, controllable via its SDK.
#4about 4 minutes
Understanding the spectrum of immersive technologies
A breakdown of the reality-virtuality continuum defines augmented reality (AR), virtual reality (VR), and how mixed reality (MR) blends the physical and digital worlds.
#5about 5 minutes
How the HoloLens enables hands-free enterprise solutions
The Microsoft HoloLens is presented as an enterprise-focused MR headset enabling natural, hands-free interaction for use cases like remote assistance and healthcare.
#6about 5 minutes
Leveraging ChatGPT to interpret documentation and write code
ChatGPT is used as a tool to understand the drone's documentation and generate initial C# code for UDP communication, including IP addresses and ports.
#7about 5 minutes
A walkthrough of the Unity project and UDP client
A look inside the Unity project and the C# script for the UDP client, which handles connecting to the drone, entering SDK mode, and sending commands.
#8about 8 minutes
Demonstrating drone control with the HoloLens
A live demo shows the Tello drone taking off, moving, and flipping, all controlled by commands from the mixed reality application on the HoloLens.
#9about 3 minutes
Answering questions about Unreal Engine and HoloLens
The speaker addresses audience questions on Unreal Engine as an alternative, the development status of HoloLens, and using mixed reality on mobile devices.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
04:29 MIN
Teaching AI-first programming with modern developer tools
aa
00:26 MIN
Fusing mixed reality, AI, and drones for magical experiences
How Mixed Reality, Azure AI and Drones turned me into a Magician?
15:35 MIN
Programming drone controls with GitHub Copilot
How Mixed Reality, Azure AI and Drones turned me into a Magician?
31:03 MIN
Flying a real drone using hand gestures in MR
How Mixed Reality, Azure AI and Drones turned me into a Magician?
06:43 MIN
The core technologies for building an immersive copilot
Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
03:58 MIN
Exploring the core technology stack for the project
How Mixed Reality, Azure AI and Drones turned me into a Magician?
00:45 MIN
Introducing the concept of an immersive AI copilot
Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
07:16 MIN
A practical walkthrough of the Azure AI Foundry playground
How Mixed Reality, Azure AI and Drones turned me into a Magician?
Featured Partners
Related Videos
35:26How Mixed Reality, Azure AI and Drones turned me into a Magician?
Zaid Zaim
31:50Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
Zaid Zaim
31:39Livecoding with AI
Rainer Stropek
30:24ChatGPT: Create a Presentation!
Markus Walker
29:35GitHub Copilot Beyond the Basics - 10 Ways to Elevate Your Coding
Liuba Gonta & Yuliya Khadasevich
1:12:04WeAreDevelopers LIVE - the weekly developer show with Chris Heilmann and Daniel Cranney
26:54Make it simple, using generative AI to accelerate learning
Duan Lightfoot
58:06From Syntax to Singularity: AI’s Impact on Developer Roles
Anna Fritsch-Weninger
Related Articles
View all articles
From learning to earning
Jobs that call for the skills explored in this talk.
Microsoft Copilot Studio & Azure AI Foundry Developer- Remote
FDM Group
Remote
Senior
TypeScript
Continuous Integration
Computer Vision Engineer for Drone Systems
Alpine Eagle GmbH
PyTorch
Tensorflow
Computer Vision
Machine Learning
Robotics Integration & Autopilot Interface Engineer (ROS 2 / PX4 / MAVLink)
autonomous-teaming
Remote
GIT
Routing
Continuous Integration
Robotics Integration & Autopilot Interface Engineer (ROS 2 / PX4 / MAVLink)
autonomous-teaming
Remote
GIT
Routing
Continuous Integration