Prototype to Production: Advanced AI Apps
Scott Moss
This Workshop's Online Chatroom is Currently Open!
This workshop has ended. Check back soon for the recording!
You can watch a replay of this workshop!
Key Takeaways
By participating along with us in the workshop, you'll learn:
- Understand how to release and evaluate AI apps for production.
- Learn to establish evaluation metrics, scoring systems, and datasets (synthetic and real) for accurate evaluations.
- Explore techniques like prompt engineering, RAG, and hyperparameter tuning to improve LLM accuracy.
- Discover strategies for handling token limits, speed optimization, latency, and cost reduction.
- Use structured outputs to get deterministic values from LLMs.
- Learn to classify user inputs before responding to improve accuracy and efficiency.
Is This Workshop for Me?
This course is aimed at developers familiar with Node.js and APIs who have built an LLM-based app and are ready to take it to the next level by improving its accuracy, performance, and scalability for production use.
Workshop Details
This course teaches you how to take a prototype AI application and optimize it for production. You’ll learn how to set up evaluation processes, including metrics, scores, and datasets. You’ll explore techniques like prompt engineering, Retrieval-Augmented Generation (RAG), and hyperparameter adjustments to improve the performance of large language models. Additionally, we’ll cover practical strategies for handling token limits, reducing latency, improving speed, and keeping costs under control. While fine-tuning will be discussed, the focus will be on optimization techniques that don’t require it. By the end of this course, you’ll be equipped to take your AI app from prototype to production.
Any Prerequisites?
- Node.js
- Basic knowledge of APIs
- OpenAI API account setup
Attend Online Live and in Full HD
You're Registered to Attend Online!
You'll receive additional details and a reminder via email as the event draws near.
Prototype to Production: Advanced AI Apps
Event Details
What
- One Full Day Workshop Session
- Replay Videos (available immediately)
When
- November 7, 2024 - 9:30am to 4:30pm Central Standard Time
Where
- Option 1: Attend online on our full HD live stream
- Option 2: Attend in-person at HQ in Minneapolis, MN
Daily Schedule
- 9:30AMIntroduction to Moving from Prototype to Production
- 10:00AMEstablishing Metrics, Scores, and Evaluation Datasets
- 10:30AMRunning Evaluations on Your App
- 11:00AMImproving Accuracy with Prompt Engineering and Structured Outputs
- 11:30AMExploring Architectures: Retrieval-Augmented Generation (RAG) and Others
- 12:00PMLunch Break
- 1:00PMHyperparameter Tuning and Adjusting LLM Settings
- 1:30PMStrategies for Classifying User Inputs Before Responding
- 2:00PMHandling Token Limits and Optimizing for Speed
- 2:30PMReducing Latency and Costs in Production
- 3:30PMDebugging and Testing Production AI Apps
- 4:00PMFinal Review: Putting It All Together for a Production-Ready AI App
- 4:30PMWrapping Up and Q&A
Your (Awesome) Instructor
Scott Moss
Scott is the CEO and Co-founder of Superfilter AI. He’s spent years as a VC investing in AI startups, building new features as an engineer at Netflix, and founding and leading a devtools startup. He’s a 2-time YC founder that loves building things people obsess about. Outside of the grind, Scott loves to game and play basketball and spend time with his family out in California.
Check out all of our upcoming workshops!
Workshops happen throughout the year, and are all included with membership.