Your lightning-fast AI cooking companion, delivering instant guidance and predictive assistance through every step.
Llama-4-Scout delivers instant answers with 1M token context
SAM2 + Llama-4-Scout identify ingredients instantly
Scout's efficiency enables seamless hands-free cooking
Watch Sous Chef in Action
Creating fresh, healthy meals
Start your cooking journey with a simple voice command
"Sous Chef, what can I do with these ingredients?"
With just your voice, unlock personalized recipes based on what's in your kitchen. No typing, no scrolling – just natural conversation with your AI sous chef.
Simply say "Sous Chef" to activate your assistant. Powered by AWS Transcribe's real-time streaming, it's always ready when you are.
Ask naturally: "What can I make with tomatoes and mozzarella?" The system understands context and cooking intent.
Get immediate, conversational responses through Amazon Polly's neural voices. Sub-100ms latency keeps the conversation flowing naturally.
Try it yourself:
"Sous Chef, I have fresh tomatoes, mozzarella, and basil. What can we make?"
→ "Perfect! With those ingredients, we can make a classic Caprese Salad. Would you like me to guide you through it?"
Contextual Understanding: Llama-4-Scout analyzes your ingredients and dietary preferences
Instant Suggestions: Get personalized recipe ideas in under 100ms
Step-by-Step Guidance: Conversational cooking instructions tailored to your skill level
Adaptive Learning: Remembers your preferences for future recommendations
Structured Output: Powered by BoundaryML for consistent, well-formatted recipe suggestions
Voice Synthesis: AWS Polly neural voices bring Sous Chef to life with natural, expressive speech
Real-time tracking ensures nothing is overlooked during preparation
SAM2's advanced segmentation technology watches your ingredients throughout the cooking process, tracking their location and state changes to ensure perfect timing and coordination.
SAM2 identifies and tracks each ingredient without manual labeling, understanding what needs attention.
Monitors changes like chopping, mixing, or cooking, alerting you when ingredients need attention.
Keeps track of where everything is, even if temporarily obscured or moved around the kitchen.
SAM2 Technology: Zero-shot segmentation • Real-time tracking • 51K+ videos trained
Keeps your recipe on track by predicting and guiding each step
V-JEPA 2's world model watches your cooking progress and anticipates what comes next, providing timely reminders and preventing common mistakes before they happen.
Anticipating Your Actions
"I see you're about to slice the tomatoes. Remember to use a sharp knife and cut them 1/4 inch thick for even layering."
Currently: Arranging mozzarella slices
Next: Layer tomato slices
Then: Add fresh basil leaves
Finally: Drizzle olive oil
Timing Alert
Don't forget to season between layers
Technique Check
Good knife angle for clean cuts
V-JEPA 2 Technology: World model • 62+ hours training • Motion prediction
30s ago
Washed basil leaves
Now
Slicing mozzarella
In 45s
Start tomato slicing
Confidence: 92%
In 2m
Layer ingredients
Confidence: 87%
In 3m
Add olive oil drizzle
Confidence: 95%
Watch all the technologies work together in real-time
Set up your iPhone camera streaming
Place ingredients on your counter
Say "Sous Chef" to activate voice
Follow AI guidance to create your dish
Response Time
Accuracy
Demo Requirements
iPhone with camera + MacBook Pro + Local server running
Get the demo running in minutes
Before starting, ensure you have: • Node.js 18+ installed • Python 3.10+ with pip • CUDA-capable GPU (for SAM2) • iPhone and MacBook on same network • Meta AI API keys
For the hackathon demo, we recommend running all services locally on the MacBook for best performance. The setup can be completed in under 10 minutes with all dependencies installed.