Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 7 hours
Course Outline
Transitioning from Text Generation to Typed Decisions
- Understanding the output structure of a decision model
- System one decisions contrasted with reasoning LLMs
- The cost and latency advantages of bounded decision-making
The Landscape of Open-Weight Decision Models
- Strands Decider 2B developed by AWS Labs
- The JEV and GEV open-weight model families
- Alternative models including Pplx-Decider, Liquid D1, and Clef
- Key differences in licensing and deployment requirements
An In-Depth Look at Decision Model Architecture
- Utilizing an LLM torso without a traditional language modelling head
- How the pointer head scores and selects from candidate options
- Understanding the origin and calculation of confidence scores
Executing Your First Decisions
- Setting up local environments on CPUs and consumer-grade GPUs
- Effective phrasing of questions and definition of option sets
- Batching multiple questions into a single processing pass
- Configuring decision thresholds and managing fallback behaviors
Evaluating Decision Quality
- Analyzing performance using JevBench and other decision-specific benchmarks
- Assessing the trade-off between accuracy and calibration
- Applying the Brier score to gauge the reliability of confidence levels
- Recognizing scenarios where a decision model is not the appropriate tool
Requirements
- A foundational understanding of large language models and prompt-based applications.
- Proficiency with command-line interfaces and Python scripting.
- No prior experience in machine learning training is required.
Target Audience
- AI engineers assessing decision models for agent-based workflows.
- Software developers seeking to replace general LLM calls with more bounded, specific decisions.
- Solution and platform architects designing robust agent architectures.
- Technical product managers evaluating strategic options for decision models.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 1300 € + VAT*
Contact us for an exact quote and to hear our latest promotions
