Get in Touch
 Duration 14 hours

Course Outline

Foundations of Multimodal LLMs in Vertex AI

  • An overview of multimodal capabilities within Vertex AI
  • Exploring Gemini models and their supported modalities
  • Real-world use cases in enterprise and research sectors

Preparing the Development Environment

  • Configuring Vertex AI for multimodal workflow execution
  • Managing datasets that span multiple modalities
  • Hands-on lab: setting up the environment and preparing datasets

Long Context Windows and Advanced Reasoning

  • Comprehending long-context workflow mechanics
  • Applications in strategic planning and decision-making processes
  • Hands-on lab: implementing long-context analysis techniques

Architecting Cross-Modal Workflows

  • Synthesising text, audio, and image analysis
  • Chaining multimodal steps within automated pipelines
  • Hands-on lab: designing a comprehensive multimodal pipeline

Managing Gemini API Parameters

  • Configuring multimodal inputs and outputs effectively
  • Optimising inference speed and operational efficiency
  • Hands-on lab: fine-tuning Gemini API parameters

Advanced Applications and System Integrations

  • Developing interactive multimodal agents and assistants
  • Integrating external APIs and third-party tools
  • Hands-on lab: constructing a complete multimodal application

Evaluation and Continuous Iteration

  • Testing the performance of multimodal systems
  • Applying metrics for accuracy, alignment, and drift detection
  • Hands-on lab: evaluating and refining multimodal workflows

Conclusion and Future Directions

Requirements

  • Proficiency in Python programming
  • Practical experience in developing machine learning models
  • Working knowledge of multimodal data types, including text, audio, and images

Target Audience

  • AI researchers
  • Advanced software developers
  • Machine learning scientists

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 2600 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Provisional Upcoming Courses (Contact Us For More Information)

Related Categories