About This Architecture

Kubeflow Training and Deployment Poller Flow orchestrates end-to-end ML model lifecycle management using Celery Beat schedulers on OCI. Training Poller monitors JOB_CREATED status every 60 seconds, dispatching check_training_status tasks per eligible job and handling failures (budget exceeded, 90-min timeout) or completion. Upon TRAINING_COMPLETED status, Deployment Poller takes over, registering models in MLflow and probing inference servers for up to 30 minutes before marking DEPLOYMENT_SUCCESS or DEPLOYMENT_FAILED. This two-stage polling architecture decouples training supervision from deployment validation, enabling reliable handoff to automated evaluation pipelines. Fork and customize this diagram on Diagrams.so to adapt polling intervals, timeout thresholds, or add model registry integrations. The 60-second beat interval balances responsiveness with resource efficiency for production ML platforms.

People also ask

How do you orchestrate Kubeflow model training and deployment with automatic status polling and MLflow integration on OCI?

This diagram shows a two-stage Celery Beat poller architecture: Training Poller monitors Kubeflow jobs every 60 seconds, handling failures and completion; Deployment Poller then registers models in MLflow and validates inference servers for up to 30 minutes before triggering automated evaluation. This decoupled approach ensures reliable model lifecycle management on OCI.

Kubeflow Training and Deployment Poller Flow

OCIadvancedKubeflowMLOpsCeleryMLflowmodel-deployment
Domain: Ml PipelineAudience: ML engineers and MLOps practitioners managing Kubeflow training and deployment workflows on OCI
0 views0 favoritesPublic

Created by

August 17, 2026

Updated

August 17, 2026 at 2:53 PM

Type

architecture

Need a custom architecture diagram?

Describe your architecture in plain English and get a production-ready Draw.io diagram in seconds. Works for AWS, Azure, GCP, Kubernetes, and more.

Generate with AI

AI-generated. Verify before production use. Learn more

Report this diagram