Deployment and Orchestration of ML Workflows1 / 5
An ML engineer is deploying a computer vision model that requires GPU inference. The model receives steady traffic during business hours but minimal traffic overnight. Which SageMaker deployment configuration optimizes cost while ensuring GPU availability during business hours?
CorrectIncorrect
Alex
Scheduled auto scaling allows you to proactively set endpoint capacity using cron-like expressions that match known traffic patterns (AWS Auto Scaling docs). For GPU workloads with predictable business-hours traffic, this avoids running expensive GPU instances 24/7 while ensuring capacity is pre-scaled before demand arrives. Serverless Inference does not support GPU instance types, making it unsuitable for GPU workloads. CPU instances lack the processing power required for computer vision inference, resulting in unacceptable latency. Batch Transform processes data in batches rather than serving real-time predictions, so it cannot handle incoming requests on demand.
Sourcedocs.aws.amazon.com
Follow-up answers are available in the app. Create a free account — no credit card required.
Question 1 of 5
Create a free account