1. A team runs an Azure Machine Learning training pipeline nightly. Recently, a pipeline step that reads raw data from Azure Data Lake fails intermittently with transient network errors, causing the entire pipeline to restart from scratch. The team wants the pipeline to retry only the failed step without re-executing successful upstream steps. Which pipeline configuration option addresses this?
- A. Enable the 'reuse' (allow_reuse=True) setting on all steps so Azure ML caches completed step outputs and skips them on retry.✓ Correct
- B. Wrap the data-loading step in a try-except block and log the error to MLflow so the pipeline continues without that step's output.
- C. Configure the pipeline to run in 'debug' mode, which automatically retries failed steps up to three times.
- D. Split the pipeline into two separate pipelines: one for data preparation and one for training, and trigger the training pipeline only after the data pipeline succeeds.
Explanation
Setting allow_reuse=True on pipeline steps causes Azure ML to cache the output of each step keyed to its inputs and code. On a re-run (after fixing or retrying the failed step), all steps whose inputs and code are unchanged will be skipped and their cached outputs reused, so only the failed step re-executes. Option B would suppress the error and propagate incomplete data downstream, corrupting results. Option C is incorrect: Azure ML pipelines do not have a 'debug' mode that provides automatic step-level retry. Option D avoids the problem partially but introduces operational complexity and does not solve transient failures within a single pipeline run.