Your team uses a TFX pipeline to train a recommendation model. You need to track the lineage from raw data ingestion through feature engineering to the final model artifact stored in Vertex AI Model Registry. Which Vertex AI service should you use to query this end-to-end lineage?
- A. Cloud Logging to search for pipeline execution logs and reconstruct lineage manually
- B. Vertex AI Pipelines' built-in lineage graph visualization (no additional service needed)
- C. Vertex AI Metadata (formerly ML Metadata) with the
aiplatform.LineageServiceClient✓ Correct - D. BigQuery metadata tables that TFX automatically populates during pipeline execution
Explanation
The correct answer is option 0. Vertex AI Metadata (built on MLMD—ML Metadata) is the dedicated service for tracking artifact and execution lineage in TFX and Vertex AI Pipelines. The LineageServiceClient provides programmatic access to trace data provenance. Option 1 is incorrect; Cloud Logging captures events but is not designed for structured lineage queries. Option 2 is misleading because while Pipelines show DAG visualization, the LineageServiceClient in Metadata is required for querying and programmatically accessing lineage. Option 3 is wrong; TFX does not automatically populate BigQuery metadata tables without explicit integration.