1. An ML engineer enables an inference table on a Model Serving endpoint serving a RAG chatbot. After generating several requests, they query the inference table in Unity Catalog but notice the table has not yet been populated. Which of the following is the MOST likely reason?
- A. Inference tables only capture requests when the endpoint workload_size is set to 'Large'.
- B. Inference logging writes data asynchronously and there may be a delay of a few minutes before records appear in the table.✓ Correct
- C. Inference tables require an additional paid add-on license that has not been enabled on the workspace.
- D. The chain model must be logged with mlflow.set_tag('inference_table', 'true') before inference logging will activate.
Explanation
Inference tables on Databricks Model Serving are populated asynchronously. There is a typical delay (often a few minutes) before request and response records appear in the Unity Catalog Delta table. This is expected behavior and does not indicate a configuration problem. Inference table availability is not gated by workload_size; it works across all sizes. There is no separate add-on license specifically for inference tables — it is a feature of the Model Serving product. No MLflow tag is required on the model artifact to enable inference logging; it is configured at the endpoint level.