Generative AI Engineer Associate · 14% of the exam

Data preparation: free practice questions

5 sample questions from our 35-question bank for this domain — answers and explanations included. These are the same scenario-based style as the real Databricks exam.

1. An engineer stores product documentation chunks in a Delta table and uses Databricks Vector Search with a Delta Sync index. After running a pipeline that updates approximately 15% of the rows in the Delta table, the engineer observes that the Vector Search index is not reflecting the updates. Which of the following is the MOST likely cause?

  • A. The embedding column was not included in the Delta table's partition specification
  • B. Change Data Feed (CDF) was not enabled on the Delta table before the updates were written✓ Correct
  • C. The Vector Search index type should have been set to 'snapshot' instead of 'Delta Sync' for update-heavy workloads
  • D. The Delta table must be stored in Unity Catalog before Delta Sync can track row-level changes
Explanation

Delta Sync indexes rely on the Delta table's Change Data Feed (CDF) to identify which rows have been inserted, updated, or deleted since the last sync. If CDF was not enabled before the updates were written, those change records are not logged in the Delta log, and the Vector Search sync process has no way to detect which rows changed. As a result, the index is not updated. Option A is incorrect—partitioning has no effect on CDF or Vector Search sync behavior. Option C is incorrect—Delta Sync is the correct index type for incremental updates; snapshot indexes are less efficient for update-heavy workloads, not more. Option D is incorrect—while Unity Catalog is recommended, it is not a hard requirement for CDF to function; CDF is a Delta table feature that works in both Unity Catalog and hive_metastore contexts.

2. A team is configuring a Databricks Vector Search index to stay synchronized with a Delta table that is updated nightly with new customer support tickets. They want new tickets to become searchable as quickly as possible after each nightly load without manual intervention. Which index configuration BEST meets this requirement?

  • A. A snapshot index that is manually triggered after each nightly pipeline run
  • B. A snapshot index scheduled to refresh every 24 hours at a fixed time
  • C. A Delta Sync index with continuous sync enabled
  • D. A Delta Sync index with triggered sync scheduled to run nightly✓ Correct
Explanation

A Delta Sync index with triggered sync scheduled nightly aligns precisely with the nightly batch update pattern—it will automatically re-sync after each nightly Delta table load without requiring manual intervention, while also being efficient for a batch workload that doesn't need real-time streaming updates. A snapshot index that is manually triggered (option A) requires human intervention and doesn't satisfy the 'no manual intervention' requirement. A snapshot index on a fixed 24-hour schedule (option B) may miss the timing of the nightly load and is less flexible. A Delta Sync index with continuous sync (option C) would also work but is unnecessary and more expensive for a nightly batch pattern—triggered sync is the better fit.

3. After deploying a RAG pipeline, a team measures retrieval performance using an evaluation dataset of 200 question-document pairs. They observe high recall@10 (0.91) but low precision@3 (0.34). What does this indicate, and what is the BEST remediation?

  • A. The system retrieves too few relevant documents; the fix is to increase the number of chunks in the index
  • B. The embedding model is poor; replace it with a generative model for retrieval
  • C. The system retrieves most relevant documents somewhere in the top 10, but many non-relevant chunks contaminate the top 3 results; adding a re-ranker model to reorder retrieved candidates before passing them to the LLM is the best fix✓ Correct
  • D. Precision and recall cannot both be measured simultaneously; the evaluation methodology is flawed
Explanation

High recall@10 means the relevant document is present somewhere in the top 10 results. Low precision@3 means the top 3 results contain a high proportion of irrelevant chunks—the relevant content is not bubbling up to the very top. A re-ranker (cross-encoder) model takes the initial retrieval candidates and re-scores them for relevance to the query, improving precision at small k values. Option A is incorrect because recall is already high—more chunks in the index would likely worsen precision further. Option B misdiagnoses the problem and proposes an inappropriate fix; generative models are not retrieval mechanisms. Option D is false—precision and recall are standard, compatible retrieval metrics routinely measured together.

4. A team is choosing between semantic chunking and fixed-size chunking for a RAG pipeline over a large library of news articles. Semantic chunking in this context groups sentences together until a significant embedding-distance shift is detected. Which of the following is a significant DISADVANTAGE of semantic chunking compared to fixed-size chunking?

  • A. Fixed-size chunking always produces higher retrieval recall than semantic chunking
  • B. Semantic chunking requires running an embedding model during the chunking pipeline itself, adding computational cost and latency✓ Correct
  • C. Semantic chunking cannot be applied to text that has already been extracted from PDFs
  • D. Fixed-size chunking preserves topical coherence better than semantic chunking
Explanation

Semantic chunking detects topic shifts by embedding sentences or short passages and measuring cosine distance between adjacent embedding windows. This means the embedding model must be called at chunking time—before the final index is built—adding significant computational overhead and latency to the data preparation pipeline. Option A is incorrect—semantic chunking generally produces more coherent chunks and can improve retrieval recall; fixed-size chunking does not universally outperform it on recall. Option C is incorrect—semantic chunking works on any extracted text string regardless of its origin (PDF, HTML, plain text, etc.). Option D is incorrect—semantic chunking is specifically designed to preserve topical coherence by grouping semantically related content together; fixed-size chunking ignores semantic boundaries.

5. An engineer is preprocessing text extracted from a large corpus of HTML web pages before ingesting it into a Databricks Vector Search index. The raw extracted text contains navigation menu items, cookie consent banners, footer boilerplate, and repeated site-wide headers mixed with the actual article content. What is the MOST important cleaning step to perform before chunking and embedding this content?

  • A. Convert all text to lowercase to normalize token representations
  • B. Remove boilerplate and non-content elements such as navigation menus, headers, and footers✓ Correct
  • C. Tokenize the text using the same tokenizer as the embedding model
  • D. Split the text into fixed 256-token chunks immediately after HTML tag removal
Explanation

Removing boilerplate (navigation, footers, cookie banners, repeated headers) is the most critical cleaning step because these non-content elements add noise to embeddings, causing the vector index to return irrelevant results when similar boilerplate matches a query rather than actual article content. Lowercasing (option A) is a minor normalization that has little effect on modern transformer-based embedding models and does not address the core noise problem. Tokenizing with the embedding model's tokenizer (option C) is a technical step done internally by the embedding model, not a content-cleaning step. Immediately chunking after tag removal (option D) skips the necessary content filtering and perpetuates the boilerplate problem.

30 more questions in this domain

Practice the full bank with instant grading, flashcards, and a timed mock exam.

Start practicing free