AWS Gen AI Challenge — Day 3

Retrieval Mechanisms for FM Augmentation:

Evaluation metrics for segmentation quality

1. Semantic similarity between sentences within each chunk using embedding models.
2. Apply topic modeling techniques to identify the primary topics within each chunk. Chunks with high cohesion demonstrate clear topic focus with minimal topic mixing. Use techniques like Latent Dirichlet Allocation(LDA) to analyze the topics and their distribution within the chunks.
3. Coherence scoring
4. Precision, Recall, F1 score