Arena · Data Science · LLMs & GenAI · advanced

Scaling to 150M embeddings

You need to serve approximate nearest-neighbour search over 150 million embedding vectors with p99 latency < 50ms. Walk through the architecture choices.

Sign in to see what a strong answer covers and to get AI feedback on your own.

Practice this question on PrepGraph