EmbeddingGemma 2 on Cloud Run: an int8 CPU Service Against an NVIDIA L4
DEV Community
EmbeddingGemma 2 on Cloud Run: an int8 CPU Service Against an NVIDIA L4
Step by step deployment of Google's EmbeddingGemma 2 text embeddings to Cloud Run, on a 1 vCPU instance with an int8 repack and on an NVIDIA L4, with tests, a semantic search demo, benchmarks and a cost per million documents.
0 comments
No comments yet.