Aphrodite Engine - a serving engine in the vLLM lineage, now renamed Sonar, and what my two 16 GB cards would need from it
DEV Community
Aphrodite Engine - a serving engine in the vLLM lineage, now renamed Sonar, and what my two 16 GB cards would need from it
First, the finding that changes how this post should be read, because I checked it first: the...
0 comments
No comments yet.