Asking an LLM "are these two tickets duplicates?" costs $111 for 1,000 tickets and $11,130 for 10,000
DEV Community
Asking an LLM "are these two tickets duplicates?" costs $111 for 1,000 tickets and $11,130 for 10,000
Checking every pair of items with an LLM takes N(N-1)/2 calls, so ten times the data costs a hundred times as much. Labeling each item once and comparing only inside a label cut the GPT-5.6 bill about 20x on evenly spread data, and 5.5-8x on realistic, lopsided data.
0 comments
No comments yet.