the.bay.news

How to compact LLM prompt

Discussions on Python.org
How to compact LLM prompt
How can we compact LLM prompts that is huge and token heavy? I have a case where I need to set many rules to normalize results, which is not possible with regex so using KIMI as LLM. Prompt became 300 lines and hit token limit so had to chunk. WHat is the best solution in this case?

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.