/
← Accept All   週ごとのアーカイブ
InfoQ AIGitHub

Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens

9月3日
Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens

Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost. By Sergio De Simone

Model InferenceLarge language modelsAgentsPerformance
InfoQ AIで読む ↗

関連する記事

InfoQ AIの他の記事