sanitation@lemmy.today to Programmer Humor@programming.dev · 2 days agoNew compression techniquelemmy.todayexternal-linkmessage-square120fedilinkarrow-up1993file-text
arrow-up1993external-linkNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 2 days agomessage-square120fedilinkfile-text
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up3·2 days agoSaves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareRooster326@programming.devlinkfedilinkarrow-up1·1 day agoIt’s an accounting trick. It uses a different budget…
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·edit-22 days agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It’s an accounting trick. It uses a different budget…
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol