Does controlflow still shove everything in the sys...
# marvin-aid
Dave Aitel
10/16/2024, 11:05 AMDoes controlflow still shove everything in the system prompt ? I assume this would affect prompt caching discounts currently offered by Claude and openai ?
j
Jeremiah
10/16/2024, 4:08 PM
Instructions are in the system prompt; history is a series of messages
d
Dave Aitel
10/16/2024, 4:08 PMWhat about context ?
Dave Aitel
10/21/2024, 3:20 PM@Jeremiah FWIW my tests with Claude 3.5 Sonnet via VERTEX are working really well!
🙌 1