📋 Sheet
Explore prompt caching
👤 Tejaswini📅 16/Apr🏃 13-26 April'26In Dev
- explore what it is: https://ai.google.dev/gemini-api/docs/caching and https://developers.openai.com/api/docs/guides/prompt-caching
This will require prompt re-writing where we may have to move all of the static context at the start.
IMPORTANT: Start with ONE of the prompt ONLY.
End goal expectation: can it make our responses faster + reduce cost + while preserving response quality (MOST IMPORTANT)
- End goal expectations need to be verifiable so make sure to share a sheet containing: user_message, old_ai_response, new_ai_response, chat_history (3-5 msgs prior to user message), response_time (time taken for new_ai_response to generate)
↪ MR: https://gitlab.com/sid6i7/beyondchats-node/-/merge_requests/65
🎯 Goal & proof
📋 SDLC actionables
SDLC checklist
In Sprint (2)
Kickoff call (optional) with owner
Confirm sprint label is set on the row