Ravi Sir's Cards › Generative AI
How do you control the cost of a Gen AI app?
Interview Q&A card: How do you control the cost of a Gen AI app? Cost mostly = tokens (text pieces) in and out × price per token. Control it by picking the smallest model that passes tests, keeping prompts short, limiting output length, caching repeated answers, and setting budgets and alerts.
Read card text
What this card says
Interview Q&A card: How do you control the cost of a Gen AI app? Cost mostly = tokens (text pieces) in and out × price per token. Control it by picking the smallest model that passes tests, keeping prompts short, limiting output length, caching repeated answers, and setting budgets and alerts.
Learn this in the lesson: Amazon Bedrock for Beginners: Your First Gen AI App on AWS