ArisGlobal Cuts Generative AI Costs on Amazon Bedrock Using Prompt Caching
Life sciences tech provider ArisGlobal scaled its generative AI engine NavaX on Amazon Bedrock by optimizing prompt caching strategies to manage rising infrastructure expenses.
🔌Chips & HardwarePhoto: AWS Machine Learning Blog
Key points
- ArisGlobal scaled its life sciences AI engine NavaX using Amazon Bedrock.
- Compliance additions caused shared prompt prefixes to expand by 150 percent over six months.
- Reversing cache priorities from source documents to shared prefixes mitigated a 200 percent surge in per-case inference costs.
Life sciences technology provider ArisGlobal has optimized the inference architecture of its NavaX artificial intelligence engine on Amazon Bedrock, successfully curbing escalating operational expenses. NavaX, which automates adverse-event case processing for pharmaceutical companies, runs on Amazon Bedrock utilizing Anthropic’s Claude models. The system extracts roughly 130 data fields from complex, multipage medical documents to streamline drug safety workflows for enterprise clients.
As ArisGlobal onboarded new corporate clients, compliance mandates caused the shared prompt prefix—which contains system rules, extraction schemas, and few-shot examples—to expand by 150 percent over a six-month period, stretching from 72,000 to 180,000 tokens. Because the platform executes multiple sequential requests per case, this compounding prompt growth drove per-case inference costs up by more than 200 percent.
Initially, the system prioritized caching source documents, which left the expanding shared prompt prefix outside the cache and subject to repeated reprocessing. By reversing the request structure to prioritize the shared prefix for explicit cache checkpoints, ArisGlobal reduced effective input costs and successfully supported higher tenant volumes without incurring proportional financial growth.
What to watch next: Monitor how other enterprise SaaS providers implement prefix caching and explicit checkpoints on cloud-managed foundational models to control scaling expenses.
Read next
⚖️Regulation & PolicyOpenAI Partners with Chilean Ministry to Advance Public Sector AI
OpenAI has signed a non-binding agreement with Chile's science ministry to integrate artificial intelligence into public administration and support local startups.
🌐Work & SocietyAmbience Healthcare Expands Clinical AI Suite for Hospital Operations
Ambience Healthcare has launched new AI tools designed to assist hospital staff with patient rounding and discharge planning, aiming to improve both clinical efficiency a…
🧠AI AnalysisAI Models Vulnerable to Manipulation in Simulated Warfare Scenarios, Research Shows
New research reveals that leading AI models from firms like OpenAI and Anthropic can be manipulated into identifying civilian targets when prompted with game scenarios.
⚖️Regulation & PolicyAWS Highlights Enterprise Governance and AI Workspace Quick Ahead of re:Invent 2026
Amazon Web Services is spotlighting its workplace AI platform, AWS Quick, ahead of its upcoming re:Invent 2026 conference, emphasizing secure deployment across major ente…
🏢Big TechLoanPro Integrates Amazon Bedrock to Automate Loan Servicing Workflows
LoanPro has deployed a multi-agent AI assistant using Amazon Bedrock and Anthropic's Claude models to help lenders manage borrower accounts, resulting in a 15% reduction …
🏢Big TechGoogle Brings Wallet App to iOS Users Across the United States
Google has expanded the availability of its Wallet application to iOS devices in the U.S., allowing Apple users to store digital passes, tickets, and receipts.