v1.4.10
npx -y @maximhq/deepintshield --transport-version v1.4.10docker pull maximhq/deepintshield:v1.4.10docker run -p 8080:8080 maximhq/deepintshield:v1.4.10β¨ Features
Section titled ββ¨ Featuresβ- Response Header Forwarding β Forward provider response headers back to clients for all providers
- Streaming Compression β Added streaming compression support for provider responses
- Bedrock Invoke & Count Tokens β Added bedrock invoke support and count tokens for bedrock provider
- Async Rerank β Added async support for rerank requests
- Dashboard Graphs β Added new dashboard graphs and graph fixes
- Gzip for Azure Speech β Added gzip compression for azure speech streams
- Grayswan Guardrails β Added grayswan guardrails configuration
- E2E Tests β Added e2e tests for API
- Azure Managed Identity β option to provider key form (DefaultAzureCredential when no API key or Entra ID)
- Bedrock STS AssumeRole β support (role_arn, external_id, session_name) in key config for cross-account access
π Fixed
Section titled βπ Fixedβ- Parallel Tool Call Deltas β Route parallel tool call argument deltas by id/index to prevent argument merging during streaming (thanks @KTS-o7!)
- Count Tokens Route β Count tokens route fixed to match OpenAI schema
β οΈ Warning: Breaking change. The count tokens route has moved from
/v1/count_tokensto/v1/responses/input_tokens, and the request body field has been renamed from incorrectmessagestoinput. Please update your clients accordingly. - Cached Tokens Handling β Standardized cached tokens handling for all providers
βΉοΈ Note: Breaking change. Cache tokens moved from usage top-level into
prompt_tokens_details(Chat) andinput_tokens_details(Responses), with standardized keys. If you have persisted data (logs, analytics, or custom storage), migrate: (1) moveusage.cache_read_input_tokensβusage.prompt_tokens_details.cached_read_tokensorusage.input_tokens_details.cached_read_tokens; (2) moveusage.cache_creation_input_tokensβusage.prompt_tokens_details.cached_write_tokensorusage.input_tokens_details.cached_write_tokens. - Team update fixes team update flow by handling nil customer id
- Bedrock Integration Routing β Added missing routing logic for bedrock integration
- Nil Tool Properties β Handle nil properties in tool function parameters
- Logprobs JSON Tag β Fixed logprobs JSON tag in DeepIntShieldResponseChoice (thanks @robechun!)
- Provider Deletion β Fixed delete providers bug, empty provider list bug, and deleting provider not loaded in memory
- Data Connectors β Fixed enabling/disabling data connectors
- OpenRouter Keys β Added proper status check for openrouter keys
- Governance Virtual Key β Added governance wrong virtual key check
- Pricing Config β Normalized framework pricing config
- Model Limit Validation β Fixed model limit form validation
- Dashboard Height β Minor dashboard height fix
- feat: added response header forwarding for providers
- feat: added streaming compression support for providers
- feat: added bedrock invoke and count tokens support
- feat: added gzip compression for azure speech streams
- feat: add Azure DefaultAzureCredential support β use managed identity when no API key or Entra ID credentials provided
- feat: add Bedrock STS AssumeRole support (role_arn, external_id, session_name) in key config for cross-account access
- fix: standardized cached tokens handling across all providers
βΉοΈ Note: Breaking change. Cache tokens moved from usage top-level into
ChatPromptTokensDetails(prompt_tokens_details) andResponsesResponseInputTokens(input_tokens_details), with standardized keys. If you have persisted data (logs, analytics, or custom storage), migrate: (1) moveusage.cache_read_input_tokensβusage.prompt_tokens_details.cached_read_tokensorusage.input_tokens_details.cached_read_tokens; (2) moveusage.cache_creation_input_tokensβusage.prompt_tokens_details.cached_write_tokensorusage.input_tokens_details.cached_write_tokens. - fix: handle nil properties in tool function parameters
- fix: fixed logprobs JSON tag in DeepIntShieldResponseChoice (thanks @robechun!)
- fix: added proper status check for openrouter keys
- feat: added response header forwarding support
- feat: added new dashboard graphs and graph fixes
- feat: added bedrock invoke streaming support
- fix: standardized cached tokens handling
- fix: preserve parallel tool call deltas during streaming (thanks @KTS-o7!)
- fix: added proper status check for openrouter keys
- chore: bump core to 1.4.6
- feat: added governance wrong virtual key check
- feat: added streaming compression support
- fix: added bedrock integration support for routing in governance
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25
- feat: added response header forwarding support
- feat: added new dashboard graphs
- fix: count tokens route fixes
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25
- fix: DefaultCacheKey dropped during JSON unmarshal (thanks @Georgehe4!)
- chore: bump core to 1.4.6 and framework to 1.2.25
- chore: bump core to 1.4.6 and framework to 1.2.25