Skip to content

v1.4.10

Terminal window
npx -y @maximhq/deepintshield --transport-version v1.4.10
DeepIntShield(HTTP) 1.4.10
  • Response Header Forwarding β€” Forward provider response headers back to clients for all providers
  • Streaming Compression β€” Added streaming compression support for provider responses
  • Bedrock Invoke & Count Tokens β€” Added bedrock invoke support and count tokens for bedrock provider
  • Async Rerank β€” Added async support for rerank requests
  • Dashboard Graphs β€” Added new dashboard graphs and graph fixes
  • Gzip for Azure Speech β€” Added gzip compression for azure speech streams
  • Grayswan Guardrails β€” Added grayswan guardrails configuration
  • E2E Tests β€” Added e2e tests for API
  • Azure Managed Identity β€” option to provider key form (DefaultAzureCredential when no API key or Entra ID)
  • Bedrock STS AssumeRole β€” support (role_arn, external_id, session_name) in key config for cross-account access
  • Parallel Tool Call Deltas β€” Route parallel tool call argument deltas by id/index to prevent argument merging during streaming (thanks @KTS-o7!)
  • Count Tokens Route β€” Count tokens route fixed to match OpenAI schema

    ⚠️ Warning: Breaking change. The count tokens route has moved from /v1/count_tokens to /v1/responses/input_tokens, and the request body field has been renamed from incorrect messages to input. Please update your clients accordingly.

  • Cached Tokens Handling β€” Standardized cached tokens handling for all providers

    ℹ️ Note: Breaking change. Cache tokens moved from usage top-level into prompt_tokens_details (Chat) and input_tokens_details (Responses), with standardized keys. If you have persisted data (logs, analytics, or custom storage), migrate: (1) move usage.cache_read_input_tokens β†’ usage.prompt_tokens_details.cached_read_tokens or usage.input_tokens_details.cached_read_tokens; (2) move usage.cache_creation_input_tokens β†’ usage.prompt_tokens_details.cached_write_tokens or usage.input_tokens_details.cached_write_tokens.

  • Team update fixes team update flow by handling nil customer id
  • Bedrock Integration Routing β€” Added missing routing logic for bedrock integration
  • Nil Tool Properties β€” Handle nil properties in tool function parameters
  • Logprobs JSON Tag β€” Fixed logprobs JSON tag in DeepIntShieldResponseChoice (thanks @robechun!)
  • Provider Deletion β€” Fixed delete providers bug, empty provider list bug, and deleting provider not loaded in memory
  • Data Connectors β€” Fixed enabling/disabling data connectors
  • OpenRouter Keys β€” Added proper status check for openrouter keys
  • Governance Virtual Key β€” Added governance wrong virtual key check
  • Pricing Config β€” Normalized framework pricing config
  • Model Limit Validation β€” Fixed model limit form validation
  • Dashboard Height β€” Minor dashboard height fix
Core 1.4.6
  • feat: added response header forwarding for providers
  • feat: added streaming compression support for providers
  • feat: added bedrock invoke and count tokens support
  • feat: added gzip compression for azure speech streams
  • feat: add Azure DefaultAzureCredential support β€” use managed identity when no API key or Entra ID credentials provided
  • feat: add Bedrock STS AssumeRole support (role_arn, external_id, session_name) in key config for cross-account access
  • fix: standardized cached tokens handling across all providers

    ℹ️ Note: Breaking change. Cache tokens moved from usage top-level into ChatPromptTokensDetails (prompt_tokens_details) and ResponsesResponseInputTokens (input_tokens_details), with standardized keys. If you have persisted data (logs, analytics, or custom storage), migrate: (1) move usage.cache_read_input_tokens β†’ usage.prompt_tokens_details.cached_read_tokens or usage.input_tokens_details.cached_read_tokens; (2) move usage.cache_creation_input_tokens β†’ usage.prompt_tokens_details.cached_write_tokens or usage.input_tokens_details.cached_write_tokens.

  • fix: handle nil properties in tool function parameters
  • fix: fixed logprobs JSON tag in DeepIntShieldResponseChoice (thanks @robechun!)
  • fix: added proper status check for openrouter keys
Framework 1.2.25
  • feat: added response header forwarding support
  • feat: added new dashboard graphs and graph fixes
  • feat: added bedrock invoke streaming support
  • fix: standardized cached tokens handling
  • fix: preserve parallel tool call deltas during streaming (thanks @KTS-o7!)
  • fix: added proper status check for openrouter keys
  • chore: bump core to 1.4.6
governance 1.4.26
  • feat: added governance wrong virtual key check
  • feat: added streaming compression support
  • fix: added bedrock integration support for routing in governance
  • chore: bump core to 1.4.6 and framework to 1.2.25
jsonparser 1.4.25
  • chore: bump core to 1.4.6 and framework to 1.2.25
litellmcompat 0.0.15
  • chore: bump core to 1.4.6 and framework to 1.2.25
logging 1.4.25
  • feat: added response header forwarding support
  • feat: added new dashboard graphs
  • fix: count tokens route fixes
  • chore: bump core to 1.4.6 and framework to 1.2.25
maxim 1.5.24
  • chore: bump core to 1.4.6 and framework to 1.2.25
mocker 1.4.25
  • chore: bump core to 1.4.6 and framework to 1.2.25
otel 1.1.25
  • chore: bump core to 1.4.6 and framework to 1.2.25
semanticcache 1.4.24
  • fix: DefaultCacheKey dropped during JSON unmarshal (thanks @Georgehe4!)
  • chore: bump core to 1.4.6 and framework to 1.2.25
telemetry 1.4.26
  • chore: bump core to 1.4.6 and framework to 1.2.25