Skip to content

Release notes

0.3

0.3.2

New Features

  • Agent Observability (Configurable Tracing) - Turn on agent.observability.tracing to export run traces to Langfuse, LangSmith, Datadog, Braintrust, or a generic OTLP collector. Optionally capture run content and redact sensitive data, and get stable trace references plus runtime trace grouping that tie benchmark, bootstrap, CLI, and chat runs into a single trace for easy correlation and debugging. #833 #864 docs
  • Visual Artifacts: Dashboard Support - The new gen_visual_dashboard generates dashboard-style HTML (multi-chart card layouts) right from Chat, just like gen_visual_report, with local interactive preview served by datus --web — filters re-run live against your database, no SaaS backend required. Report and dashboard generation is also noticeably better: cleaner layouts, more reliable chart rendering (concurrent multi-chart queries to DuckDB no longer race), consistent use of the runtime ChartCard primitive, more accurate underlying data queries, support for more complex reports, and multi-round refinement. The compiled HTML's absolute path is now surfaced in the CLI message stream, so you can reopen the artifact after closing the browser tab. #829 #835 #842 #847 #848 #849 #853 #855 #863 #866 #867 #869 #894 #895 #901 #905 #907 docs
  • Mid-Run User Input - Send additional instructions while an agent run is still streaming — type in the CLI/TUI or POST to the API; the text is picked up on the model's next step, saved to the session, and shown live as it is inserted, without interrupting the run. #824

Enhancements

  • Semantic SQL Metric Extraction - When mining metrics from historical SQL, Datus tells apart brand-new metrics, metrics derived from existing ones, and plain references to existing metrics, so it won't create duplicates; it also keeps time grain, filters, and literal values. Supported metric types include count, distinct count, sum, average, min/max, conditional (filtered), ratio, expression, cumulative, and derived; for multi-table cases (cross-table calculations, non-equi joins, unions) it first combines the data into a single source and then defines metrics on top. End-to-end verified on a real warehouse (StarRocks): the generated metrics return the same values as the original SQL. #811
  • Smoother CLI Chat & Streaming - Fixes a duplicated last paragraph in the terminal when streaming through Claude's native API (plus a related session-resume parsing fix); chat history now renders through one unified path, so history, resume/rewind, and mid-run user inserts all display consistently, with user messages shown in a bordered panel for clearer separation. #837 #852

Bug Fixes

  • Phased Semantic-Model Validation - A semantic model can be validated before any metrics exist: the expected "no metrics yet" issue no longer aborts the flow, while genuine model errors still fail validation. #827 #850
  • Reliable Bootstrap Result Handling - Bootstrap flows now correctly recognize each step's generation result (including failures), so successful output is no longer dropped and failures are no longer silently swallowed. #831
  • Reference SQL Summary Path Resolution - Generated reference-SQL summary paths now resolve correctly across the different path forms; out-of-sandbox paths are safely skipped instead of crashing. #840
  • Print Mode No Longer Hangs on Permission Prompts - datus -p (the non-interactive print mode, used in CI and scripting) now runs under the workflow execution mode and dangerous profile — consistent with /bootstrap and other non-interactive flows — so ASK/EXTERNAL permission prompts that previously blocked waiting for a human responder short-circuit cleanly. #891

0.3.1

New Features

  • HTML Report Generation - New gen_visual_report subagent turns a question, a metric reference, or your own SQL into a self-contained HTML report (KPI cards, charts, tables, narrative) with section-by-section editing so you can refine a single chart without rewriting the whole report. #783 #821 docs
  • Persistent Plan Mode - Plan Mode now writes plan.md to disk and restores it on session resume, so closing the CLI mid-plan no longer loses your work. #772 docs
  • CLI / TUI Polish - Live todo sidebar tracks task progress at a glance, plus an inline command wizard, scroll-back search, mouse-drag selection copy, and a draggable scrollbar for a more native terminal feel. #772

Enhancements

  • /permission Command - Renamed /profile to /permission, with normal / auto / dangerous modes for matching different development workflows. #769 docs
  • Custom Subagent Management - Custom subagents can now be deleted via API or TUI, and the available-tools list per agent type is returned by a single backend source so SaaS and standalone UIs build and edit subagents consistently. #807 #812 docs
  • Per-Request Permission Mode - Chat requests can pick normal / auto / dangerous per call, so multi-tenant SaaS deployments stop polluting a shared default. #822 docs

Bug Fixes

  • Claude / Anthropic Parameter Conflict - Requests on the Claude / Anthropic route no longer fail when both temperature and top_p are sent in the same call. #817
  • Metric ID Collision Under Missing Subject Path - Same-named metrics across different subject trees now stay distinct when subject_path was previously absent from the metric id. #819

0.3.0

New Features

Datus API

  • FastAPI REST API - Layered service/model REST API with CLI entry, streaming Chat, task tracking, SQL execution stop, multi-select ask_user, success story persistence, knowledge base bootstrap, and request-side proxy source / interactive mode controls. #520 #538 #539 #551 #553 #555 #606 #610 docs
  • Model Discovery API - Model discovery, per-request model override, current model metadata, and ISO-8601 UTC timestamps. #643 #649 #700 docs
  • Chart Recommendation & Visualization API - Generate dashboard-ready visualizations from Datus Chat and external applications. #545 docs

Datus Chat & IM Gateways

  • Datus Chat (FastAPI Chatbot) - Replaced the legacy Streamlit chatbot with FastAPI + @datus/web-chatbot, adding the Datus Chat module. #543 #554 docs
  • Slack & Feishu/Lark Gateways - New IM gateways with channel configuration, daemon mode, streaming replies, and feedback actions; datus-claw renamed to datus-gateway. #559 #562 #565 #616 #623 #593 docs

Project & Workspace Configuration

  • Project-aware Configure/Init Flow - Split setup into project-aware configure/init flows with project-level .datus/config.yml, project memory, automatic datasource/service setup, and a redesigned .datus directory. #542 #578 #592 #608 docs
  • Unified Runtime Services Config - Unified configuration around services.datasources, services.bi_platforms, semantic layer, and scheduler; CLI now uses --datasource. #614 #633 #636 #642 docs
  • One-line Installer - New Linux/macOS curl | sh install script with refreshed quickstart and service docs. #613 #611 #667 docs

CLI Experience

  • Unified / Command Prefix - All interactive commands moved to / prefix; added /model, /skill, /mcp, /agent, /subagent, interactive input, and a streaming /bootstrap TUI. #621 #635 #650 #655 #656 #659 #683 docs
  • /language and /effort Commands - Pin response language with /language, control reasoning effort with /effort, plus /<service>.<method> dispatch for read-only service calls. #641 #653 #631 docs
  • CLI Print Mode & UX Polish - Print mode, proxy tools, reworked bottom status bar, fixed streaming/tool status line, improved markdown streaming, and restored @ reference auto-completion. #489 #501 #583 #586 #654 #664 #661 #662 docs
  • New Model & Plan Providers - Codex OAuth, Claude Subscription, Coding Plan, OpenRouter, MiniMax, GLM, BigModel, Z.AI support, with rebuilt provider-based model configuration and provider catalog. #487 #635 #687 #693 docs
  • Permission Profiles - New normal / auto / dangerous permission profiles with subagent-aware permission hooks; safe discovery tools relaxed in normal mode. #646 #652 docs

Data Engineering Subagents & Skills

  • Data Engineering Agents & Skills - Built-in agents and skills for cross-database migration, ETL/job generation, scheduler workflows, table generation, dashboard generation, and BI/scheduler orchestration. #494 #525 #564 #575 #580 #639 docs
  • Deliverable Validation Hooks - Table deliverable validation hook, shared deliverable node, validation skills, and a publish gate for semantic/metric generation. #657 #663 #665 docs
  • Natural-language Metrics & Skill Creator - Natural-language metric creation, wheel-bundled built-in skills, skill frontmatter scope, and a skill-creator subagent for interactive skill authoring. #504 #526 #627 #645 #676 docs

Memory & Reference Template

  • Auto Memory - New MEMORY.md-based Auto Memory with an emergent topic tree, empty-memory prompt, and project/session isolation. #498 #620 #595 #523 #594 docs
  • Reference Template - New Reference Template mechanism, with bootstrap reference template parsing fixes. #508 #574 #677 docs

Ecosystem & Adapters

  • Datus Studio (VSCode Extension) - Official VSCode extension that brings Datus into the IDE: Object Explorer (Catalog/Context trees), SubAgent wizard, Datus Chat panel with @-references, plan mode, datasource/subagent switching, SQL Result & AI Chart panel (ECharts), and workspace-scoped FileSystem tools. Connects to any Datus-agent Web Server (datus-cli --web) via a single Endpoint. #713 #717 docs
  • Database Adapters: Greenplum & Migration Mixin - datus-db-adapters added Greenplum, improved metadata robustness, thread-safe connector isolation, dialect-specific identifier quoting, and a MigrationTargetMixin for migration workflows. datus-db-adapters#40 #43 #45 #46 #47 #48 docs
  • BI Adapters: Superset & Grafana - New datus-bi-core with Superset and Grafana adapters, list API, chart data retrieval, dashboard/chart write validation, paginated envelope, datasource metadata fixes, and dashboard layout improvements. datus-bi-adapters#1 #2 #3 #7 #8 #9 docs
  • Scheduler Adapters: Airflow - New datus-scheduler-core and Airflow adapter with DuckDB DAG execution, multi-tenant DAG folder, job/run list result envelope, and inactive DAG deletion semantics; published as datus-scheduler-airflow 0.1.2. datus-scheduler-adapters#2 #3 #4 #8 #9 docs
  • Semantic Adapter Split - datus-semantic-adapter split out datus-semantic-core and migrated the MetricFlow adapter, with dict config injection, adapter contract tests, datasource terminology, configurable semantic model paths, and stricter MetricFlow validation. datus-semantic-adapter#6 #7 #9 #10 docs

Enhancements

  • Streaming & Session Stability - Fixed and enhanced web/chat/gateway streaming, compact/resume, group chat thread handling, Feishu permissions, Slack replies, API node creation, session persistence, and timestamp formats. #531 #548 #567 #568 #638 #674 #680 #689 #700 docs
  • Generation Stability - Improved semantic, metric, reference-template, dashboard, SQL prompt, and query-metric generation. #596 #604 #690 #691 #692 #697 docs
  • Filesystem & Data Isolation - Strengthened via filesystem_strict, project-root zone policy, safe search, credential redaction, and strict FuncTool result handling. #588 #597 #603 #681 #694 docs
  • Storage Refactor - Unified datus_db, datasource isolation, singleton registry, pluggable RDB/vector backends, and PostgreSQL support via datus-storage-postgresql. #493 #499 docs
  • CI Restructure - Split PR acceptance and nightly pipelines, added docker-backed adapter integration tests and a test-quality audit workflow, and resolved multiple nightly/unit/integration regressions. #589 #600 #601 #634

Documentation

  • REST API, IM Gateway & CLI Docs - New docs for REST API deployment / chat / KB / models, Slack & Feishu IM gateways, and /model / /language / /effort / /init / /bootstrap / service / --datasource flows. docs
  • Configuration Docs - Added datasources, semantic layer, BI platforms, schedulers, and PostgreSQL-backed storage configuration docs. docs
  • Subagent Docs - Dashboard generation, table generation, scheduler workflow, data pipeline, metrics, semantic model, and SQL summary subagent docs. docs
  • Adapter, Memory & Reference Template Docs - Refreshed adapter, memory, reference template, quickstart, benchmark, and docs-deployment documentation. #530 #536 #549 #556 #611 #622 #667 docs

0.2

0.2.6

New Features

  • Ask User Tool - Introduced an interactive ask_user tool with inline free-text support and batch question capabilities, integrated into GenSQL and GenReport nodes for human-in-the-loop workflows. #457 #460 #481
  • Skill Marketplace CLI - Built-in marketplace for discovering, installing, and managing community skills directly from the CLI. #416 docs
  • General Chat Agent - A general-purpose chat agent for flexible conversational workflows beyond SQL generation. #452
  • Explore Task Tool - New exploration tool for navigating and managing tasks within the agent. #455
  • Storage Adapter - Pluggable storage adapter layer for flexible backend integration. #446
  • 4 New Database Adapters - Added ClickHouse, Hive, Spark, and Trino adapters in the datus-db-adapters repository, all installable as independent packages via pip install datus-<database>. docs

Enhancements

  • Session Resume/Rewind - Added /resume, /rewind, and .interrupt commands with interactive arrow-key selector for navigating conversation history. #438 #470 docs
  • Scoped Context Filter - Filter-based scoped context for more precise knowledge retrieval during SQL generation. #441
  • Direct Subagent Web Access - New --subagent CLI parameter for launching subagents directly via the web interface. #447
  • CLI Interaction UX - Improved multiline input support and ellipsis truncation for better readability. #468
  • Simplified Subagent Guidance - Streamlined subagent usage instructions for clearer onboarding workflows. #469
  • Hardened Function Tools - Enforced read-only SQL execution, deduplicated tool registration, and improved docstrings. #474
  • Current Date Injection - Injected current_date directly into system prompts, removing the separate get_current_date tool. #473
  • Data Compression - Added response compression for query_metrics and fixed DataCompressor model_name handling to reduce token consumption. #435 #472

Bug Fixes

  • Kimi-K2.5 & Qwen3-Coder-Plus Init - Fixed temperature/top_p support for these models during interactive initialization. #483
  • Generation Hooks Condition - Fixed generation_hooks to use correct where expression condition. #482
  • Ctrl+O Toggle - Fixed missing response display for previous turns when toggling with Ctrl+O. #477
  • Missing Tabulate Dependency - Added missing tabulate dependency to pyproject.toml and requirements.txt. #476
  • Skill Scan Paths - Removed ~/.claude/skills from default scan paths and improved config passing for ChatAgenticNode. #475

Documentation

  • Added Hive, Spark, ClickHouse, Trino database adapter docs. #464 docs
  • Added resume/rewind command documentation. #465

0.2.5

New Features

  • OpenAI Agent SDK 0.7.0 Upgrade with Kimi-2.5 & Gemini-3 Support - Rebuilt the model layer with litellm_adapter and sdk_patches, enabling seamless integration with the latest Kimi-2.5 and Gemini-3 series models.
  • AgentSkills Support - Introduced a complete Skill system with skill configuration, registration, management, and permission control, supporting both bash and function-based skill tools. docs
  • Tools as MCP Server - Expose Datus database tools and context search as an MCP server, enabling integration with Claude Desktop, Claude Code, and other MCP-compatible clients. docs

Enhancements

  • Knowledge Generation Iteration - Enhanced the external knowledge node with improved knowledge storage and more accurate context search. docs
  • Semantic Tools Optimization - Optimized semantic tools and context search for faster, more relevant results in the CLI.
  • Generation Prompt String Validation - Strengthened string validation across multiple prompt templates for more reliable generation output.
  • Action-Based User Interaction Model - Redesigned the CLI interaction layer to use a unified action-based model for execution, generation, and planning.
  • Reference SQL Parallelization & Date Support - Parallelized reference SQL initialization for faster bootstrap, and enhanced date expression parsing. docs
  • Bootstrap Markdown Summary - Displays a formatted Markdown summary after bootstrap completion for quick review of generated results. docs
  • Subject Entry Deletion - Added the ability to delete semantic models, metrics, and SQL summaries directly from the /subject screen. docs

Bug Fixes

  • Subject Node Race Condition - Fixed a race condition when creating multiple subject nodes in parallel, improving concurrency safety.
  • Multi-Round Benchmark Evaluation - Resolved issues in agent state, workflow runner, and configuration handling during multi-round evaluations. docs
  • Attribution Analysis - Simplified attribution analysis logic for clearer and more reliable results.

0.2.4

Dashboard Copilot (Auto-generation)

  • Dashboard to Sub-Agent: Automatically generate sub-agents from BI dashboard configurations #339
  • Automatic semantic model generation during BI dashboard bootstrap #368
  • Generate metrics definitions directly from Dashboard components #363

Better Semantic Layer Integration

  • Semantic Adapter: Pluggable adapter for external metric layer integration #355
  • External Knowledge Storage: Vector-based knowledge retrieval for enhanced SQL generation context #359
  • Added SQL field to metrics schema definition #364

Enhancements

  • Optimized reference SQL search with deduplication and simplified format #348 #358 #375
  • Enhanced ContextSearch methods and display #347
  • Improved Plan Mode: Chat node inherits from GenSQL agentic node #334
  • Catalog screen improvements: column comments and nested table row styles #345 #378
  • Tool execution feedback with context and start events #340 #341
  • Enhanced prompt version handling #367 #379
  • Clean deprecated metric metadata and YAML directory on overwrite #362 #365

Refactoring

  • Semantic model and metrics architecture refactor #350
  • Unified subject tree management #349
  • Pluggable DB adapter architecture #353
  • Namespace config refactor #346

Bug Fixes

  • Fixed empty query_context in Superset charts #372
  • Skip render processing for tool calls in chatbot #360 #380
  • Fixed semantic model and metrics deduplication #369
  • Fixed subject_path parsing in context_search #357
  • Improved sample row error handling #354

0.2.3

New Features

  • Embedded Tutorial Dataset - California Schools dataset now bundled with installation and integrated into datus-agent init workflow for hands-on learning of contextual data engineering. #277 tutorial
  • Enhanced Evaluation Framework - New evaluation command with expanded categories: Exact Match, Same Result Count (different values), Schema/Table Usage Match, and Semantic/Metric Layer Correctness. #264
  • Plugin-Based Database Connector - Refactored database connector to plugin-based architecture for easier extensibility and custom adapter development. #284

Enhancements

  • Simplified Installation - Removed legacy transformers dependency from default installation for faster setup and reduced package size. #247
  • Streamlined MetricFlow Configuration - Simplified configuration as MetricFlow now natively supports Datus config format. #243
  • Built-in Generation Commands - /gen_semantic_model, /gen_metrics, and /gen_sql_summary subagents now work out of the box without additional setup. #250
  • Agentic Node Integration - Workflow-based evaluations now support agentic nodes for more sophisticated testing scenarios. #262
  • Code Quality Improvements - Refactored tool modules and enhanced node logic. Unified bootstrap-kb and gen_semantic_model to use the same implementation. #245 #250
  • Optimized Embedding Storage - Refactored embedding model storage and updated dependencies for better performance. #247

Bug Fixes

  • Schema Metadata Handling - Fixed empty definition field in schema_linking command to ensure proper schema metadata is passed to downstream nodes. #327
  • Initialization Issues - Resolved multiple initialization bugs and corrected configuration file validation for tutorial mode. #304 #303
  • Environment Variable Compatibility - Fixed environment variable handling across different platforms for improved deployment compatibility. #294
  • Evaluation Summary Generation - Fixed summary generation in benchmark evaluation for more accurate evaluation reports. #314
  • FastEmbed Cache Directory - Fixed cache directory path for fastembed to resolve caching issues on different platforms. #251

0.2.2

skipped

0.2.1

New Features

  • Web Chatbot Upgrade - Added feedback collection, issue reporting, stream output, and &hide_sidebar=true parameter for embedding. docs
  • Context Generation Commands - New /gen_semantic_model, /gen_metrics, and /gen_sql_summary commands in subagents for dynamic knowledge base enrichment. #192 docs
  • Interactive Context Editing - Visual editing support for /catalog and /subject commands to modify semantic models, metrics, and SQL summaries. #219 #199 #175 docs
  • Scoped Knowledge Base - Subagents now support scoped KB initialization for better context isolation and management. #217

Enhancements

  • MetricFlow Integration - Load configuration from env_settings.yml, improved project detection, and cleaner output formatting. #214 #216 docs
  • Flexible Model Configuration - Support for multiple model providers and specifications in agent configuration. #195
  • CLI Display Improvements - Enhanced table width rendering for better SQL query readability. #200
  • Improved Initialization - Enhanced datus-agent init command with better error handling and setup flow. #194

Dependency Changes

  • openai-agents upgraded to 0.3.2 (requires manual update: pip install -U openai-agents)
  • datus-metricflow updated to 0.1.2

0.2.0

Enhanced Chat Functionality

  • Advanced multi-turn conversations for seamless interactions. #91
  • Agentic execution of database tools, file system operations, and automatic to-do list generation.
  • Support for both automatic and manual compaction (/compact). #125
  • Session management with /resume and /clear commands.
  • Provide dedicated context by introducing it with the @table, @file, @metrics, @sql_history commands. #134 #152
  • Token consumption tracking and estimation for better resource visibility. #119
  • Write-capability confirmations before executing sensitive tool actions.
  • Plan Mode: An AI-assisted planning feature that generates and manages a to-do list. #147

Automatic Knowledge Base Building

  • Automatic generation of Metric YAML files in MetricFlow format from historical success stories. #10
  • Automatic summary and labeling SQL history files from *.sql files in workspace. #132
  • Improves SQL accuracy and generation speed using metrics & SQL history.

MCP Extension

  • New /mcp commands to add, remove, list, and call MCP servers and tools. #54

Flexible Workflow Configuration

  • Fully customizable workflow definitions via agent.yml.
  • Configurable nodes, models, and database connections.
  • Support for sub-workflows and result selection to improve accuracy. #88

Context Exploration

  • Improve /catalog to display all databases, schemas, and tables across multiple databases.
  • New /subject to show all metrics built with MetricFlow. #165
  • Context search tools integration to enhance recall of metadata and metrics. #138

User Behavior Logging

  • Automatic collection of user behavior logs.
  • Transforms human–computer interaction data into trainable datasets for future improvements.

0.1

0.1.0

Datus-cli

  • Supports connecting to SQLite, DuckDB, StarRocks, and Snowflake, and performing common command-line operations.
  • Supports three types of command extensions: !run_command, @context, and /chat to enhance development efficiency.

Datus-agent

  • Supports automatic NL2SQL generation using the React paradigm.
  • Supports retrieving database metadata and building vector-based search on metadata.
  • Supports deep reasoning via the MCP server.
  • Supports integration with bird-dev and spider2-snow benchmarks.
  • Supports saving and restoring workflows, allowing execution context and node inputs/outputs to be recorded.
  • Offers flexible configuration: you can define multiple models, databases, and node execution strategies in Agent.yaml.

0.1.2

Datus-cli

  • Added a fix node: use !fix to quickly fix the last SQL error, with a focused template for the LLM.

Datus-agent

  • Performance improvement for bootstrap-kb with multi-threading.
  • Other minor bug fixes.

0.1.3

Datus-cli

  • Added datus-init to initialize the ~/.datus/ directory.
  • Included a sample DuckDB database in ~/.datus/sample.

Datus-agent

  • Added the check_result option to the output node (default: False).

0.1.4

Datus-agent

  • Added the check-mcp command to confirm the MCP server configuration and availability.
  • Added support for both DuckDB and SQLite MCP servers.
  • Implemented automatic installation of the MCP server into the datus-mcp directory.

0.1.5

Datus-agent

  • Automated semantic layer generation.
  • Introduced a new internal workflow: metrics2SQL.
  • Added save_llm_trace to facilitate training dataset collection.

Datus-cli

  • Enhanced !reason and !gen_semantic_model commands for a more agentic and intuitive experience.