Listing Thumbnail

    NanoOrch

     Info
    Deployed on AWS
    A self-hosted, multi-tenant platform for orchestrating AI agents across OpenAI, Anthropic, Gemini, on-prem Ollama, and vLLM (on-prem GPU clusters) , with 3-tier role-based access control, per-workspace resource limits, Docker-isolated task execution, real-time monitoring, approval gates, pipeline/DAG chaining, observability dashboards with utilization threshold alerts, scheduled jobs, two-way Slack/Teams/Google Chat messaging (inbound messages routed to agents, replies posted back to the thread), channel-based delivery for heartbeats/pipelines/jobs/triggers, outbound notifications, cloud integrations (AWS/GCP/Azure/Teams/Slack/Google Chat), DevTools integrations (Jira/GitHub/GitLab), RAGFlow knowledge base support, and a chat UI with @agent mentions.

    Overview

    NanoOrch is a self-hostable, multi-tenant AI orchestration platform that lets teams build, deploy, and monitor intelligent agent workflows without handing control to a third-party cloud. From a single UI, you can run autonomous agents, chain them into pipelines, trigger them from webhooks or cron schedules, and supervise every action they take.

    Multi-tenant workspaces keep teams, projects, or customers fully isolated. A global admin governs the platform , capping resource limits per workspace, restricting which AI providers are permitted, and managing users through a 3-tier RBAC model (global admin, workspace admin, member). SSO is supported via OIDC or SAML 2.0, with automatic user provisioning on first login.

    Orchestrators and agents are the core building blocks. Each workspace can run multiple orchestrators , each with its own AI provider, model, and system prompt , and each orchestrator can host multiple agents with individual instructions, memory, temperature settings, and tool access. NanoOrch supports five AI providers out of the box: OpenAI, Anthropic, Gemini, Ollama, and vLLM. Orchestrators also support model failover: if the primary model fails, a backup kicks in automatically, with exponential backoff retry logic.

    Tasks can be submitted through the UI, a webhook endpoint, an API key channel, or a scheduled cron job. Real-time log streaming via SSE keeps you informed as tasks execute. For high-impact write operations, approval gates pause execution mid-task and surface a pending approval in the sidebar , or push interactive Approve/Reject cards directly into a Slack thread or Microsoft Teams conversation so reviewers never need to leave their messaging app.

    Pipeline and DAG chaining lets you build sequential multi-step workflows where each step's output feeds as context into the next agent. Pipelines support cron scheduling, manual triggers, and per-run step history.

    Event-driven triggers connect NanoOrch to your development workflow. Webhook listeners fire agent tasks on GitHub push/PR events, GitLab push/merge events, or Jira issue updates, all HMAC-SHA256 verified with full event history. Git Agents take this further: connect a repo, drop a .nanoorch.yml file in the root, and NanoOrch automatically dispatches tasks on push or PR events and posts AI-generated feedback comments back to the PR.

    Two-way messaging turns NanoOrch into a conversational AI layer inside Slack, Microsoft Teams, or Google Chat. Enable a workspace as a comms workspace, and users can mention the bot or DM it , the message gets routed to an agent, and the reply lands in the same thread. Features include a DM allowlist, bypass phrases for approval gates, conversation history across the last 50 exchanges per thread, and built-in commands like /status, /reset, and /help.

    Integrations span cloud platforms (AWS, GCP, Azure), DevTools (GitHub, GitLab, Jira), ITSM (ServiceNow), databases (PostgreSQL with a built-in read/write approval gate), and RAGFlow for knowledge base querying or auto-injected context. Messaging platforms: Slack, Teams, Google Chat can also be used as agent tools, not just inbound channels.

    Observability covers token usage and cost across all providers, with daily charts, per-agent breakdowns, and configurable threshold alerts dispatched to any outbound channel when rolling usage crosses a set limit.

    Code execution runs Python and JavaScript directly from chat inside a gVisor sandbox: fully network-isolated, read-only filesystem, memory and CPU capped. Action tasks run in ephemeral Docker containers for the same isolation guarantees.

    The MCP Server exposes NanoOrch's core capabilities: running tasks, checking status, approving requests, triggering pipelines: to Claude Desktop or any MCP-compatible client via a standard HTTP/SSE interface.

    All credentials (AI provider keys, cloud credentials, database connection strings) are stored AES-256-GCM encrypted. NanoOrch is designed to run entirely on your infrastructure, giving your team full data residency and control.

    Highlights

    • Intelligent Agent Workflows Run multiple orchestrators and agents per workspace, each with its own AI provider, model, system prompt, memory, and toolset. Chain agents into sequential pipelines where each step's output feeds the next. Built-in model failover with exponential backoff ensures reliability , if the primary model fails, a backup takes over automatically. Submit tasks via UI, webhook, API key, or cron schedule with real-time log streaming throughout.
    • Human-in-the-Loop Approvals & Two-Way Messaging Approval gates pause agent execution before high-impact operations, surfacing interactive Approve/Reject cards directly inside Slack threads or Microsoft Teams conversations : no context switching required. Enable any workspace as a comms workspace so users can DM or mention the bot in Slack, Teams, or Google Chat, with replies landing in the same thread and conversation history retained across 50 exchanges
    • Secure, Observable, and Fully Self-Hosted All credentials are stored AES-256-GCM encrypted. Code execution runs inside gVisor sandboxes; action tasks run in ephemeral Docker containers. A built-in observability dashboard tracks token usage and costs across all five AI providers : OpenAI, Anthropic, Gemini, Ollama, and vLLM , with per-agent breakdowns and configurable threshold alerts. NanoOrch runs entirely on your infrastructure for full data residency and control

    Details

    Delivery method

    Delivery option
    NanoOrch Deployement

    Latest version

    Operating system
    AmazonLinux 2023

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    This product is available free of charge. Free subscriptions have no end date and may be canceled any time.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Vendor refund policy

    Not Applicable

    How can we make this page better?

    Tell us how we can improve this page, or report an issue with this product.
    Tell us how we can improve this page, or report an issue with this product.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    NanoOrch Deployement

    This delivery option utilizes AWS CloudFormation to automatically provision a secure and scalable environment for NanoOrch.

    The template deploys the following infrastructure:

    • A new VPC with two public subnets across multiple Availability Zones.
    • An Internet Gateway and associated route tables.
    • An Application Load Balancer (ALB) to route HTTP traffic securely.
    • Strict Security Groups ensuring port 22 (SSH) is locked to your specified IP address, while port 80 is open to the ALB.
    • An EC2 instance running the pre-baked NanoOrch application via Docker Compose.

    Once the CloudFormation stack reaches the CREATE_COMPLETE status, you can access the NanoOrch admin dashboard via the Load Balancer DNS URL provided in the stack's Outputs tab. From there, you can navigate to the settings to input your preferred AI provider API keys (OpenAI, Anthropic, or Gemini) to fully activate the incident management orchestration features.

    Instance Type: t3.medium Usage Instructions: GIT HuB URL Parameters Name: NanoOrchAmiId

    CloudFormation Template (CFT)

    AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."

    Version release notes

    Released: May 5, 2026 We're excited to ship the first stable release of NanoOrch, a self-hostable, multi-tenant AI orchestration platform built for teams that need full control over their AI workflows. Core Platform: Multi-tenant workspace isolation with 3-tier RBAC (global admin, workspace admin, member), SSO support via OIDC and SAML 2.0 with automatic user provisioning, workspace-level resource limits and AI provider restrictions managed by global admins, collapsible sidebar with persistent layout preference. Agent & Orchestration: Multiple orchestrators per workspace with configurable AI provider, model, and system prompt, per-agent settings for instructions, temperature, memory, and tool access, model failover with exponential backoff retry, support for five AI providers (OpenAI, Anthropic, Gemini, Ollama, vLLM), AES-256-GCM encrypted credential storage for all provider keys. Pipelines & Scheduling: Sequential pipeline and DAG chaining with per-run step history, cron-based scheduled jobs with timezone support and manual trigger, task submission via UI, webhook, API key channel, or scheduled job, real-time SSE log streaming for all task executions. Approvals & Safety: Approval gates that pause execution before high-impact write operations, pending approvals in a dedicated sidebar with live badge counts, interactive Approve/Reject cards delivered natively into Slack threads (Block Kit) and Teams conversations (Adaptive Cards). Two-Way Messaging: Comms workspace mode supporting Slack, Microsoft Teams, and Google Chat as inbound channels, bot mention and DM routing with replies posted back in the same thread, DM allowlist, bypass phrases, typing indicator, and chat commands (/status /reset /compact /help), conversation history retained across last 50 exchanges per thread. Event-Driven Triggers & Git Agents: Webhook triggers on GitHub push/PR, GitLab push/merge, and Jira issue events with HMAC-SHA256 payload verification, Git Agent support via .nanoorch.yml that auto-dispatches tasks on push/PR and posts AI feedback comments back to the PR/MR. Integrations: Cloud platforms AWS, GCP, and Azure with agentic tool calling and AES-256-GCM encrypted credentials, DevTools covering GitHub (7 tools), GitLab (8 tools), and Jira (7 tools), ITSM via ServiceNow (9 tools), external PostgreSQL with read-only query and write execution behind a built-in approval gate, RAGFlow for knowledge base querying or auto-injected context. Observability: Token usage and cost dashboard across all 5 AI providers, daily usage charts with per-agent breakdowns and provider/model cost summaries, configurable per-workspace utilization threshold alerts dispatched to any outbound channel. Code Execution & Isolation: Python and JavaScript execution from chat inside a gVisor (runsc) sandbox, fully network-isolated with read-only filesystem and memory/CPU caps, action tasks run in ephemeral Docker containers. MCP Server: HTTP/SSE Model Context Protocol server at /mcp with 8 tools ,list_orchestrators, list_agents, run_task, get_task_status, list_pending_approvals, approve_request, trigger_pipeline, fire_scheduled_job , compatible with Claude Desktop and any MCP-enabled client. Chat & Member Experience: Per-workspace chat UI with @agent mention autocomplete and live streaming responses, clean member chat interface at /chat/:slug with no admin UI exposed, public pricing page at /pricing with OSS vs commercial plan comparison and billing toggle.

    Additional details

    Support

    Vendor support

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.