Vellum is coming to the AI Engineering World's Fair in SF. Come visit our booth and get a live demo!

Vellum Product Update | May & June

AI-powered features and easier ways to customize and build together, across both the SDK and visual builder.

6 min
Written by
Reviewed by
No items found.

Over the past two months, we’ve been focused on two core themes: launching AI-powered features and making it easier for teams to customize and collaborate across the SDK and visual builder.

You’ll see that in everything from running Custom Nodes directly in the UI, to new AI tools that help you write better prompts and document your work faster. We’ve also made it easier to bring in Docker images, standardize deployments, and fine-tune how your team builds and ships.

Here are the latest updates:

Run Custom Code Nodes in the UI

We’re building Vellum to give product engineering teams the building blocks they need to get started fast, with the flexibility to customize every part of the workflow together.

That’s why so far we’ve enabled Code Execution Nodes in the UI, and Custom Nodes in the SDK enabling you to execute any logic you need.

But until now, Custom Nodes created in the SDK couldn’t easily be used in the visual builder.

Today, you can run vellum workflows push [module] on any Workflow that features a Custom Node, and that Node will be runnable in the UI!

The UI has all support for this Workflow Node like ports, adornments, trigger behavior, expressive attributes and more.

Custom Docker Images & Nodes in the Visual Builder

As an extension to the above update, we’ve also enabled a way to bring SDK-defined Docker images into the visual builder (UI).

Docker images defined through the SDK are useful for pulling in your full repo or handling bespoke binaries that don’t play well with the supported SDK language. And now, you can build and push your image, and your Custom Nodes will automatically show up in the UI side panel, ready for anyone on your team to drop into a workflow.

To make it work, just include a vellum_custom_nodes folder in your Docker image containing your Node.

Additionally you can now run Workflows within a Custom Docker Image.

Run Workflows within a Custom Docker Image

Workflows that are SDK enabled can now be run in a Docker Image of your choice! By default, all Workflows run in our base image, vellumai/python-workflow-runtime:latest. You can now extend that base image to define a new Docker image, push it up to Vellum, then associate it with your Workflow:

AI-powered Features

We’re excited to launch our first AI powered features in Vellum. And what better way to start than by helping you write higher performing prompts and help you organize your work better!

Prompt Improver (Beta)

Now, you can use this feature to generate improved versions of your prompt directly from the Prompt Sandbox. This feature uses Anthropic under the hood and generates new prompts based on best practices. This feature is in beta and we would love to hear more feedback on how we can improve it!

AI-generated Workflow Descriptions

When editing a Workflow’s details, Vellum now auto-generates a draft description for any Workflow without one. Powered by AI, it looks at your Workflow’s structure, nodes, and metadata to give you a solid starting point, making it easier to document and helping new teammates get up to speed faster.

You can enable or disable both of these features from your Organization Settings under the “AI Features” section.

Global Default Release Tags

Previously, Vellum defaulted to the LATEST Release Tag when creating a Prompt or Workflow Deployment Node. Today, you can set your own global default Release Tag, like “production” or “staging”, so every new Deployment Node starts with the setup that matches your team's workflow.

Find it under Organization Settings > Advanced Settings > Default Tag Settings.

Configurable Data Retention Policies

Enterprise customers can now configure data retention policies for their organization. This new feature allows you to:

  • Set whether monitoring data is retained indefinitely (default) or for a specific time period
  • Choose from predefined retention periods (30, 60, 90, or 365 days)

Expression Inputs on Final Output Nodes

Previously, Final Output Nodes only allowed you to reference values like Node Outputs, Inputs, etc. Now, you can do more with these values and write an Expression to define the Final Output you want (Quick demo).

For example, you can use the accessor operator to reference an attribute in a json output from a Prompt Node by using this expression input: Output Value = Prompt[JSON].foo

Evaluation Updates

Edit Test Cases in a Resizable Side Drawer

We’ve improved the Evaluation Report table to make editing Test Cases easier and more intuitive.

Now, clicking an editable cell opens a side drawer where you can update variable values, switch between tabs, and navigate between rows. The new layout is cleaner, more spacious, and supports keyboard shortcuts for faster editing—perfect for working with complex Test Cases.

Duplicate Test Cases in Evaluation Reports

You can now duplicate Test Cases directly from the Evaluation Report UI, making it much faster to create slight variations without starting from scratch.

Bulk Apply Value to Test Cases

You can now efficiently apply a cell’s value to multiple Test Cases at once. A new icon button appears in each Test Case cell that, when clicked, opens a confirmation modal asking whether you want to apply the current cell’s value to all or selected test cases.

New Models

We’ve added support for the following models:

  • Vertex AI
    • Claude 4 Models
  • AWS Bedrock
    • Claude 4 Models
  • All Claude 4 models
  • All Gemini 2.5 models
  • OpenAI
    • GPT 4o Search Preview
    • GPT 4o Mini Search Preview
    • Codex Mini (Latest)
    • Support for OpenAI’s new Responses API endpoint
    • GPT-4o Audio Preview
  • Azure
    • DeepSeek v3 via Azure AI Foundry
    • GPT 4.1 and 4.5 Model via Azure OpenAI
    • Microsoft OmniParser V2

Other updates

Condensed Node View: You can now enable Condensed Node View from the Navigation Settings to streamline your workflow interface. This feature displays all Nodes in a more compact format, significantly reducing visual clutter and making it easier to navigate complex workflows with many Nodes (Quick Demo)

Redesigned Deployment Flow: We’ve redesigned the Deployment Flow for Prompt and Workflow Sandboxes with a cleaner layout, streamlined forms, and an improved Releases tab to make managing deployments and release tags more intuitive. You can also now add descriptions to your Prompt and Workflow deploymnts.

Global Search Navigation: You can now navigate Vellum using global search and keyboard shortcuts. Open global search by clicking the search bar or using cmd-K, then press / to display available navigation options and quickly jump to different sections of the platform without using your mouse.

Smart Labels for Node Input Variables: Previously, Node input labels remained static regardless of their content. Now, input labels automatically update to reflect the value or expression they contain, making your Workflows more intuitive and self-documenting. (Quick demo)

OpenAI Base64 PDF Files: We now support OpenAI Models newly added capability to use Base64 documents within API requests.

Structured Outputs and Json Mode Support for x AI Models: We have added the ability to have Grok models that are hosted on xAI to return responses in JSON format via an agnostic JSON Mode, or a formatted Structured Output.

Gemini Vertex AI Models Are Now Region Specific:  Gemini Vertex AI Models are now available as region-specific instances, giving you the flexibility to enable models in multiple regions and build more reliable workflows with fallback support.

ABOUT THE AUTHOR
Noa Flaherty
Co-founder & CTO

Noa Flaherty, CTO and co-founder at Vellum (YC W23) is helping developers to develop, deploy and evaluate LLM-powered apps. His diverse background in mechanical and software engineering, as well as marketing and business operations gives him the technical know-how and business acumen needed to bring value to nearly any aspect of startup life. Prior to founding Vellum, Noa completed his undergrad at MIT and worked at three tech startups, including roles in MLOps at DataRobot and Product Engineering at Dover.

ABOUT THE reviewer

No items found.
lAST UPDATED
Jul 1, 2025
share post
Expert verified
Related Posts
Product Updates
October 1, 2025
7
Vellum Product Update | September
Guides
September 30, 2025
15
A practical guide to AI automation
LLM basics
September 25, 2025
8 min
Top Low-code AI Agent Platforms for Product Managers
LLM basics
September 25, 2025
8 min
The Best AI Agent Frameworks For Developers
Product Updates
September 24, 2025
7 min
Introducing AI Apps: A new interface to interact with AI workflows
LLM basics
September 18, 2025
7 min
Top 11 low‑code AI workflow automation tools
The Best AI Tips — Direct To Your Inbox

Latest AI news, tips, and techniques

Specific tips for Your AI use cases

No spam

Oops! Something went wrong while submitting the form.

Each issue is packed with valuable resources, tools, and insights that help us stay ahead in AI development. We've discovered strategies and frameworks that boosted our efficiency by 30%, making it a must-read for anyone in the field.

Marina Trajkovska
Head of Engineering

This is just a great newsletter. The content is so helpful, even when I’m busy I read them.

Jeremy Hicks
Solutions Architect

Experiment, Evaluate, Deploy, Repeat.

AI development doesn’t end once you've defined your system. Learn how Vellum helps you manage the entire AI development lifecycle.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Build AI agents in minutes with Vellum
Build agents that take on the busywork and free up hundreds of hours. No coding needed, just start creating.

General CTA component, Use {{general-cta}}

Build AI agents in minutes with Vellum
Build agents that take on the busywork and free up hundreds of hours. No coding needed, just start creating.

General CTA component  [For enterprise], Use {{general-cta-enterprise}}

The best AI agent platform for enterprises
Production-grade rigor in one platform: prompt builder, agent sandbox, and built-in evals and monitoring so your whole org can go AI native.

[Dynamic] Ebook CTA component using the Ebook CMS filtered by name of ebook.
Use {{ebook-cta}} and add a Ebook reference in the article

Thank you!
Your submission has been received!
Oops! Something went wrong while submitting the form.
Button Text

LLM leaderboard CTA component. Use {{llm-cta}}

Check our LLM leaderboard
Compare all open-source and proprietary model across different tasks like coding, math, reasoning and others.

Case study CTA component (ROI)

40% cost reduction on AI investment
Learn how Drata’s team uses Vellum and moves fast with AI initiatives, without sacrificing accuracy and security.

Case study CTA component (cutting eng overhead) = {{coursemojo-cta}}

6+ months on engineering time saved
Learn how CourseMojo uses Vellum to enable their domain experts to collaborate on AI initiatives, reaching 10x of business growth without expanding the engineering team.

Case study CTA component (Time to value) = {{time-cta}}

100x faster time to deployment for AI agents
See how RelyHealth uses Vellum to deliver hundreds of custom healthcare agents with the speed customers expect and the reliability healthcare demands.

[Dynamic] Guide CTA component using Blog Post CMS, filtering on Guides’ names

100x faster time to deployment for AI agents
See how RelyHealth uses Vellum to deliver hundreds of custom healthcare agents with the speed customers expect and the reliability healthcare demands.
New CTA
Sorts the trigger and email categories

Dynamic template box for healthcare, Use {{healthcare}}

Start with some of these healthcare examples

Personalized healthcare explanations of a patient-doctor match
SOAP Note Generation Agent

Dynamic template box for insurance, Use {{insurance}}

Start with some of these insurance examples

AI agent for claims review and error detection
Insurance claims automation agent
Collect and analyze claim information, assess risk and verify policy details.

Dynamic template box for eCommerce, Use {{ecommerce}}

Start with some of these eCommerce examples

E-commerce shopping agent

Dynamic template box for Marketing, Use {{marketing}}

Start with some of these marketing examples

Competitor research agent
Scrape relevant case studies from competitors and extract ICP details.

Dynamic template box for Legal, Use {{legal}}

Start with some of these legal examples

PDF Data Extraction to CSV
Extract unstructured data (PDF) into a structured format (CSV).

Dynamic template box for Supply Chain/Logistics, Use {{supply}}

Start with some of these supply chain examples

Risk assessment agent for supply chain operations

Dynamic template box for Edtech, Use {{edtech}}

Start with some of these edtech examples

Turn LinkedIn Posts into Articles and Push to Notion
Convert your best Linkedin posts into long form content.

Dynamic template box for Compliance, Use {{compliance}}

Start with some of these compliance examples

No items found.

Dynamic template box for Customer Support, Use {{customer}}

Start with some of these customer support examples

Trust Center RAG Chatbot
Read from a vector database, and instantly answer questions about your security policies.

Template box, 2 random templates, Use {{templates}}

Start with some of these agents

React Agent for Web Search and Page Scraping
Gather information from the internet and provide responses with embedded citations.
SOAP Note Generation Agent

Template box, 6 random templates, Use {{templates-plus}}

Build AI agents in minutes

Risk assessment agent for supply chain operations
Turn LinkedIn Posts into Articles and Push to Notion
Convert your best Linkedin posts into long form content.
E-commerce shopping agent
Insurance claims automation agent
Collect and analyze claim information, assess risk and verify policy details.
AI agent for claims review and error detection
Personalized healthcare explanations of a patient-doctor match

Build AI agents in minutes for

{{industry_name}}

Competitor research agent
Scrape relevant case studies from competitors and extract ICP details.
AI agent for claims review and error detection
E-commerce shopping agent
Retail pricing optimizer agent
Analyze product data and market conditions and recommend pricing strategies.
Risk assessment agent for supply chain operations
Insurance claims automation agent
Collect and analyze claim information, assess risk and verify policy details.

Case study results overview (usually added at top of case study)

What we did:

1-click

This is some text inside of a div block.

28,000+

Separate vector databases managed per tenant.

100+

Real-world eval tests run before every release.