Vellum is coming to the AI Engineering World's Fair in SF. Come visit our booth and get a live demo!

Partnering with Composio to Help You Build Better AI Agents

Building AI agents is 10x easier with 10,000+ tools and built-in LLM tooling support

6 min
Written by
Reviewed by
No items found.

AI agent building just got easier with Vellum and Composio. Today, we’re excited to share our partnership with Composio, a leading AI connector platform with 10,000+ tools (Google Drive, Notion, Jira, Linear, Trello, etc.) that can adapt to your AI solutions.

We’re now offering first-class support for Composio tools in our newly launched Agent Node, enabling our customers to build even more powerful agents.

Thanks to this partnership, hundreds of agentic use cases just became 100x easier to build with Vellum. Sing up here, and start building! Here are some ideas to get you started:

  • An agent that researches competitor profiles and sends a report straight to your inbox
  • An agent that gathers all Jira tickets and sends a weekly report to the team
  • An agent that searches the internet and creates SEO-optimized articles in your Notion
  • An agent that monitors all new Jira bugs and sends Slack notifications to the team

Tomorrow (9/13) at 4 pm EST, Vargas, our founding engineer, will demo how to start building agents using the Agent Node and your Composio tools. Save your spot here!

The sections below provide a full tutorial on how the Agent node works, how to integrate with Composio and start using it today.

Quick primer on the Agent Node

The Agent Node streamlines tool calling within Vellum Workflows by automatically handling OpenAPI schema generation, loop logic, and function call output parsing. This eliminates the tedious manual work traditionally required for implementing function calling patterns.

Key Features

The Agent Node provides several advantages over manual function calling implementation:

  • Automatic Schema Generation: No need to manually define OpenAPI schemas for your tools
  • Built-in Loop Logic: Automatically handles the iterative calling pattern until a text response is received
  • Output Parsing: Automatically parses function call outputs without manual intervention
  • Multiple Tool Support: Configure multiple tools within a single node

Configuration

The Agent Node requires two main components:

1. Model and Prompt Configuration

Configure the LLM model and prompt that will determine when and how to call the available tools.

2. Tool Definitions

Define the tools that the model can call. The node automatically infers the required schema for each tool type. The Agent Node supports three types of tools:

For more context about each of the tool types, and the outputs you can get from this Node, you can read in the official documentation page.

How to use the Agent Node with Composio tools

To use the Agent Node with Composio, you’ll need to have:

  • An account with Composio (they have a free tier with up to 20k tool calls/m)
  • An account with Vellum

Composio setup

Now, to start using tools from Composio in Vellum, you’ll need to do two things:

  1. You’ll need to authenticate the tools in your Composio account
  2. Create and copy your Composio API key

Tool authentication

To do that, head to your profile, and go into the Auth Configs section. Once you’re there, click on the “Create Auth Config” button:

Once you click that button, you’ll be able to select the tool that you want to authenticate with (see first image). From there if you select “Gmail” for example as your tool, you’ll be able to use the OATH 2 option. You don’t change anything in the settings, and just click on “Create Gmail Auth Config” (see second image):

Once you initialize the Gmail tool, you’ll arrive to the configuration for that specific tool. In it you’ll need to add your account by clicking on “Connect Account” where you’ll be asked to connect your gmail account via OAUTH 2 authorization:

Once you click “Connect Account” you’ll see a pop up asking you to add a User ID. Just type “default” here, and you should be able to authenticate:

If the authentication was successful, you’ll be able to see your account listed under this configuration, with status “Active”:

Getting your Composio API

Before you go into your Vellum workspace, you’ll need to create an API key from Composio. To do that, navigate to “Settings” and click “Create API key”. Once you have the API key, copy it to your clipboard.

The next steps are going to happen in Vellum.

Vellum setup

In Vellum, you’ll need to do two things:

  • Setup your Composio secret as an environment variable once (You can do this from your Workspace setting, or directly on the Agent node. Bellow we show the former example)
  • Add an Agent Node, select the Composio tool type and connect with your tools

Adding your Composio secret

In Vellum, navigate to your Workspace Settings, where you’ll find the Environment variables section. Then, click on “Add Environment Variable”:

From there you can add your API key, and create a Variable:

Now you’re ready to use your Composio account in Vellum Workflows, in the Agent Node!

Using Composio tools in the Agent Node

Now that you have Composio connected with Vellum, you can start giving your LLMs tools to work with. Once you select the Agent Node, in a given workflow, and you select “Composio tools” from the Tool dropdown, you’ll be able to select specific tools that you’d like to enable for a given LLM call:

Once you enable one tool, for example “Create an email draft” you’re going to see the tool selection in the side-nav, and the LLM call will be ready to use it under the hood:

So for example, if you write in the prompt something like “ Send an email draft with 5 quotes to "sam@open.ai”, the LLM model will know to create the 5 quotes, and open an email draft in Sam’s inbox containing that output!

And there you have it folks! Looking forward to what you can build next! Signup to Vellum today!

ABOUT THE AUTHOR
Anita Kirkovska
Founding Growth Lead

An AI expert with a strong ML background, specializing in GenAI and LLM education. A former Fulbright scholar, she leads Growth and Education at Vellum, helping companies build and scale AI products. She conducts LLM evaluations and writes extensively on AI best practices, empowering business leaders to drive effective AI adoption.

ABOUT THE reviewer

No items found.
lAST UPDATED
Aug 12, 2025
share post
Expert verified
Related Posts
LLM basics
September 25, 2025
8 min
Top Low-code AI Agent Platforms for Product Managers
LLM basics
September 25, 2025
8 min
The Best AI Agent Frameworks For Developers
Product Updates
September 24, 2025
7 min
Introducing AI Apps: A new interface to interact with AI workflows
LLM basics
September 18, 2025
7 min
Top 11 low‑code AI workflow automation tools
All
September 16, 2025
12 min
MCP UI & The Future of Agentic Commerce
Guides
September 16, 2025
4 min
Google's AP2: A new protocol for AI agent payments
The Best AI Tips — Direct To Your Inbox

Latest AI news, tips, and techniques

Specific tips for Your AI use cases

No spam

Oops! Something went wrong while submitting the form.

Each issue is packed with valuable resources, tools, and insights that help us stay ahead in AI development. We've discovered strategies and frameworks that boosted our efficiency by 30%, making it a must-read for anyone in the field.

Marina Trajkovska
Head of Engineering

This is just a great newsletter. The content is so helpful, even when I’m busy I read them.

Jeremy Hicks
Solutions Architect

Experiment, Evaluate, Deploy, Repeat.

AI development doesn’t end once you've defined your system. Learn how Vellum helps you manage the entire AI development lifecycle.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Email Signup
Sorts the trigger and email categories
Come to our next webinar
Description for our webinar
New CTA
Sorts the trigger and email categories

Start with some of these healthcare examples

SOAP Note Generation Agent
This agentic workflow generates a structured SOAP note from a medical transcript by extracting subjective and objective information, assessing the data, and formulating a treatment plan.
Personalized healthcare explanations of a patient-doctor match
An AI workflow that extracts PII data and match evidence then summarizes to the user why a patient was matched with a specific provider, highlighting factors like insurance, condition, and symptoms.

Start with some of these insurance examples

Insurance claims automation agent
This workflow automates the claims adjudication process in the insurance industry. It collects and analyzes claim information, assesses risks, verifies policy details, and generates a final decision along with a comprehensive audit trail.
AI agent for claims review and error detection
This workflow automates the review of healthcare claims to detect anomalies and benchmark pricing against established guidelines. It processes claim documents, extracts relevant data, and generates both structured JSON outputs and natural language summaries for human reviewers.

Start with some of these agents

SOAP Note Generation Agent
This agentic workflow generates a structured SOAP note from a medical transcript by extracting subjective and objective information, assessing the data, and formulating a treatment plan.
LinkedIn Content Planning Agent
This agentic workflow generates a 30 day LinkedIn content plan based on your content goals, target audience, and business information. It automates the process of generating content ideas, drafting posts, and organizing them into Notion for easy access and management.
Risk assessment agent for supply chain operations
This workflow generates a comprehensive risk assessment for suppliers based on various data inputs. It evaluates financial, performance, and news-related factors to provide a risk score, detailed assessment, and specific recommendations for risk mitigation.