Chat With Documents and Translate Text in Tulip Apps: Introducing AI Trigger Actions

We're excited to preview AI Trigger Actions, the first example of how our Frontline Copilot will augment Tulip users. AI trigger actions bring the power of AI to Tulip apps, allowing engineers to build powerful functionality into their applications to support operators in their facilities.

Logic in the form of Tulip triggers is the backbone of Tulip applications. As one of the first features of our Frontline Copilot, we are bringing AI Trigger Actions to this core part of the platform. Frontline Copilot trigger actions allow no code app builders to dynamically translate text in Apps, empower operators to have natural language questions answered based on documents and data and extract text from images simply by asking for it - all just as easy as using any other trigger action.

Concretely, we are making the following trigger actions available as part of our closed beta of Frontline Copilot. Let's look take a look at them:

1. Extract Text lets your operators or engineers pull specific text out of the image of a document, label or traveler via a natural language query to use it in an app

2. Answer Question from Input allows you to provide a natural language question and a PDF or list of data and will return an answer based on the provided information. If you have an SOP or machine maintenance manual, an operator can quickly ask a specific question and get a summarized answer so they can quickly get back to the task at hand.

3. Find References goes hand in hand with the Answer Question action. If you don’t require an answer to a specific question but want to identify which pages from a PDF or elements from a list of data are most relevant for a taks, Find References will help you identify those. If a piece of equipment needs to be cleaned, they can quickly find the exact steps to do just that.

4. Translate. In situations where multiple languages are spoken or used in your plant or process, the Translate trigger action allows to harmonize user input to one language for easier analysis or display content to users in their preferred language. This extends the multilingual capabilities of Tulip to any changing elements of Apps.

The Tulip platform will always be human-centric, ensuring that your team has the right tools to get the job done, and our approach to AI doesn't change that. Context is key, which is why AI-triggered responses appear with references to the original text, allowing your operators to easily verify the answer or dig deeper into the material to find instructions or more information. This keeps humans in the loop and helps operators quickly navigate through documents, manuals, and SOPs so they can get back to the task at hand.

If the platform does not have enough information to provide an answer, it will let your operators know that it cannot respond. We also use large language models that don't require training, so you can get up and running quickly, and make your information more accessible for your team.

Tulip's investment in AI with Frontline Copilot brings powerful AI functionality to the platform's intuitive no-code trigger editor. AI trigger actions will be available in closed beta to select Tulip users as we work to refine and gather feedback. If you're interested in testing these features and providing feedback, please email us at copilot@tulip.co.