OpenAgents-EN
icon
password
As @ AI Daily Guy mentioned, the product features include:
- Easy Deployment: Simplifies the installation and getting started process.
- Full-Stack Support: Provides comprehensive tools and functionalities for developers.
- Chat Interface: Offers an intuitive user interface for seamless interaction.
- Agent Methods: Employs advanced technologies and methods to enhance functionality.
OpenAgents is an open-source platform that develops LLM-powered agents, integrating three powerful agents in XLang.
Project link: https://github.com/xlang-ai/OpenAgents
Paper link: https://arxiv.org/abs/2310.10634
User manual: https://docs.xlang.ai/category/user-manual
📄Data Agent
Highly available for structured data like tables, and directly displays data. The main feature of the Data Agent is to write and execute code (Python and SQL) and present the results to users.
Before: Download data as xlsx or csv → Import to Excel → Process data.
Now: One step! For instance, simply enter your topic of interest on the platform, and the Data Agent can automatically search datasets on Kaggle, find useful datasets that meet user needs, and directly generate Python or SQL code to automatically clean the data.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F42f304d7-76b9-4948-95eb-e13e602a6696%2FUntitled.png?table=block&id=11ec789d-837a-4825-afef-a930c0f09e61)
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2Fb75a1169-d9fa-4899-9769-d8ceed905ad4%2FUntitled.png?table=block&id=3115b1c0-43bf-4ccb-9e77-290ca9c5007e)
It can also automatically run the pyecharts package code, generating a JSON object and displaying it as an Echarts chart on the frontend.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F3edbc16b-66cd-4735-b82a-0f0a372cf843%2FUntitled.png?table=block&id=c142e56d-b8b9-49a4-b810-19ee3e6df209)
Additionally, users can also input images, allowing the Data Agent to perform image processing, such as greyscale.
🔌Plugins Agent
Integrated with over 200 third-party plugins, users can find information on a range of plugins (including Wolfram, NewsAPI, RapidAPI, etc.) in XLang's user manual, and interact with popular applications like Spotify, Twelve Data, Youtube, and Alpha Vantage.
The use is divided into categories requiring authentication and those that do not.
No authentication needed, such as shopping, weather, creating flowcharts.
For example, tell the
Klarna Shopping
plugin what you want to buy, and it will return user link cards to navigate to the product page.![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F3898b644-8da4-438d-9309-44230c39313c%2FUntitled.png?table=block&id=8c6d736c-38da-459f-87b0-ec6ac1a2fe15)
Tools that require authentication, such as Wolfram for scientific calculations, a very popular tool for science subjects.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2Fc7fc5a2c-2f8b-4487-bd82-a67ab3e9e6b1%2FUntitled.png?table=block&id=b3c73df9-6565-46be-86d2-e616e03ca435)
When users are unsure which plugin they need, there is an auto plugin selection feature, where the Plugins Agent will automatically match plugins based on user needs.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F78263157-2398-42ee-94fb-f989086a5727%2FUntitled.png?table=block&id=1aeb1358-d1ae-46b7-8dd2-84e1a284631b)
🌐Web Agent
Leveraging the browser Sidebar plugin, the Web Agent can automatically operate webpages, simplifying web browsing. Users can directly search for "XLang Web Agent" in the Chrome extensions web store, download, and configure it according to the prompts.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F97094ec7-072e-4d40-8e92-055a1b5589da%2FUntitled.png?table=block&id=544ca58d-88a3-4909-8a3a-d7398323fbfa)
When using it, users input commands into the Web Agent, jump to the corresponding webpage, and need to activate the console [shortcut: "Cmd + Option + I" (on Mac) or "Ctrl + Shift + I" (on Windows)] to manually select to start the search. The Web Agent will automatically analyze the webpage and import the webpage information into the chat on the platform.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F48cff1df-e6bb-4ad5-89a3-042199fe0702%2FUntitled.png?table=block&id=1fcbefd4-90d3-460f-b794-306b6cd53626)
Although this Agent requires an extra step of manual activation in the console, it is undeniably powerful. For instance, based on user queries for flight information, it can automatically input flight origin, time, round trip conditions into the webpage, continue to compare ticket prices after the webpage jumps, and return results to the user.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2Fdb084d3e-9a1c-4cd4-8e1e-dbd90f5c6072%2FUntitled.png?table=block&id=83db979d-3c50-4f90-bed0-6413ef56d13f)
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2Fdda86823-325c-44c0-a61f-79b3de586329%2FUntitled.png?table=block&id=7272749f-de9f-4c80-8759-695f1536cfb3)
Additionally, it can automatically browse movies on IMDb and write reviews; provide time and distance information based on Google Maps data; automatically send and forward tweets; and automatically fill out Google forms. The functionality is truly powerful!
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F1f2a92d8-d17b-4731-92e0-82d4e79ef685%2FUntitled.png?table=block&id=7dc9e0d2-14c6-4816-8ae8-93a1c637fd1c)
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F49a0a428-e9cd-4be9-9de6-b014654eedd0%2FUntitled.png?table=block&id=91d87a07-9afe-4b0a-95bc-28bba74dc4dc)
💡Design Philosophy
XLang Agents are tailored for real-world scenarios, designed to solve specific human challenges.
In Reinforcement Learning (RL), an "agent" is a decision-maker that interacts with its environment to achieve goals. It learns through a feedback loop, adjusting strategies based on rewards or punishments to maximize accumulated rewards over time.
In the fields of Natural Language Processing (NLP) and robotics, an "agent" refers to a system or model that interacts with its environment directly or through tools.
The team believes that agents are large language models (LLMs) that follow language instructions and predict actions by activating API functions with specific parameters through prediction. Specifically, they accept user intentions as input, with LLM-based strategies to predict the next action, and consist of the action space for selection.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2Ffe0609e0-30dd-44a9-8021-df919a9ed14e%2Fsystem_design.png?table=block&id=d03a3b75-0161-4fa4-91a0-120d99f48e53)
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F279f3f6f-4727-4e54-81b1-3b66a423b320%2F851429ab-a62c-4123-bb27-e3ca703b02e9%2Fopenagents_overview.png?table=block&id=383d499e-bbf7-42eb-8d2f-abe8da75029b)
🪄Getting Started
Entry without installation: https://chat.xlang.ai/zh
Local installation method:
- Download from its Git repository
- Start the [backend](https://github.com/xlang-ai/Open
Agents/blob/main/backend/README.md)
- Install environment
- Configure MongoDB, Redis, environment variables, OpenAI API as per README.md
- Run the script
- To achieve the automatic running of Python scripts like the Data Agent, without using the local environment, configure Docker as follows:
- Start the frontend and begin using - Access at http://localhost:3000
Google Plugin:
Besides the Chrome store, users can also locally import the Chrome plugin.
- Unzip the
webot_extension.zip
file in thefrontend
directory.
- Open
chrome://extensions/
.
- Enable
Developer mode
.
- Click
Load unpacked extension
.
- Select the unzipped
builder
folder.
Last update: 2023-10-26
icon
password
I am currently in Melbourne
I am Looking for a Data Analytics Role…