Data Handling

Widget interaction

Dynamic parameter modification represents one of the OpenBB's Copilot most powerful capabilities.

The system understands the parameter schemas of each widget and can intelligently modify settings like date ranges, asset symbols, calculation periods, and analysis parameters to match your specific requirements.

This eliminates the need for manual widget configuration and enables the Copilot to perform iterative analysis with different parameters automatically, such as comparing the same analysis across different time periods or asset classes within a single conversation.

Structured data

The Copilot excels at processing and analyzing structured financial datasets through multiple specialized capabilities:

• Table widgets: A natural language to SQL translation tool allows you to query tabular data from your widgets using plain English. Once your data is loaded in a tabular format, text2sql converts your questions into SQL queries under the hood and retrieves specific information from these tables. This allows you to explore and analyze your data through simple natural language questions.

• Plotly widgets: Full-featured charting engine that not only generates interactive visualizations but also allows developers to provide the underlying data. The Copilot can extract specific data points, and create derivative analyses from existing visualizations. The AI agent will have better results in case the Plotly widget has raw data associated with it.

Unstructured data

The Copilot's unstructured data processing capabilities enable comprehensive analysis of diverse document types and media:

• Document Processing (MD/PDF): Advanced text extraction and comprehension. The system maintains document structure understanding, preserving context around tables and hierarchical information. This utilizes a sophisticated retrieval system that chunks large documents intelligently, maintains semantic relationships, and provides precise citations. The system can cross-reference information across multiple documents and identify contradictions or supporting evidence.

• Web search:: When the user provides a URL to the AI agent, it converts the web page to markdown for it to be parsed by the model - as done above.

• Image Analysis: Image processing capabilities for charts, screenshots, financial diagrams, and infographics. The Copilot can extract data from visual representations, understand chart types, and incorporate visual information into broader analytical workflows.