Data Handling
Structured data
The Copilot excels at processing and analyzing structured financial datasets through multiple specialized capabilities:
- Table widgets: A natural language to SQL translation tool allows you to query tabular data from your widgets using plain English. Once your data is loaded in a tabular format,
text2sql
converts your questions into SQL queries under the hood and retrieves specific information from these tables. This allows you to explore and analyze your data through simple natural language questions.

- Plotly widgets: Full-featured charting engine that not only generates interactive visualizations but also allows developers to provide the underlying data. The Copilot can extract specific data points, and create derivative analyses from existing visualizations. The AI agent will have better results in case the Plotly widget has raw data associated with it.

Unstructured data
The Copilot's unstructured data processing capabilities enable comprehensive analysis of diverse document types and media:
- Document Processing (MD/PDF): Advanced text extraction and comprehension. The system maintains document structure understanding, preserving context around tables and hierarchical information. This utilizes a sophisticated retrieval system that chunks large documents intelligently, maintains semantic relationships, and provides precise citations. The system can cross-reference information across multiple documents and identify contradictions or supporting evidence.

- Web search:: When the user provides a URL to the AI agent, it converts the web page to markdown for it to be parsed by the model - as done above.

- Image Analysis: Image processing capabilities for charts, screenshots, financial diagrams, and infographics. The Copilot can extract data from visual representations, understand chart types, and incorporate visual information into broader analytical workflows.
