Designing Simulation & Evaluation Platforms for Trustworthy AI Systems
Team
Rohitha Remala
Roles
Overview
Collinear AI builds an enterprise platform that helps teams test, evaluate, and improve AI agents before production deployment. The platform supports two core product offerings:
-
Simulations — enabling teams to model and test conversational AI behavior in controlled, high-variance scenarios
-
Real-World Environment Evaluations — enabling teams to evaluate how AI systems perform in realistic, production-like environments
I led design across both offerings, ensuring each product solved distinct user needs while sharing a coherent system foundation.
The Mandate
Scope
As Collinear scaled into enterprise AI platforms, the team faced key challenges:
-
Conversational AI behavior was hard to interpret and validate
-
System evaluation logic lacked clear UI representation
-
Sales and engineering needed demo-ready, production-credible UX—fast
What I worked on:
End-to-end product design
Cross-product interaction systems
Scalable design system migration
Engineering & Sales alignment
Rapid, high-impact delivery
Design Strategy
Simulation-First, Evaluation-Ready UX
I designed both products around a common principle: AI systems must be observable and explainable.
Across Simulations and Real-World Evaluations, the UI enables users to:
-
Inspect conversational behavior at multiple levels
-
Understand how system decisions are made
-
Identify failures, edge cases, and performance gaps
This ensured consistency while allowing each product to serve distinct workflows.
Conversational Interfaces Grounded in System Behavior
I designed conversational interfaces where:
-
Messages, states, and outcomes reflect underlying system behavior
-
Users can understand why an AI responded the way it did
-
Designers and engineers operate from a shared behavioral model
This reduced interpretation gaps and accelerated iteration across both products.
Scalable Design System
To support multiple product lines, I led the migration of legacy designs into a single, extensible design system that:
-
Supports data-dense inspection and evaluation views
-
Enables reuse across Simulations and Real-World Evaluations
-
Scales without constraining future AI workflows
Simulations Platform
The Simulations product enables teams to create controlled, high-variance scenarios to test conversational AI behavior before production deployment.
Scope
-
Led end-to-end UI/UX for a brand-new core product offering
-
Designed workflows for configuring, running, and analyzing AI simulations
-
Built interfaces that surface conversational behavior, outcomes, and evaluation context
-
Established reusable interaction patterns adopted across the platform
What I worked on:
End-to-end product design
Cross-product interaction systems
Scalable design system migration
Engineering & Sales alignment
Rapid, high-impact delivery
Real-World Environment Evaluations
The Real-World Environment Evaluations product allows teams to evaluate AI agents in environments that closely mirror production conditions, bridging the gap between simulation and live deployment.
Design Scope & Contributions
-
Partnered with Engineering & Sales on a 48-hour sprint
-
Designed and prototyped real-world evaluation workflows
-
Translated abstract evaluations into demo-ready UX
-
Maintained consistency across product platforms
Impact
-
Enabled credible, system-accurate sales demos
-
Helped customers understand how AI agents perform in real-world conditions
-
Accelerated adoption of a previously non-visualized capability
Website Design & Product Narrative
As Collinear’s product offerings expanded, the website needed to clearly communicate both platforms to enterprise buyers and partners.
I led the redesign of the website hero experience to:
-
Visually represent Simulations and Real-World Evaluations
-
Translate complex AI capabilities into a clear product narrative
-
Align marketing visuals with actual platform behavior
Using Adobe After Effects and Premiere Pro, I created custom motion visuals that demonstrate how conversations, simulations, and evaluations come together—strengthening first impressions and sales conversations.
