BRIN Vehicle Dashboard
Real-time ROS1 sensor telemetry into a Flutter operator cockpit
The Problem
Autonomous vehicle field tests require test engineers to observe vehicle telemetry in real time and safely dispatch navigation commands without tethering bulky laptops running RViz. During testing at BRIN, operators needed a fast, interactive mobile interface that could render live sensor telemetry and route navigation goal points directly into the vehicle stack.
My role was to design and build an operator cockpit using Flutter and connect it to the vehicle ROS1 Noetic bus over a low-latency bridge.
How It Works
The platform bridges real-time robotics middleware with a reactive mobile interface through three core components.
ROS1 Sensor Aggregation
Subscribed to physical sensor topics on the vehicle bus, including 3D LiDAR point clouds, RTK-GPS coordinates (/fix), and IMU acceleration and orientation feeds (/imu/data). Timestamp synchronization prevented state drift across streams.
Rosbridge WebSocket Serialization
Deployed a rosbridge daemon that serialized native ROS messages into lightweight JSON payloads over WebSockets. High-frequency feeds were downsampled to balance network throughput across wireless test ranges.
Interactive Cockpit and Waypoint Dispatch
Rendered real-time vehicle orientation, speed, and spatial obstacle boundaries on a custom Flutter map overlay calibrated to the BRIN KST test area. Operators could tap directly on the test map to publish a target pose (/move_base_simple/goal) to the autonomous planner.
Decisions and Trade-offs
Flutter over Web RViz
RViz web bridges exist, but they are heavy, consume substantial client resources, and do not provide clean mobile touch ergonomics in the field. Flutter allowed us to compile a responsive mobile app with custom 60 FPS vector instrumentation.
Selective Downsampling on Heavy LiDAR Feeds
Raw 3D point cloud topics easily saturated wireless links between the moving vehicle and the tablet. I implemented spatial filtering and downsampled preview rates to 10 Hz for the operator display while leaving the onboard autonomous planner untouched at full bus frequency.
Field operations and waypoint dispatches were executed within the designated BRIN Kawasan Sains dan Teknologi (KST) testing grounds under controlled safety supervision.
Camera-LiDAR Multimodal Exploration
In parallel with dashboard development, I researched Bird's Eye View (BEV) fusion architectures on the nuScenes dataset, evaluating how multimodal camera-LiDAR representations preserve 3D geometry compared to single-sensor projections.
Results
The dashboard served as the active monitoring interface during vehicle navigation trials.
Summary
The dashboard closed the loop between the vehicle onboard autonomy stack and safety engineers on the ground, enabling instant goal placement and real-time state verification during research maneuvers.