Arash Asgharivaskasi

I am a senior engineer at Hillbot, where I work on general-purpose embodied AI.

I did my PhD at UC San Diego, and had the privilege to be advised by Prof. Nikolay Atanasov at the Existential Robotics Laboratory.

Email  /  CV  /  Google Scholar  /  LinkedIn Page

profile photo
Research

The main theme of my research has been active information gathering in the context of robotics. Applications include autonomous exploration and mapping, target tracking, and active 3-D reconstruction. I am interested in using information theory as a bridge between perception models (range sensing, object recognition, etc) and planning methods. Specifically, active information gathering is achieved via finding robot(/sensor) trajectories that optimize an information theoretic objective function based on the sensor's observation model. I am also interested in decentralized multi-robot exploration under non-Euclidean and non-Gaussian regimes.

Simulation
Real-world
Riemannian Optimization for Active Mapping with Robot Teams
Arash Asgharivaskasi, Fritz Girke, Nikolay Atanasov
Submitted to IEEE Transactions on Robotics (T-RO), 2024.
website / video / paper / code

Autonomous exploration of unknown environments using a team of mobile robots demands distributed perception and planning strategies to enable efficient and scalable performance. Ideally, each robot should update its map and plan its motion not only relying on its own observations, but also considering the observations of its peers. Centralized solutions to multi-robot coordination are susceptible to central node failure and require a sophisticated communication infrastructure for reliable operation. Current decentralized active mapping methods consider simplistic robot models with linear-Gaussian observations and Euclidean robot states. In this work, we present a distributed multi-robot mapping and planning method, called Riemannian Optimization for Active Mapping (ROAM). We formulate an optimization problem over a graph with node variables belonging to a Riemannian manifold and a consensus constraint requiring feasible solutions to agree on the node variables. We develop a distributed Riemannian optimization algorithm that relies only on one-hop communication to solve the problem with consensus and optimality guarantees. We show that multi-robot active mapping can be achieved via two applications of our distributed Riemannian optimization over different manifolds: distributed estimation of a 3-D semantic map and distributed planning of SE(3) trajectories that minimize map uncertainty. We demonstrate the performance of ROAM in simulation and real-world experiments using a team of robots with RGB-D cameras.

Optimal Scene Graph Planning with Large Language Model Guidance
Zhirui Dai, Arash Asgharivaskasi, Thai Duong, Shusen Lin, Maria-Elizabeth Tzes, George Pappas, Nikolay Atanasov
IEEE International Conference on Robotics and Automation (ICRA), 2024.
website / video / paper / code

Recent advances in metric, semantic, and topological mapping have equipped autonomous robots with semantic concept grounding capabilities to interpret natural language tasks. This work aims to leverage these new capabilities with an efficient task planning algorithm for hierarchical metric-semantic models. We consider a scene graph representation of the environment and utilize a large language model (LLM) to convert a natural language task into a linear temporal logic (LTL) automaton. Our main contribution is to enable optimal hierarchical LTL planning with LLM guidance over scene graphs. To achieve efficiency, we construct a hierarchical planning domain that captures the attributes and connectivity of the scene graph and the task automaton, and provide semantic guidance via an LLM heuristic function. To guarantee optimality, we design an LTL heuristic function that is provably consistent and supplements the potentially inadmissible LLM guidance in multi-heuristic planning. We demonstrate efficient planning of complex natural language tasks in scene graphs of virtualized real environments.

Distributed Optimization with Consensus Constraint for Multi-Robot Semantic Octree Mapping
Arash Asgharivaskasi, Nikolay Atanasov
CoPerception: Collaborative Perception and Learning, ICRA 2023 Workshop.
video / paper / code

This work develops a distributed optimization algorithm for multi-robot 3-D semantic mapping using streaming range and visual observations and single-hop communication. Our approach relies on gradient-based optimization of the observation log-likelihood of each robot subject to a map consensus constraint to build a common multi-class map of the environment. This formulation leads to closed-form updates which resemble Bayes rule with one-hop prior averaging. To reduce the amount of information exchanged among the robots, we utilize an octree data structure that compresses the multi-class map distribution using adaptive-resolution.

SSMI: Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Exploration
Arash Asgharivaskasi, Nikolay Atanasov
IEEE International Conference on Robotics and Automation (ICRA), 2021.
Journal version accepted to IEEE Transactions on Robotics (T-RO), 2023.
website / video / journal version / conference version / code

We develop a Bayesian multiclass mapping algorithm based on an octree data structure, where each voxel maintains a categorical distribution over semantic classes. We derive a closed-form efficiently computable lower bound of the Shannon mutual information between a multiclass octomap and a set of range-category measurements using semantic run-length encoding of the sensor rays. The bound allows rapid evaluation of many potential robot trajectories for autonomous exploration and mapping. We compare our method against state-of-the-art exploration techniques and apply it in a variety of simulated and real-world experiments.

Policy Learning for Active Target Tracking over Continuous SE (3) Trajectories
Pengzhi Yang, Shumon Koga, Arash Asgharivaskasi, Nikolay Atanasov
Learning for Dynamics and Control (L4DC), 2023.
paper / code

We propose a novel model-based policy gradient algorithm for tracking dynamic targets using a mobile robot, equipped with an onboard sensor with limited field of view. The task is to obtain a continuous control policy for the mobile robot to collect sensor measurements that reduce uncertainty in the target states, measured by the target distribution entropy. We design a neural network control policy with the robot SE(3) pose and the mean vector and information matrix of the joint target distribution as inputs and attention layers to handle variable numbers of targets. We also derive the gradient of the target entropy with respect to the network parameters explicitly, allowing efficient model-based policy gradient optimization.

Learning Continuous Control Policies for Information-Theoretic Active Perception
Pengzhi Yang, Yuhan Liu, Shumon Koga, Arash Asgharivaskasi, Nikolay Atanasov
IEEE International Conference on Robotics and Automation (ICRA), 2023.
paper / code

We consider a mobile robot detecting landmarks within a limited sensing range, and tackle the problem of learning a model-free control policy that maximizes the mutual information between the landmark states and the sensor observations. We employ a Kalman filter to convert the partially observable problem in the landmark state to Markov decision process (MDP), a differentiable field of view to shape the reward, and an attention-based neural network to represent the control policy. The approach is further unified with active volumetric mapping to promote exploration in addition to landmark localization. The performance is demonstrated in several simulated landmark localization tasks in comparison with benchmark methods.

Information-theoretic Abstraction of Semantic Octree Models for Integrated Perception and Planning
Daniel T. Larsson, Arash Asgharivaskasi, Jaein Lim, Nikolay Atanasov, Panagiotis Tsiotras
IEEE International Conference on Robotics and Automation (ICRA), 2023.
paper

Our approach builds a three-dimensional, semantic tree representation of the environment from sensor data which is then compressed by a novel information-theoretic tree-pruning approach. The proposed approach is probabilistic and incorporates the uncertainty in semantic classification inherent in real-world environments. Moreover, our approach allows robots to prioritize individual semantic classes when generating the compressed trees, so as to design multi-resolution representations that retain the relevant semantic information while simultaneously discarding unwanted semantic categories. We demonstrate the approach by compressing semantic octree models of a large outdoor, semantically rich, real-world environment. In addition, we show how the octree abstractions can be used to create semantically-informed graphs for motion planning, and provide a comparison of our approach with uninformed graph construction methods such as Halton sequences.

Active Mapping via Gradient Ascent Optimization of Shannon Mutual Information over Continuous SE(3) Trajectories
Arash Asgharivaskasi, Shumon Koga, Nikolay Atanasov
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.
website / video / paper

The non-smooth nature of ray-tracing within a grid representation makes the active mapping objective function non-differentiable, forcing existing methods to search over a discrete space of candidate trajectories. This work proposes a differentiable approximation of the Shannon mutual information between a grid map and ray-based observations that enables gradient ascent optimization in the continuous space of SE(3) sensor poses. Our gradient-based formulation leads to more informative sensing trajectories, while avoiding occlusions and collisions. The proposed method is demonstrated in simulated and real-world experiments in 2-D and 3-D environments.

Active SLAM over Continuous Trajectory and Control: A Covariance-Feedback Approach
Shumon Koga, Arash Asgharivaskasi, Nikolay Atanasov
American Control Conference (ACC), 2022.
paper

We propose a novel active Simultaneous Localization and Mapping (SLAM) method with continuous trajectory optimization over a stochastic robot dynamics model. The problem is formalized as a stochastic optimal control over the continuous robot kinematic model to minimize a cost function that involves the covariance matrix of the landmark states. We tackle the problem by separately obtaining an open-loop control sequence subject to deterministic dynamics by iterative Covariance Regulation (iCR) and a closed-loop feedback control under stochastic robot and covariance dynamics by Linear Quadratic Regulator (LQR). The proposed optimization method captures the coupling between localization and mapping in predicting uncertainty evolution and synthesizes highly informative sensing trajectories. We demonstrate its performance in active landmark-based SLAM using relative-position measurements with a limited field of view.

Active Exploration and Mapping via Iterative Covariance Regulation over Continuous SE(3) Trajectories
Shumon Koga, Arash Asgharivaskasi, Nikolay Atanasov
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021.
website / video / paper

This paper develops iterative Covariance Regulation (iCR), a novel method for active exploration and mapping for a mobile robot equipped with on-board sensors. The problem is posed as optimal control over the SE(3) pose kinematics of the robot to minimize the differential entropy of the map conditioned on the potential sensor observations. We introduce a differentiable field of view formulation, and derive iCR via the gradient descent method to iteratively update an open-loop control sequence in continuous space so that the covariance of the map estimate is minimized. We demonstrate autonomous exploration and uncertainty reduction in simulated occupancy grid environments.



Template borrowed from Jon Barron.