Centre for Interdisciplinary and Convergent Technologies

Physical Intelligence Lab

Bridging the paradigm gap between Vision-Language Models (VLMs) and real-world physical interactions. We focus on multi-agent multimodal robotics, adaptive hardware design, and resilient embodied AI systems.

Our Mission

The Physical Intelligence Lab (PILab) at IIT Kharagpur approaches robotics from an applied, experimental "builder" perspective. We construct tight hardware-software integrations capable of complex open-ended multi-agent tasks across terrestrial, aerial, and aquatic configurations.

Multimodal Fusion

Fusing deep semantic vision-language representation spaces with downstream robotic feature spaces for adaptive control.

Multi-Agent Systems

Developing scalable, decentralized communication and optimization frameworks for cooperative autonomous task executions.

Digital Twins & SLAM

Constructing high-fidelity campus-scale point clouds and submap-fused 3D Gaussian Splatting configurations for intelligent navigation.

Embodied AI Architectures

Deploying tiered models connecting deep high-level reasoning to agile low-level micro-controller frequency actuation loop execution.

Core Research Thrusts

Pushing the frontier of Physical AI through coordinated hardware-software co-design initiatives.

Perception & Alignment

CoDet Core Optimization

Developing fine-tuned Vision-Language models by optimizing specialized custom loss function configurations. Our focus includes decreasing text/caption dimensionality down to functional atomic primitives to accelerate continuous video-sequence sequence reasoning.

Computer Vision, Multimodal Alignment
Spatial Intelligence

Gaussian Splatting & SLAM

Generating dense, scalable digital twins using continuous 3D Gaussian Splatting and semantic SLAM pipelines. We implement specialized submap fusion routines to deploy real-time context-aware spatial navigation directly inside high-density point clouds.

3D Reconstruction, Semantic Mapping
Navigation & Manipulation

Long-Horizon Compositional Tasks

Constructing multi-tier embodied systems where natural language instructions accurately map to unified multi-stage spatial trajectories and robust precision micro-actuation manipulation hooks.

Vision-Language Navigation, Manipulation

Mechatronics & Rapid Prototyping

Our physical testbeds are designed, modeled, and manufactured in-house. We heavily focus on creating customized, efficient kinetic configurations over rigid commercial out-of-the-box hardware templates.

  • Custom Linkages & Actuators: Designing 4-servo grippers, 5-bar linkage systems, and 6-DOF/7-DOF manipulator mechanics.
  • Multi-Material Rapid Prototyping: Utilizing dual-extrusion parameters (PLA, TPU) to prototype high-friction specialized tactile skins.
  • Simulation to Reality (Sim2Real): Standardizing continuous validation environments using PyBullet, MuJoCo, and detailed Onshape assets.
7-DOF
Custom Kinematic Arms
TPU
High-Friction Tactile Skins
SLAM
Submap Cloud Fusion
VLN
Long-Horizon Autonomy

Selected Publications

Core scientific and mechanical research output from our team.

View Full Google Scholar
Frontiers in Robotics & AI

A Modular Vision Language Navigation and Manipulation Framework for Long Horizon Compositional Tasks in Indoor Environment

H. Saha, F. Fotouhi, Q. Liu, S. Sarkar

Energy and Buildings

Occupancy sensing in buildings: A review of data analytics approaches

H. Saha, A. R. Florita, G. P. Henze, S. Sarkar

Indian Patent

Intelligent Biped Mobile Robot to mimic human being

Dr. Dayal Parhi, Dr. Chinmaya Sahu, Dr. Homagni Saha (Patent No. 529812)

Lab Leadership

Leading interdisciplinary initiatives at the nexus of mechanics and computer vision science.

Dr. Homagni Saha

Assistant Professor Grade-I

Dr. Saha heads the Physical Intelligence Lab at the Centre for Interdisciplinary and Convergent Technologies, IIT Kharagpur. He completed his Ph.D. in Mechanical Engineering and Computer Science at Iowa State University, followed by industry positions as a Lead Machine Learning Scientist and Computer Vision Engineer.

Join Our Research Initiative

We are actively seeking motivated M.Tech, Ph.D., and undergraduate research interns passionate about Physical AI, 3D printing custom robotics, and Vision-Language models.

Inquiries & Correspondence
homagni.saha@atdc.iitkgp.ac.in
Centre for Interdisciplinary and Convergent Technologies, IIT Kharagpur