|  | Data-Driven Modelling of a Track-based Stair-Climbing WheelchairYogita Choudhary,Nidhi Malhotra, Pratyush Kumar Sahoo
 Indian Institute Of Technology, Varanasi   [Accepted as a full paper at AIM 2021, TU Delft]
 
 A stair-climbing wheelchair can notably enhance the autonomy in terms of mobility for the aged and disabled. This paper presents a data-driven system identification approach and a vision-based heading control algorithm for reliable operation of a stair-climbing wheelchair. We develop a track-based wheelchair model and propose a methodology for autonomous stair traversal. Modeling the dynamics of track-based systems is a challenging task. Hence, a data-driven approach based on the Observer Kalman filter Identification/Eigensystem Realization Algorithm is employed for modeling the complex dynamics of the system. For developing an affordable system, low-cost sensors such as Microsoft Kinect and IMU are utilized. We employ a computationally efficient image processing algorithm, and the heading angle is controlled using Linear Quadratic Regulator (LQR). The effectiveness of the proposed methodology for a safe stair traversal is verified in the ROS-Gazebo environment. [Project Page] [Thesis][Code] [Paper]
 
 | 
                   
          
              |  | Semi-Autonomous Stairclimbing WheelchairYogita Choudhary,Nidhi Malhotra, Pratyush Kumar Sahoo, Shyam Kamal
 Indian Institute Of Technology, Varanasi   [Accepted for presentation at Student Design Competition, AIM Boston, 2020]
 
 We  develop  a  low  cost  semi-autonomous,  robust mechanism  for  a  stair-climbing  wheelchair  in  this  work.  The core contribution is the system include the design of a variable geometry track-based mechanism which accomplishes the taskof stair climbing. A recursive line merging algorithm with spatial constraints is proposed to detect and localize stairs and output the yaw angle of the robot w.r.t stairs. Additionally, for safety of the user we proposea mechanism to adjust the elevation of the seat through closed-loop   feedback   control.   For   attitude   estimation,   we   employ the  Extended  Kalman  Filter  Approach.  The  algorithm  fuses data   from   IMU,   RGB   and   Depth   channels   of   the   Kinectsensor. Presence of both RGB and Depth data helps to receive an  accurate  pose  estimate  is  different  lighting  conditions. The dynamics  of  the  robot  have  been  approximated  as  a  first-order linear system. A Proportional Integral (PI) Controller isimplemented  for  Heading  angle  control  to  maintain  a  desiredpath  of  the  wheelchair.  Slip  Compensation  is  done  using  the Slip  Compensated  Optometry  using  Gyro  approach.Finally,we  stress  test  our  algorithms  in  the  Robot  Operating  System(ROS) simulation software and prove that the algorithm worksefficiently in maintaining zero heading angle throughout ascend [Project Page] [Thesis][Code] [Poster]
 
 | 
          
          
              |  | Monocular shape and Pose estimation of Indian VechilesPratyush Kumar Sahoo, Sarthak Sharma, K. Madhava Krishna
 Robotics Research Center, IIIT-H
 
 We inspected and trained the stacked hourglass network for vehicle pose estimation(Buses) on a synthetic dataset generated by triangulation followed by bundle adjustment and RenderForCNN on 400 ShapeNet CAD Models. The network was trained on a CRF style loss function to force learn inter keypoint distances.[Results] [Report]
 
 | 
          
            |  | InspirARMIndian Institute Of Technology, Varanasi   [Presented at the Inter IIT TechMeet 8.0, Engineer's Conclave]
 
 
 Designed and 3D printed a robotic arm, used servo motors and arduino to control finger motions. Used an EMG sensor module on the user arm to collect signals and trained a neural network classifier to classify between 5 different hand motions. Later, integrated a raspberry pi camera and utilized a pre-trained mobile net object detection network to predict the most suitable grip depending upon the object detected.  [Poster][Presentation]
 | 
          
            |  | iDetect
 iVizz, cAST Technologies [Filed a Provisional US Patent]
 
 Utilized the work of Zhe Cao et al to build a human touch detection pipeline on 2D surveillance camera feeds. Created a custom pose classification deep neural network to differentiate between human postures taking pose points output from the first network as an input to eleminate false-positives. Showcased results on cluttered Indian Hospital environments. The entire application is deployed at iVizz
 | 
		              
            |  | Swaayat [Participated in  the Student AUV Design Competition]
 
 Inspected and implemented image enhancement algorithms including Homomorphic filters and Contrast stretching on underwater images. Trained and finetuned Detectron-2 for underwater object detection and localization on the Robosub dataset. [Image Enhancement][Object Detection][Concept Design Report]
 | 
           
            |  | MediAssess [Third Position Worldwide in the Johns Hopkins Healthcare Design Competition, Ppaper accepted in The 5th International Workshop On Health Intelligence, 35th AAAI 2021 Conference on Artificial Intelligence]
 
 To aid the process of triaging in Emergency Departments of over-stressed settings an automatic triaging system is developed trained on the NHAMCS dataset. The developed model very accurately differentiates critical patients. Further details can be found here. [Website][Code][Paper]
 |