About

Timeline

Download Chronological Resume:

Date Description
August 2023 - November 2023 KaggleX Mentee, 3rd cohort. Pursuing my interest in reinforcement learning and Open-Source contributions.
Summer 2023 Contributed as a reviewer for multiple papers at the 8th International Conference on Computer Vision and Image Processing (CVIP) 2023 held at IIT Jammu. More about CVIP
January 2022 - Ongoing AI Software developer at Captury GmbH, based in Germany, contributing to dataset preparations, handpose tracking, CPython bindings, build process, plugin management for Unreal and Unity, building prototypes using Unreal Engine, Unity, and Oculus Quest, etc. My role mostly involves developing things from scratch. Successfuly in production two projects: 1. Low resolution hand tracking, 2. Guitar and Violin Tracking. These projects were built from scratch by me. Scratch implies here that the data preparation, algorithmic analysis, model developement and iterative model improvement etc.
May 2021 Graduated with a 4-year undergraduate degree in Computer Science and Engineering from IIT Jammu.
July - December 2021 Worked as a freelancer for Captury GmbH after completing my graduation. Started building handpose tracking support for Captury.
October - December 2020 Worked as a Deep Learning and Computer Vision intern with Captury GmbH, focusing on Fast Background subtraction using neural networks.
May 2020 - May 2021 Worked on location privacy and reinforcement learning methods in collaboration with Prof. Isao Echizen, NII Japan, and Dr. Harkeerat Kaur, IIT Jammu. This collaboration led to the successful publication of two papers mentioned below. Publications section
May - July 2020 (Summer) Worked as a summer intern with Captury GmbH. Successfully built “End to End 3D face landmarks annotation,” which led to another long-term project in the company, “Facial expression transfer via morph-key prediction.”
September - December 2019 Served as the Cultural Secretary of IIT Jammu. Major contributions included starting the Student Mentorship Program for incoming batches and securing significant budgets for cultural clubs and fest.
July 22 - July 31, 2019 Led a team of 30 members to organize a 10-day long foundation program at IIT Jammu. News and report
May - July 2019 (Summer) Conducted summer research at IIT Bombay, working with Prof. Virendra Singh on the topic of object detection and deep learning methods.

Research

Publications

  1. Reinforcement Learning based Smart Data Agent for Location Privacy.
    • AINA’21 (Advanced Information Networking and Applications)
    • Publication
  2. Smart Data Agent for Preserving Location Privacy.
    • IEEE-SSCI’20 (Symposium Series on Computational Intelligence)
    • Publication

Others

  1. ( January - May, 2021 ) Term paper on Adaptation in Cloud Computing guided by Prof. Naveen Sharma, Rochester Institute of Technology, NY. GitHub Repository

  2. (Summer, 2019) Machine Learning Research Intern, under the guidance of Prof. Virendra Singh, IIT Bombay, where I worked on object detection and deep learning methods for it.

Experiences

Captury Summer 2020 - Present

  • AI Software Developer
  • Captury GmbH
  • Germany

I work as an AI software developer. Major parts of my job role involve developing neural networks as well as the data needed for it. The other part of my job involves developing prototypes on the AI technology we develop at Captury. Captury works in real-time markerless motion capture systems - read more.

3D simulations : I develop various prototypes in Unreal, Unity, and for Oculus Quest. They have been used in our client demo.

Python wrappers in C: I contribute in C++, C, and Python towards the core software also and the plugins needed for the 3D simulation software. I developed the Python library for Captury using C-API’s of CPython, that provides user access to internal implementation of Captury. This enabled Captury for the first time to scale the Shot processing on server farms.

Deep Learning: i have successfully completed two projects which are in production. I developed the hand tracking technology, which is the core of the captury’s hand tracking capability. I developed the guitar and violin tracking technology, which was one of the biggest project we had at captury. You can check the public release of hand tracking on youtube : youtube

Synthetic Data Generation : I extensively work with Blender and its Python API to generate the synthetic datasets. The projects developed uses the inhouse data generation.

The unique workspace of captury enabled me to work on the full projects by myself, developing and planning the scope, solution, data generation and the experiments.

I have been working on and off with Captury since the summer of 2020 and joined them as full-time in august 2021. Please visit my linkedin for the timeline.

Undergraduate 2017 - 2021

  • Bachelors in Computer Science and Engineering
  • Indian Institute of Technology (IIT), Jammu, India

I pursued my bachelors in Computer Science and engineering from the Indian Institute of Technology (IIT), Jammu, India. It is one of the prestigious institutes in India. During my time there, I participated in various inter IIT tech meets, and held leadership positions multiple times, the most significant of which was as Cultural Secretary.

I collaborated with Professors for work in AI. A result of which led to successful publications, term papers, and various semester projects. I am immensely grateful to professors there for their teaching. To Dr. Harkeerat Kaur for her guidance in research and for Prof. Sumit Kumar Pandey for his guidance during hard times and for career.