CV

Download my resume or view the structured CV below.

Contact Information

Name Om Rastogi
Professional Title MS in Artificial Intelligence
Email rastogi.o@northeastern.edu

Professional Summary

MS student in Artificial Intelligence at Northeastern University, Khoury College of Computer Sciences. Research interests in multimodal ML, computer vision, and diffusion-based generative models. Seeking Summer 2027 research and engineering internships and full-time roles.

Experience

  • 2026 -

    Boston, MA

    ML/CV Graduate Co-op
    C10 Labs
    • Built semi-supervised YOLO training on video frames from Grounding DINO, YOLO and ByteTrack pseudo-labels; precision 38% to 93%.
    • Built infant posture classification from DINO features, infant pose and the gravity direction estimated by GeoCalib.
    • Built a phone capture prototype (wide + ultrawide + IMU) and offline pipeline for metric SfM, stereo + Depth Pro depth fusion, Gaussian splatting, and MegaSaM trajectories rescaled with phone sensors (8.5 cm to 1.2 cm error).
  • 2025 -

    Boston, MA

    Graduate Research Assistant
    Northeastern University — Augmented Cognition Lab
    Research on multimodal ML, video understanding, and human motion estimation, under the supervision of Prof. Sarah Ostadabbas.
    • Co-authored AdShot, a benchmark for advertisement video clipping with multimodal LLMs, accepted at NeurIPS 2026 Datasets & Benchmarks track.
    • Extending GVHMR to multi-person scenarios using scene detection, Visual Odometry patching, SMPL mesh overlay rendering, and YOLO tracking on Northeastern Discovery cluster (SLURM).
    • Supporting IARPA MOVES pre-proposal at the Augmented Cognition Lab.
  • 2025 - 2025

    Bengaluru, India

    Research Engineer
    Dashtoon
    • Trained and shipped Flux LoRA adapters for 20+ characters across 8 animation styles; validated at 2048 resolution with FP16, batching, and caching optimizations.
    • Integrated Hidream-l1 (MoE) into animated character pipeline; improved prompt alignment and output smoothness at 2048 resolution.
    • Curated 10,000+ image Bollywood dataset from 100+ movies via automated extraction pipeline to reduce regional bias in generation.
    • Evaluated Google Veo 2 (early access) for character animation; partnered with GCP team to integrate workflow into Frameo AI platform.
  • 2024 - 2025

    Bengaluru, India

    Project Associate
    Indian Institute of Science (IISc) — Vision and AI Lab
    • Trained DepthDiT, a Diffusion Transformer for monocular depth estimation, adapting PixArt-Alpha and PixArt-Sigma backbones; best checkpoint AbsRel 0.107, δ1 0.88 at 40k steps.
    • Built automated pipeline to curate and QA 30,000 MatrixCity images for depth model training.
    • Designed masked diffusion loss for reflective surfaces; implemented DreamBooth and RealFill-inspired inpainting workflows.
  • 2023 - 2024

    Remote

    Research Collaborator
    Carnegie Mellon University (Collaboration)
    • Evaluated transfer learning for 3D cryo-ET classification using MedicalNet and ModelNet40-pretrained models.
    • Analyzed pretrained representations with t-SNE to assess cross-domain transferability to cryo-ET.
    • Converted 3D cryo-ET volumes into point-cloud representations for comparison against voxel-based pipelines.
  • 2022 - 2024

    Gurugram, India

    Senior Research Engineer (Founding Member)
    Menmitsu Private Limited
    • ITC Freight Damage Mitigation: deployed YOLO-based truck-loading monitoring achieving 70% rough-handling detection accuracy with <5% false positives; led integration of 3 intelligent modules operating in near real-time.
    • Smartivity Defect Detection: achieved 97% accuracy on missing-part detection, reducing inspection time from 10 to 2 seconds (5x speedup); built millimeter-precision homography-based deviation detection system.
  • 2021 - 2022

    Gurugram, India

    Data Scientist
    EZ Works
    • Finetuned Neural Machine Translation models (Arabic–English) exceeding 50 BLEU score; deployed with ONNX-optimized beam search for faster inference.
    • Built BERT-based translation memory with custom batch cosine similarity achieving 10x retrieval speedup.
    • Implemented LCNN for wireframe and tabular detection in PPT; built document segmentation for image-based documents.
    • Built EZ Flip chart/diagram conversion modules with 100% error-free output at 3x speed improvement.
  • 2020 - 2021

    India

    Machine Learning Engineer (Intern)
    CyberCure Technologies
    • Built LSTM-based demand forecasting for 200+ products across state/territory/beat/shop-owner hierarchy; 90% accuracy on frequently selling products.
    • Added convolutional models to mitigate exogenous correlation, improving accuracy and reducing training/inference time by 2x.
    • Designed and deployed analytics dashboard for predictions and demand analysis.
  • 2019 - 2020

    Noida, India

    Python Developer (Intern)
    Arcturus Business Solutions
    • Upgraded GUI for Intelligent Surveillance Solution using Python PyQt5 and SQL.
    • Added new features and incorporated statistical dashboard into existing system.
  • 2018 - 2018

    Ghaziabad, India

    Intern
    Central Electronics Limited
    • Quality check in System Production Department; training in Digital Axle Counter for Indian Railways, Solar Panels, and Microwave Electronics.

Education

  • 2025 - 2027

    Boston, MA

    Master of Science
    Northeastern University
    Artificial Intelligence
    • Khoury College of Computer Sciences
    • Affiliated with Augmented Cognition Lab, advised by Prof. Sarah Ostadabbas
  • 2017 - 2021

    Noida, India

    Bachelor of Technology
    JSS Academy of Technical Education, Noida
    Electronics and Communication Engineering
    • Creative Head at Quanta JSS; Member of EDC

Publications

  • 2021
    Color Masking Method for Variable Luminosity in Videos with Application in Lane Detection Systems
    Proceedings of International Conference on Machine Intelligence and Data Science Applications, Springer

    A color thresholding method independent of lighting conditions using a two-layered process: luminosity filter followed by variable color threshold. Applied to lane detection for robust performance across weather and time-of-day variations.

Certificates

  • Graph Theory and Machine Learning: From Fundamentals to Advanced Applications - Indian Institute of Science (2024)
  • Amazon Web Services Cloud Practitioner - Amazon Web Services (2021)
  • Deep Learning Specialization - DeepLearning.AI (2020)
  • Applied Machine Learning in Python - University of Michigan (2020)
  • Machine Learning - Stanford University (2019)

Skills

Machine Learning & AI (Expert): PyTorch, Diffusion Models, Transformers, LoRA, Flux, DiT, Computer Vision, Multimodal LLMs, Depth Estimation, YOLO, NMT, BERT
Infrastructure & Deployment (Intermediate): AWS, GCP, Docker, SLURM, ONNX, FastAPI, LangGraph, ChromaDB, Railway, Vercel
Programming (Expert): Python, SQL, PyQt5, React