Talent.com
Research Scientist - World Modeling
Research Scientist - World ModelingInstitute of Foundation Models • Sunnyvale, CA, US
Research Scientist - World Modeling

Research Scientist - World Modeling

Institute of Foundation Models • Sunnyvale, CA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

We are the AllWorld Team under the Institute of Foundation Model (IFM) at MBZUAI . At AllWorld, we are pioneering the development of the PAN (Physical, Agentic, and Networked) world models —the next-generation foundation models to unlock machine intelligence beyond lingual.

Our mission is to tackle the fundamental challenges of world modeling and establish a new paradigm for next-generation machine reasoning . We are looking for passionate individuals who share our vision and are eager to push the boundaries of AI together.

Key Responsibilities

  • Develop the foundational world model to accurately simulate the physical world.
  • Collaborate with engineering and data teams to tackle key challenges in training the world model on large-scale clusters.
  • Develop metrics and evaluation benchmarks to better assess model performance.
  • Design and implement a scalable and efficient data annotation pipeline to ensure high-quality labeled data for training and evaluation.
  • Optimize inference efficiency to enable real-time interaction.

Areas of Focus

  • Scalable Training Systems : Develop and optimize infrastructure for training multimodal LLMs and video diffusion models at massive scale.
  • Efficient Data Pipelines : Build scalable video data pipelines and annotation frameworks to support high-quality training data.
  • Inference Optimization : Enhance inference efficiency through optimization and distillation techniques to enable real-time interaction.
  • Visual Tokenization : Develop methods for discretizing visual features into tokens for improved model representation.
  • Quantitative Evaluation : Establish rigorous benchmarks to assess physical accuracy, controllability, and intelligence.
  • Scaling Laws for Video Pretraining : Investigate scaling law principles to guide efficient video pre-training strategies.

    • Academic Qualifications

  • MSc or PhD in Machine Learning or Computer Science, or equivalent industry experience.

    • Professional Experience

  • Experience in large-scale model training (LLMs or Diffusion Models) on large clusters.
  • Hands-on experience with state-of-the-art video generative models (e.g., Sora, Veo2, MovieGen, CogVideoX, etc.).
  • Experiences in building and optimizing large-scale video data pipelines.
  • Experience in accelerating diffusion model inference for improved efficiency.
  • Exceptional problem-solving and troubleshooting skills to tackle complex technical challenges.
  • Strong systems and engineering expertise in deep learning frameworks such as PyTorch.
  • Strong communication and collaboration skills for effective cross-functional teamwork.
  • Ability to navigate ambiguity and drive projects in rapidly evolving research areas.
  • Research contributions to top-tier conferences or journals (e.g., ICML, ICLR, NeurIPS, ACL, CVPR, COLM, etc.), with published work in relevant domains.

    • Visa Sponsorship

    This position is eligible for visa sponsorship.

    Benefits Include

  • Comprehensive medical, dental, and vision benefits
  • Bonus
  • 401K Plan
  • Generous paid time off, sick leave and holidays
  • Paid Parental Leave
  • Employee Assistance Program
  • Life insurance and disability
    • [job_alerts.create_a_job]

    Research Scientist • Sunnyvale, CA, US

    [internal_linking.similar_jobs]
    Research Scientist

    Research Scientist

    Adobe • San Jose, California, USA
    [job_card.full_time]
    Changing the world through digital experiences is what Adobes all about.We give everyonefrom emerging artists to global brandseverything they need to design and deliver exceptional digital experien...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    3D Reconstruction Scientist

    3D Reconstruction Scientist

    Array Labs • Palo Alto, CA, US
    [job_card.permanent]
    At Array Labs, we build advanced radar satellite constellations that generate high-resolution 3D maps of the Earth.Our mission is to provide lidar-like 3D data and imagery from space for customers ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Scientist

    Research Scientist

    kadence • Sunnyvale, CA, US
    [job_card.full_time]
    We are a seed-stage AI company building the industry standard for evaluating and benchmarking large language models on real enterprise tasks. As a Research Scientist, you will develop new benchmarks...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Research Scientist

    Research Scientist

    Horizon Robotics • Cupertino, CA, US
    [job_card.full_time]
    HORIZON ROBOTICS : Make human life safer and better.Horizon Robotics (HKEX : 9660) is a leading provider of Smart Driving solutions for passenger vehicles, empowered by our proprietary software and h...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Scientist / Engineer - Training Infrastructure

    Research Scientist / Engineer - Training Infrastructure

    IntelliPro Group Inc. • Palo Alto, CA, US
    [job_card.full_time]
    Research Scientist / Engineer – Training Infrastructure.Palo Alto, CA • Remote - US • Remote - International.We believe that multimodality is critical for intelligence.To go beyond ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Senior / Staff Machine Learning Research Scientist : Generative Modeling for Planning

    Senior / Staff Machine Learning Research Scientist : Generative Modeling for Planning

    Nuro • Mountain View, CA, United States
    [job_card.full_time] +1
    Senior / Staff Machine Learning Research Scientist : Generative Models for Behavior Modeling.Senior / Staff Machine Learning Research Scientist : Generative Models for Behavior Modeling.Senior / Staff Mach...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Scientist, AI Robotics

    Research Scientist, AI Robotics

    VirtualVocations • Santa Clara, California, United States
    [job_card.full_time]
    A company is looking for a Research Scientist in Generalist Embodied Agent Research for New College Grads in 2026.Key Responsibilities Design and implement novel AI algorithms and models for huma...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Research Engineer - World Modeling

    Research Engineer - World Modeling

    Institute of Foundation Models • Sunnyvale, CA, US
    [job_card.full_time]
    About the Institute of Foundation Models.We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next...[show_more]
    [last_updated.last_updated_30] • [promoted]
    AI Research Scientist – World Model

    AI Research Scientist – World Model

    Bosch Group • Sunnyvale, California, USA
    [job_card.full_time]
    Conduct research on GenAI and Foundation models (FM) to address academic and industrial challenges in ADAS AI domain such as 3D reconstruction world model map and localization data curation and aut...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Scientist, World Models for Autonomous Vehicles

    Research Scientist, World Models for Autonomous Vehicles

    Toyota Research Institute • Los Altos, CA, US
    [job_card.full_time]
    At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life.We’re developing new tools and capabilities to amplify the human experience.To lead this tran...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research ScientistEngineer, Model Threat Defense

    Research ScientistEngineer, Model Threat Defense

    DeepMind • Mountain View, California, USA
    [job_card.full_time]
    Artificial Intelligence could be one of humanitys most useful inventions.At Google DeepMind were a team of scientists engineers machine learning experts and more working together to advance the sta...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Research Scientist - World Model

    AI Research Scientist - World Model

    Bosch Group • Sunnyvale, CA, US
    [job_card.full_time]
    At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people’s lives. Our areas of activity are every bit as diverse as our outstan...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Scientist, Model Architectures

    Research Scientist, Model Architectures

    Zyphra • Palo Alto, CA, US
    [job_card.full_time]
    Research Scientist, Model Architectures.Zyphra’s AI Architecture Research Team.This will involve designing and rigorously testing novel model architectures and training methodologies, with a ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research Scientist, LLM

    Research Scientist, LLM

    HMBL • Mountain View, CA, US
    [job_card.full_time]
    HMBL is your premiere Talent Partner and Executive Search Solution.We were founded on the fact that technical recruiting is most fruitful via partnership than it is transactional.We partner the m...[show_more]
    [last_updated.last_updated_30] • [promoted]
    research scientist - RL

    research scientist - RL

    Cerebro • Sunnyvale, CA, United States
    [job_card.full_time]
    Join a Leading Applied Research Lab Pushing the Boundaries of Reinforcement Learning.Are you passionate about advancing the frontiers of. An innovative AI research lab is seeking talented and ambiti...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Research Scientist (AI) - Cell & Tissue Modeling

    Research Scientist (AI) - Cell & Tissue Modeling

    GenBio AI • Palo Alto, CA, US
    [job_card.full_time]
    Headquartered in Silicon Valley, we are a newly established start-up, where a collective of visionary scientists, engineers, and entrepreneurs are dedicated to transforming the landscape of biology...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Applied Research Scientist

    Applied Research Scientist

    Horizon Robotics • Cupertino, CA, US
    [job_card.full_time]
    HORIZON ROBOTICS : Make human life safer and better.Horizon Robotics (HKEX : 9660) is a leading provider of Smart Driving solutions for passenger vehicles, empowered by our proprietary software and h...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Research scientist (Robotics, AI)

    Research scientist (Robotics, AI)

    IntelliPro Group Inc. • Santa Clara, CA, US
    [job_card.full_time]
    Research scientist (Robotics, AI).B;​​​​​​.We are looking for a creative, skilled, and motivated research scientists to join our team in advancing robot ma...[show_more]
    [last_updated.last_updated_30] • [promoted]