ml engineer video generation

Higgsfield AI is a generative AI company focused on AI-powered video creation and next-generation creative tools. It serves more than 25M users worldwide, processes over 6M generations per day, and supports 390 Fortune 500 brands.

• Analyze motion and physical dynamics in video, including optical flow, camera vs. object motion, temporal consistency, and physical plausibility such as dynamics, collisions, gravity, and deformation;
• Train models for post-training, including reward models;
• Build video classifiers for motion types, shot types, genres, and quality using classical approaches and VLM/embedding-based methods;
• Develop methods for creating multi-shot video sequences, including shot-boundary detection, coherent sequence assembly with consistent characters and scenes, and caption generation for individual shots;
• Work with audio, including speech, music, and sound-event detection, audio-visual synchronization evaluation, audio-quality filtering, and audio-track captioning;
• Apply classical and learned data-curation techniques, including near-duplicate detection, heuristic filtering, VLM-based captioning, synthetic data generation, and dataset versioning;
• Build and run large-scale distributed processing pipelines.

• Strong PyTorch skills and hands-on model training experience, including fine-tuning and deploying classifiers, embedding models, and VLMs;
• Deep knowledge of video-processing methods, including motion analysis, optical flow, tracking, camera-motion estimation, shot-boundary detection, and temporal consistency and quality evaluation;
• Experience building and validating classifiers on video data, including annotation workflows, active learning, threshold calibration, and precision/recall measurement at scale;
• Strong understanding of data-curation techniques such as deduplication, filtering, sampling, and dataset balancing, including their impact on model training;
• Experience processing large-scale unstructured datasets, particularly video, audio, and images.

• Competitive base salary in USD, based on experience, skills, and role scope;
• Equity participation through the company’s stock option program;
• Relocation support to Almaty for candidates moving from another city or country;
• Collaborative, fast-paced environment with direct access to experienced leaders;
• Opportunities for professional growth, ownership, and career development;
• Company-provided equipment, meals, transportation, and other office benefits;
• The team works from the office five days per week for the full working day.