- Hark
- San Jose, CA
- 48 days ago
- $180,000 – $450,000
Member of Technical Staff, Multimodal Vision.
Before you go
Before you leave us, sign up for our email alerts
We don't do job spam, just the best digital jobs delivered straight to your inbox.
Member of Technical Staff, Multimodal Vision: our view in 3 lines...
- The Role:This role is for an AI specialist working on multimodal vision models that combine text, video, and vision with large-scale machine learning systems.
- The Person:The person will advance vision and video capabilities in multimodal models, build large-scale vision and video data pipelines, design and implement models, create evaluation frameworks, and optimise systems for production deployment.
- Requirements:The ideal candidate has proven experience in vision or video models, image understanding, video modeling, generative vision, multimodal learning, large-scale machine learning systems, distributed training, and data-driven experimentation.
About the role
About Hark
Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.
We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.
To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
About the Role
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, and vision. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.
As part of the Omni team, you will help drive the development of text, video, and multimodal models. This includes working across the full stack—from data and modeling to training, serving, and product integration. You will contribute to both pretraining and posttraining efforts while collaborating closely with product teams to push the boundaries of model capability and deliver exceptional end-to-end user experiences.
Responsibilities
- Drive research and development to advance vision and video capabilities in multimodal models, including image understanding, video modeling, and generative vision systems.
- Develop and improve large-scale vision and video data pipelines, including data collection, filtering, labeling, and synthetic data generation.
- Design and implement state-of-the-art models for vision and video, including multimodal architectures that integrate vision with text and other modalities.
- Build evaluation frameworks and internal benchmarks to measure model performance, robustness, and visual quality across tasks.
- Optimize models and systems for scalability, efficiency, and real-time or production deployment.
- Collaborate closely with product and engineering teams to translate research innovations into impactful, user-facing AI experiences.
Requirements
- Proven track record of advancing vision or video models through innovations in data, modeling, or training.
- Strong experience in areas such as image understanding, video modeling, generative vision (e.g., diffusion, autoregressive models), or multimodal learning.
- Experience with large-scale machine learning systems and distributed training.
- Strong background in data-driven experimentation, evaluation, and iterative model development.
- Strong ownership mindset and ability to drive end-to-end impact from research to production.
Bonus Qualifications
- Background in graphics, rendering, simulation, or 3D vision is a plus.
- Experience with multimodal systems (vision + text, vision + audio) or real-time AI systems is a strong plus.
Compensation
The US base salary range for this full-time position is between $180,000 - $450,000 annually.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

