Senior Forward Deployed Engineer, ML Infrastructure & Inference
Black Forest LabsSan Francisco, CAposted 13h ago
- PayUSD / yr
- $273k – 395k
- Where
- San Francisco, CA
- Posted
- Nov 19
- 13 hours ago
- Type
- Full-time
- Setup
- Hybrid
At a glance
Deploy and optimize FLUX-powered ML systems for enterprise customers, from custom inference pipelines and evaluations to production infrastructure. Lead technical delivery while turning field learnings into reusable tooling.
Summarized by AI from the original posting
What you'll do
- Build custom FLUX endpoints and pipelines for customers
- Take customer use cases from scoping through production deployment
- Deploy FLUX models and custom pipelines to customer environments
- Configure serving, GPU sizing, and scaling
- Profile workloads and optimize inference for cost and latency
- Build evaluation sets and harnesses and catch model regressions
- Help customers adapt models through fine-tuning and LoRA pipelines
- Advise on deployment architecture and hosting trade-offs
- Feed field learnings into research and platform teams
- Create reusable tooling, reference architectures, and documentation
- Set applied deployment standards and mentor engineers
Requirements
- 01Significant experience building and running ML systems in production
- 02Hands-on experience serving ML models from model code to API
- 03Experience building end-to-end applied ML systems
- 04Experience with customer engineering teams in complex enterprise environments
- 05Security review and regulated or air-gapped environment experience
- 06Strong Python skills and ability to modify model code
- 07Clear communication with technical and non-technical stakeholders
- 08Willingness to take Technical Deployment Lead responsibility
- 09Willingness to travel occasionally nationally and internationally
Perks
Skills
Full description
About Black Forest Labs
We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.
Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.
Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.
What You’ll Work On
As a Forward Deployed Engineer, ML Infrastructure & Inference at BFL, you will:
Build custom endpoints and pipelines on top of FLUX for our customers: multi-step workflows, prompt harnesses and upsampling, pre- and post-processing, moderation and safety layers, and combinations of FLUX with VLMs and other models
Take customer use cases from scoping to proof of concept to a production endpoint, running on BFL's or the customer's infrastructure
Own the deployment of FLUX models and custom pipelines into customers' production environments, from on premise to BFL-hosted integrations, including serving setup, GPU sizing and scaling
Profile customer workloads, apply existing inference optimizations to hit cost and latency targets, and partner with BFL's inference team on deeper optimization work
Build evaluation sets and harnesses against customer requirements, and catch quality regressions across model versions
Help customers adapt models to their use case through finetuning and LoRA training pipelines on their own or BFL's infrastructure
Advise customers on deployment architecture and on the trade-offs between BFL-hosted and self-hosted setups (cost, latency, security, compliance)
Feed field learnings back to BFL's research and platform teams, and turn repeated customer work into reusable tooling, reference architectures and documentation
Act as a technical thought leader within the FDE team, setting standards for applied and deployment work and mentoring other engineers
What We’re Looking For
6+ years of engineering experience, with significant time building and running ML systems in production
Hands-on experience building and serving ML models in production, from model code to API (e.g. PyTorch, model serving frameworks, GPU workloads)
Experience building applied ML systems end to end: pipelines combining multiple models, evaluation, and safety or moderation components
Solid infrastructure skills: Kubernetes, containerization, observability, and at least one major cloud platform (AWS, GCP, Azure)
Experience working directly with customer engineering teams in complex enterprise environments, including security reviews and regulated or air-gapped setups
Strong Python skills and comfort reading and modifying model code
Ability to explain complex technical trade-offs clearly to both engineers and non-technical stakeholders, internally and externally
Willingness to take on Technical Deployment Lead (TDL) responsibility for strategic accounts, owning the technical relationship and delivery end to end
Willingness to travel occasionally, nationally and internationally, for team offsites and customer engagements
Nice to have
Prior knowledge of diffusion models and/or flow matching, and relevant finetuning and distillation techniques
Inference optimization experience and a track record of improving latency, throughput or cost per generation
Experience with LLMs or VLMs for prompt harnesses, captioning or evaluation
Experience with open source tooling from the FLUX ecosystem such as ComfyUI, diffusers and common trainer frameworks
Experience serving video generation models
Open-source contributions to inference, serving or diffusion model projects
Previous experience as a forward deployed engineer, solutions architect or ML platform engineer at an AI lab or cloud provider
How We Work Together
We’re a distributed team with real offices that people actually use. This role is based in San Francisco, and you’ll join us in the office at least 2 days a week, or one full week every other week.
Everything we do is grounded in four values:
Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.
Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.
Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.
Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.
Closing
If this sounds like work you'd enjoy, we'd love to hear from you.
Compensation
USD 273-395K + equity, depending on profile