Machine Learning Performance Engineer
Jane Street · New York
Job details
- Firm
- Jane Street
- Location
- New York, US
- Role
- ML Engineer
- Level
- Mid-level
- Type
- Full-time
- Department
- Machine Learning
- First seen
- 2026-11-14
- Last seen
- 2026-11-19
Also hiring for this role in: London.
Description
We are looking for an engineer with experience in low-level systems programming and optimization to join our growing ML team.
Machine learning is a critical pillar of Jane Street's global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction.
Your part here is optimizing the performance of our models – both training and inference. We care about efficient large-scale training, low-latency inference in real-time systems, and high-throughput inference in research. Part of this is improving straightforward CUDA, but the interesting part needs a whole-systems approach, including storage systems, networking, and host- and GPU-level considerations. Zooming in, we also want to ensure our platform makes sense even at the lowest level – is all that throughput actually goodput? Does loading that vector from the L2 cache really take that long?
If you’ve never thought about a career in finance, you’re in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you’ll fit right in.
There’s no fixed set of skills, but here are some of the things we’re looking for:
• An understanding of modern ML techniques and toolsets
• The experience and systems knowledge required to debug a training run’s performance end to end
• Low-level GPU knowledge of PTX, SASS, warps, cooperative groups, Tensor Cores, and the memory hierarchy
• Debugging and optimization experience using tools like CUDA GDB, NSight Systems, NSight Compute
• Library knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS
• Intuition about the latency and throughput characteristics of CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads
• Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, and NVLink, and how to use these networking technologies to link up GPU clusters
• An understanding of the collective algorithms supporting distributed GPU training in NCCL or MPI
• An inventive approach and the willingness to ask hard questions about whether we're taking the right approaches and using the right tools
If you're a recruiting agency and want to partner with us, please reach out to agency-partnerships@janestreet.com .
About Jane Street
Tier 1, elite global · HFT & Prop Trading · HQ New York, NY
Strategies: ETF Arb, Market Making, Quant, Bonds
More jobs at Jane Street
- Jane Street · New YorkFull-time · First seen 2026-11-14
- Jane Street · New YorkFull-time · First seen 2026-11-14
- Jane Street · New YorkFull-time · First seen 2026-11-14
- Jane Street · LondonMid-level · Full-time · First seen 2026-11-14
- Jane Street · LondonMid-level · Full-time · First seen 2026-11-14
- Jane Street · New YorkSenior · Full-time · First seen 2026-11-14
- Jane Street · LondonIntern · Full-time · First seen 2026-11-14
- Jane Street · SingaporeMid-level · Full-time · First seen 2026-11-14
- Jane Street · New YorkMid-level · Full-time · First seen 2026-11-14
- Jane Street · New YorkFull-time · First seen 2026-11-14
Similar jobs in New York
- Point72 Asset Mgmt · New YorkMid-level · Full-time · $180K – $300K per year · First seen 2026-11-19
- Hudson River Trading · New YorkMid-level · Full-time · $250K – $300K per year · First seen 2026-11-19
- Schonfeld Strategic · New YorkMid-level · Full-time · $175K – $225K per year · First seen 2026-11-19
- Schonfeld Strategic · New YorkMid-level · Full-time · $200K – $250K per year · First seen 2026-11-19
- Schonfeld Strategic · New YorkMid-level · Full-time · $225K – $275K per year · First seen 2026-11-19
- Plaid · New YorkMid-level · Full-time · First seen 2026-11-19
- Walleye Capital · New YorkMid-level · Full-time · First seen 2026-11-19
- Walleye Capital · New YorkMid-level · Full-time · First seen 2026-11-19
- Crypto.com · New YorkMid-level · Full-time · First seen 2026-11-19
- FMX · New YorkJunior · Full-time · First seen 2026-11-19
The Quant Researcher Test gives you 20 timed problems in statistics, backtesting, microstructure and risk, and places you from Junior to Guru. Free, no sign-up.
Take the Quant Researcher Test