Brex · Primly Community

Brex machine learning engineer interview: what they're actually testing (it's not what you think)

ml_mike · 4 replies

just wrapped a brex ml engineer loop and wanted to write this up while it's fresh. brex isn't an ml-first company, which means their ml interviews are shaped differently than what you'd expect from a pure ml shop like spotify or airbnb.

what the loop looked like: recruiter screen (30 min, standard) ml fundamentals screen with a senior ml engineer (60 min) coding round: data manipulation + model evaluation script in python (60 min) system design: ml-flavored (60 min) behavioral + cross-functional (45 min)

the ml fundamentals screen: not a quiz. they asked me to walk through a past project end to end: how i framed the problem, chose features, validated offline vs online. they pushed on things like class imbalance in fraud detection and how i'd think about threshold selection. brex has a payments/fraud context, so skewing toward that domain in your examples helps.

coding round: no leetcode. they gave me a csv of transaction data and asked me to compute features, identify anomalies, and write a basic evaluation loop. pandas + sklearn. the point seemed to be: can you do applied ml work, not theoretical ml math.

ml system design: they asked me to design a real-time transaction risk scoring system. latency constraints, feature stores, model serving, feedback loops. i leaned into the fintech-specific complexity (card-not-present fraud, velocity checks) and that landed well. they want engineers who understand the product domain, not just model architectures.

behavioral: normal for fintech. tell me about a time you disagreed with a business stakeholder about a model's readiness. how do you handle a model in prod that's degrading.

overall take: brex ml interviews feel more like applied engineering than pure research. if your background is heavy on transformers and papers, prepare to contextualize that to practical product impact. if you're a solid ml engineer who ships things, you'll feel comfortable here.

4 replies

ds_dmitri

the transaction data coding round is interesting. did they give you a clean dataset or one with obvious data quality issues baked in? asking because anomaly detection on messy data is a completely different skill than on a pre-cleaned sample.

ml_mike

there were definitely some nulls and a few obvious outliers that seemed intentional. they were watching how i handled missing values before jumping to modeling. don't skip the data quality checks is my takeaway.

infra_ines

the feature store discussion in system design, did they push on latency requirements? i've seen fintech system design rounds where 'sub-50ms for fraud scoring' becomes the whole conversation and the model architecture almost doesn't matter.

analyst_ana

do they hire data scientists separately from ml engineers or is it one track at brex? i'm more of a ds background (sql, experimentation, some sklearn) and not sure if i'd fit this loop.