Computer Vision Engineer interview questions

Vision interviews test whether you can make a model work on real cameras, not just recite architectures. Expect a mix of coding, image fundamentals, deep learning, and a long conversation about a project you built. Here's what each round is really checking and how to answer the questions that come up most.

The process

What happens in each round

  1. 1

    Recruiter screen

    What happens

    Whether your background matches the team's side of vision work: research, production modeling, or edge and robotics. Have a short summary of your best vision project ready.

  2. 2

    Coding round

    What happens

    Clean Python, sometimes C++, often with an image twist: implementing non-max suppression, a convolution, a flood fill or intersection over union from scratch using NumPy arrays.

  3. 3

    Vision and ML fundamentals

    What happens

    Whether you understand what's under the library calls: camera models, loss functions, metrics, augmentation, and why a model trains badly.

  4. 4

    Project deep-dive

    What happens

    Whether you actually did the work you listed. They'll push on data decisions, failure cases and trade-offs until they reach the edge of what you know.

  5. 5

    System design

    What happens

    Whether you can design a full pipeline, from camera to labeled data to deployed model to monitoring, under real limits on latency, cost and hardware.

Questions you're likely to get

1.Walk me through a vision model you took from data to deployment.

Why they ask

This is the question the whole loop hangs on. They want proof you've handled the unglamorous parts, not just training runs.

How to answer

  • Name the business problem and the camera setup before you name the model
  • Explain how the data was collected and labeled, and one labeling problem you fixed
  • Give the metric you chose and why it matched what the customer cared about
  • Describe how it ran in production: hardware, latency, and how you watched it after launch
  • Admit one thing you'd do differently now
2.Your detector does well on the test set but misses objects at a new customer site. How do you debug it?

Why they ask

Domain shift is the most common way vision systems fail in the field. They want a method, not a guess.

How to answer

  • Pull real failure frames from the site and look at them before touching code
  • Compare lighting, camera angle, resolution, compression and object scale against the training data
  • Check the preprocessing path for mismatches like color order or resizing differences
  • Label a small set from the new site to measure the gap honestly
  • Fix with targeted data, augmentation or fine-tuning, then add the site to your eval set
3.Explain mean average precision and when you'd look at something else.

Why they ask

People quote this metric constantly without knowing what goes into it. It tells them how carefully you evaluate.

How to answer

  • Describe how precision and recall come from matching predictions to ground truth using intersection over union
  • Explain averaging across recall levels and across classes
  • Note that the overlap threshold changes the number a lot
  • Say when a per-class breakdown, recall at a fixed precision, or a business metric like missed defects matters more
4.Implement non-max suppression.

Why they ask

It's short, it's specific to detection, and it shows whether you can write array code under pressure.

How to answer

  • Sort boxes by score and keep the highest
  • Compute overlap between the kept box and the rest, then drop any above the threshold
  • Repeat until no boxes remain, and handle the empty input case
  • Mention the vectorized NumPy version and the per-class variant
5.How does a pinhole camera model map a point in the world to a pixel?

Why they ask

Geometry separates vision engineers from people who only train classifiers. Robotics and AR teams lean hard on this.

How to answer

  • Explain extrinsics moving the point into the camera frame
  • Explain intrinsics: focal length and principal point projecting it onto the image plane
  • Mention lens distortion and how calibration estimates it, for example with a checkerboard in OpenCV
  • Connect it to a task like measuring distance or fusing with another sensor
6.You need this model to run in real time on an edge device. What do you try?

Why they ask

A huge share of vision work ships on Jetson boards, phones and smart cameras. They want to see you know the toolbox and its costs.

How to answer

  • Profile first to find whether preprocessing, the model or postprocessing is the bottleneck
  • Try a smaller backbone or lower input resolution and measure the accuracy cost
  • Export to ONNX and optimize with TensorRT or OpenVINO, using half precision or integer quantization with a calibration set
  • Move resizing and color conversion onto the GPU and batch or pipeline frames where latency allows
7.How would you build a labeling pipeline for a new detection task?

Why they ask

Data quality decides most vision projects. They want to know you treat labels as engineering work.

How to answer

  • Write clear labeling guidelines with pictures of tricky cases
  • Use a tool like CVAT or Label Studio and run a small pilot to find ambiguity
  • Measure agreement between labelers and review a sample every batch
  • Use model predictions to pre-label and to find likely mistakes
  • Pick what to label next from where the model is unsure
8.Your segmentation model's loss stalls early. What do you check?

Why they ask

Training bugs are common and silent. They want a calm, ordered checklist.

How to answer

  • Overfit a handful of images first to prove the pipeline can learn at all
  • Visualize inputs and masks after augmentation to catch misaligned labels or wrong normalization
  • Check class imbalance and consider a different loss, like Dice or focal loss
  • Look at learning rate, frozen layers and whether pretrained weights actually loaded
9.When would you use classical computer vision instead of a neural network?

Why they ask

Good engineers pick the cheapest thing that works. This shows judgment.

How to answer

  • Name cases with controlled lighting and fixed cameras, like measuring parts on a conveyor
  • Mention tools such as thresholding, contours, template matching, feature matching and optical flow
  • Point to the benefits: no training data, predictable behavior, tiny compute
  • Say when you'd combine them, like a network finding the region and classic geometry measuring it
10.Design a system that counts people entering a store from ceiling cameras.

Why they ask

It's a compact design problem that touches detection, tracking, privacy and deployment all at once.

How to answer

  • Ask clarifying questions: camera count, angle, lighting, accuracy target and whether it runs on site or in the cloud
  • Propose a head or person detector plus a multi-object tracker, with a virtual line to count crossings
  • Cover the hard cases: groups, occlusion, people turning back, staff walking through
  • Explain privacy choices like processing on the device and storing counts rather than video
  • Describe monitoring by comparing counts against a manual tally on sample days
11.Tell me about a time a model you shipped caused a problem.

Why they ask

They want honesty and ownership. Everyone who has shipped vision has a story like this.

How to answer

  • Pick a real incident with a clear effect on users or the business
  • Explain how it was found and how quickly
  • Walk through the root cause and the fix
  • Name the process change you made so it wouldn't repeat, like a new eval slice or a release check

Mistakes that sink good candidates

Talking only about architectures you read about and never about data you handled yourself

Quoting metric numbers from a project without knowing how the test set was built

Treating deployment, latency or hardware as someone else's job when the posting says edge or real time

Claiming team results as your own and then stalling when they ask which part you wrote

Need more Computer Vision Engineer interviews to prep for?

HeroApply applies to Computer Vision Engineer jobs that match you, every day. 74 jobs are open today.

Find Computer Vision Engineer jobs