Senior Research Engineer, Model Inference

May 10

Apply Now

Receive Emails with Similar Jobs

Otter.ai

WebsiteLinkedInAll Job Openings

Award-winning voice-first team collaboration app for meetings and conversations. Otter Voice Meeting Notes.

51 - 200

💰 $50M Series B on 2021-02

Description

• Model optimization: Collaborate with machine learning researchers to understand model architectures and algorithms. • Implement optimization techniques to enhance machine learning models' efficiency and inference speed on production • Deployment and Integration: Work closely with product engineers to integrate machine learning models into production systems in a scalable way • Optimize models for real-time inference, ensuring low latency and high-throughput • Set up monitoring systems to track model performance in real time. • Ensure models can scale horizontally to handle the increased load. • Implement strategies for resource-efficient inference, considering factors such as memory usage and CPU/GPU utilization. • Collaborate with cross-functional teams to understand requirements and constraints. • Provide technical expertise on inference-related matters during the model development lifecycle. • Document the deployment and optimization processes for machine learning models.

Requirements

• 5+ years of professional industry experience • Masters or Ph.D. degree in computer science, machine learning, speech/language processing or related field • Experience in PyTorch • Proficiency in Python • Experience in C++ • Basic knowledge of CUDA • Strong understanding of machine learning models, algorithms, and deployment strategies • Experience with model optimization techniques and performance profiling • Familiarity with docker and Kubernetes • Knowledge of AWS • Experience with monitoring tools

Benefits

• Salary Range: $200,000 to $250,000 USD per year. • The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.