Together AI
The future of AI is open-source. Let's build together.
Artificial Intelligence • Cloud Computing • LLM • Open Source • Decentralized Computing
11 - 50
Software Engineer, LLM Inference Frameworks Engineer
June 26
🏢 In-office - San Francisco
Together AI
The future of AI is open-source. Let's build together.
Artificial Intelligence • Cloud Computing • LLM • Open Source • Decentralized Computing
11 - 50
Description
• Develop and optimize large language model (LLM) inference frameworks • Optimize GPU and CUDA performance for high-performance LLM inference engine • Design and implement distributed inference infrastructure for LLM • Build monitoring and management tools for online inference servers reliability and scalability
Requirements
• Bachelor’s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience • Proficient in C/C++, Python, or Rust with a strong understanding of algorithms and data structures • At least 3 years of experience working in ML infrastructure • Solid understanding of deep learning training frameworks such as PyTorch and TensorFlow
Benefits
• Competitive compensation • Startup equity • Health insurance • Remote work flexibility
Apply Now
