July 9
🔄 Hybrid – Bay Area
• Design, improve, and maintain AI features at Observe. • Finetune and serve LLMs in production. • Build AI agentic workflows to improve the observability of users’ systems.
• 3+ years of experience working in generative AI • Master’s in Computer Science or related field. • Experience with RAG • Experience evaluating LLMs and RAG systems • Experience with Huggingface Transformers • Worked on a model that’s been deployed in production • Python expertise • Great written and spoken English communication skills about technical topics • Knowledge of the Python data science stack: (Scikit-Learn, Numpy, Pandas)
• Experience building AI agents • Experience pre-training and/or fine-tuning LLMs at the 1b+ scale • Experience building scalable applications with LLMs, using frameworks such as LangChain, LlamaIndex, etc. • Experience working with adapters, e.g. LoRA • Experience with Pytorch • Experience with FastAPI or Flask • Experience with LLM-powered synthetic data labelling and evaluation • Experience in the observability domain • Experience with data processing tools like Apache Spark, Huggingface Datasets, or similar • Experience with Go
Apply Now