Senior Data Engineer
March 18
🏢 In-office - San Francisco
Description
• Own the implementation of our data platform for highly scalable real-time event ingestion and data streaming anti-abuse infrastructure running on Kubernetes • Design and implement the distributed infrastructure for scalable counting and real-time feature generation backed by Redis and BigTable running on PubSub • Supply real-time features to custom machine learning models served via gRPC services
Requirements
• Bachelors in Computer Science or equivalent experience in data engineering infrastructure • 2+ years of industry experience, working on production backend data infrastructure • 3 years software programming experience in 2‐3 of the following: Python, Golang, SQL, Scala, Java, C/C++, etc • Experience with running large data processing tasks in cloud environments (eg, AWS, Google Cloud) • Excellent understanding of 2‐3 of stream processing technologies like Flink, Spark, Kafka, PubSub, etc. • Familiar with horizontally scalable databases like Redis, Cassandra, BigTable • Exposure and understanding to Kubernetes and containerized environments • Experience working in adversarial systems like fraud or content moderation is a plus
Benefits
• Platinum-level medical, dental, and vision insurance • Generous PTO, sick leave, and parental leave • Up to $100 in reimbursement for personal health & wellness expenses each month • 401(k) plan
Apply Now
