Data Platform Engineer
June 3
🏢 In-office - San Francisco
Description
• We’re looking for an experienced and independent data platform engineer to design and build our data architecture • Leverage Spark, Airflow, Apache Beam, Google Kubernetes Engine, BigQuery and other tools to build robust and efficient data pipelines • Expand and optimize our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams • Collaborate with project leads and other software engineers across multiple teams • Be a leader, use your voice, and apply your tech skills to solve real world problems
Requirements
• BS degree in Computer Science or related technical field, or equivalent practical experience • 6+ years of proven working experience as a data engineer • 5+ years writing production-quality Python • 3+ years’ experience with Spark, either in Python or in Scala. Bonus points for Spark on EMR, Dataproc, or Kubernetes • Working knowledge of Google Cloud tools (compute, cloud storage, GKE, GCR, AutoML, etc.) • Expertise building and optimizing data pipelines using Kafka (preferred), Kinesis, or other event bus • Deep experience with data frameworks and tools like Spark, Spark Streaming, Apache Beam, and Airflow • Comfort with and experience working within CI/CD processes and tools and software development practices • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of SQL and NoSQL databases, including BigQuery (preferable), MySQL/MariaDB, Postgres or Cassandra • Expertise in data modeling for data science, reporting, and analytics, including dimensional and transactional models • Ability to thrive in a fast-paced growing company
Benefits
• Competitive salary and growth opportunities • Company quarterly performance based bonus • Equity stock options package • Employer funded comprehensive health, vision, dental insurance and wellness program for employees and their dependents • Employer funded life and disability insurance coverage • Company HSA, FSA, Dependent Care, 401k, and commuter benefits • Up to 12 weeks paid family leave • In office, remote, and hybrid work location options • Home office and technology stipend for those working outside of a traditional office more than 75% of the time • Flexible time-off plan to empower employees to take time off • Continuing education reimbursement • Routine Team swag deliveries!
Apply Now
