Senior Data Engineer
April 17
🏢 In-office - San Francisco
Description
• Design, build, and own the core data models and infrastructure to manage data across Nightfall’s analytics stack - AWS, Kafka, Glue, S3, Snowflake, Cassandra, Cockroach DB, Tableau, and Datadog. • Collaborate closely with Data Analysts to unlock the data needed to power dashboards, ad-hoc analyses, monitoring, and high-quality decision-making across the company. • Collaborate closely with ML Engineering and Data Science to scale our data pipelines for machine learning, analytics, and data annotation. • Design and implement a data quality monitoring system with source-to-target data validations and anomaly detection. • Collaborate with Security and Engineering to meet data governance requirements.
Requirements
• SQL Expert. Solid experience in Python or similar. • Experience (3+ years) with analytical data warehouses/lakes. AWS/Snowflake preferred. • Experience (3+ years) developing data pipelines supporting ML/NLP projects. Experience with popular MLOps and data annotation platforms is a plus. • Experience (3+ years) analyzing complex datasets using SQL, optimizing queries, working with Data Analysts to automate dashboards (Tableau preferred), and performing ad-hoc analyses that lead to actionable business insights. • Bachelor's degree in Computer Science or related field. MS/PhD a plus. • Experience with source code repositories and cloud monitoring tools (Datadog preferred). • Possess excellent communication skills, strong analytical skills, and the ability to work independently and as part of a team. • The ability to thrive in a dynamic environment, being flexible and willing to jump in and do whatever it takes to be successful.
Benefits
• 11 paid holidays • Generous Accrued Time Off increasing with years of service • Generous paid sick time • Annual day of service
Apply Now
