Senior Data Engineer
July 3
🏢 In-office - San Francisco
Description
• As a Data Engineer you would be working to design, build, test and create infrastructure necessary for real time analytics and batch analytics pipelines. • You will work with multiple teams within the org to provide analysis, insights on the data. • You will also be involved in writing ETL processes that support data ingestion. • You will also guide and enforce best practices for data management, governance and security. • You will build infrastructure to monitor these data pipelines / ETL jobs / tasks and create tooling/infrastructure for providing visibility into these.
Requirements
• Bachelor's Degree in a quantitative discipline: computer science, statistics, operations research, informatics, engineering, applied mathematics, economics, etc. • 3+ years of relevant work experience in analytics, data engineering, business intelligence, research or related fields. • Experience in at least one programming language (Python, Scala, or other JVM based languages) • Experience working with latency data processing solutions like Flink, Prefect, AWS Kinesis, Kafka, Spark Stream processing etc. • Experience with SQL/Relational databases, OLAP databases like Snowflake. • Experience in messaging/streaming platforms like Kafka, TimestreamDB etc. • Experience working in AWS: S3, MSK, Glue, Athena, EMR, ECR etc. • Experience working with CI/CD systems: Circle-CI, Github Actions, Argo-CD, Spinnaker etc. • Experience working with IAC providers: Crossplane, Terraform, Pulumi etc. • Bonus: Experience with the Energy industry • Bonus: Experience with building IoT and/or hardware products • Bonus: Understanding of electrical systems and residential loads • Bonus: Experience with data visualization using Tableau. • Bonus: Experience in Data loading tools like FiveTran
Benefits
• Competitive compensation + equity grants at a well-funded, venture-backed company • Comprehensive benefits: 100% employee premiums for base plans on medical, dental, vision with options for additional coverage. Parental leave up to twenty four (24) weeks depending on eligibility • Comfortable, sunny office space located near BART and Caltrain public transit • Strong focus on team building and company culture: Employee Resource Groups, monthly social events, SPANcakes recognition breakfast, lunch, and learns • Flexible hours, one holiday per month, and flexible time off
Apply Now
