Sr. Data Engineer

July 20

Apply Now

Receive Emails with Similar Jobs

Craft.co

WebsiteLinkedInAll Job Openings

Creating a more resilient global supply chain.

Technology • company search • data analytics • recruiting • competitive intelligence

51 - 200

Description

• Building and optimizing data pipelines (batch and streaming) • Extracting, analyzing and modeling of rich and diverse datasets • Designing software that is easily testable and maintainable • Support in setting data strategies and our vision • Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft • Work on extendable data processing systems that allows to add and scale pipelines • Applying Machine learning techniques such as anomaly detection, clustering, regression classification, summarization to extract value from our data sets

Requirements

• 3+ years of experience in Data Engineering • 3+ years of experience with Python • Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment • Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing • Knowledge and experience of Amazon Web Services (AWS) and Databricks (nice to have) • Familiar with infrastructure-as-code approach • Shows curiosity through asking questions, digging into new technologies, and always trying to grow • Kind, and empathetic with your teammates and others • Strong problem solving and the ability to communicate ideas effectively • Self-starter, independent, likes to take initiative • Our current technology stack (experience with all technologies not required): Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker, Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS), CircleCI, GitHub

Benefits

• Competitive salary starting at $160,000 USD/ year • Equity at a well-funded, fast-growing startup • Unlimited vacation time so you can take what you need, when you need it • 99% covered health + dental + vision insurance for employees and dependents • 401K through Empower with options to invest how you want it • $200 monthly wellness/ learning stipend (Gym memberships, meals, snacks, books, classes, conferences, etc.)