Databricks is the lakehouse company$1. .$1
Apache Spark • Apache Spark Training • Cloud Computing • Big Data • Data Science
March 20
🏢 In-office - San Francisco
Databricks is the lakehouse company$1. .$1
Apache Spark • Apache Spark Training • Cloud Computing • Big Data • Data Science
• Apache Spark: Develop the de facto open source standard framework for big data. • Data Plane Storage: Provide reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. • Delta Lake: A storage management system that combines the scale and cost-efficiency of data lakes, the performance and reliability of a data warehouse, and the low latency of streaming. Its higher level abstractions and guarantees, including ACID transactions and time travel, drastically simplify the complexity of real-world data engineering architecture. • Delta Pipelines: It's difficult to manage even a single data engineering pipeline. The goal of the Delta Pipelines project is to make it simple and possible to orchestrate and operate tens of thousands of data pipelines. It provides a higher level abstraction for expressing data pipelines and enables customers to deploy, test & upgrade pipelines and eliminate operational burdens for managing and building high quality data pipelines. • Performance Engineering: Build the next generation query optimizer and execution engine that's fast, tuning free, scalable, and robust.
• BS (or higher) in Computer Science, related technical field or equivalent practical experience • Comfortable working towards a multi-year vision with incremental deliverables • Motivated by delivering customer value and impact • 5+ years of production level experience in either Java, Scala or C++ • Strong foundation in algorithms and data structures and their real-world use cases • Experience with distributed systems, databases, and big data systems (Spark, Hadoop)
• Comprehensive health coverage including medical, dental, and vision • 401(k) Plan • Equity awards • Flexible time off • Paid parental leave • Family Planning • Gym reimbursement • Annual personal development fund • Work headphones reimbursement • Employee Assistance Program (EAP) • Business travel accident insurance
Apply Now