Spotter
Spotter empowers top YouTube creators to accelerate their business and unleash their full creative potential by giving them access to the capital, knowledge, and community they need to succeed at scale$1. .$1
51 - 200
Senior Data Engineer
March 15
🏢 In-office - Los Angeles
Spotter
Spotter empowers top YouTube creators to accelerate their business and unleash their full creative potential by giving them access to the capital, knowledge, and community they need to succeed at scale$1. .$1
51 - 200
Description
• Develop and maintain scalable data pipelines, including: ETL pipelines, both single and multi-node solutions • Build data quality assurance steps for new and existing pipelines • Create derived datasets with augmented properties • Work on analytics ready datasets to power internal and creator facing tools • Troubleshoot issues when they arise, working directly with internal data consumers • Automate pipeline runs with scheduling and orchestration tools • Work with large scale datasets • Work with/use various external APIs to enhance data • Setup database tables for analytics users to consume the data • Work with big data technologies to improve data availability and data quality in the cloud (AWS) • Mentor members of the team
Requirements
• Bachelor’s degree, preferably in Computer Science or Computer Information Systems • 4+ years of software engineering experience • 3+ years of data engineering experience with Apache Spark or Apache Flink • 3+ years of experience running software and services in the cloud • Proficiency in working with DataFrame APIs (Pandas and Spark) for parallel and single node processing • Proficiency using advanced languages and techniques with Python, Scala, etc. with modern data optimized file formats such as Parquet and Avro • Proficiency with SQL on RDBMS and data warehouse solutions like Redshift • Additional Valued Skills: Experience with YouTube APIs, data acquisition from external APIs at large scale / in parallel processing, Data-Lake technologies, AWS Glue metastore, Data-Mesh approaches, data cataloging, data lineage and data governance tools and approaches, vector databases
Benefits
• Medical and vision insurance covered up to 100% • Dental insurance • 401(k) matching • Stock options • Complimentary gym access • Autonomy and upward mobility • Diverse, equitable, and inclusive culture, where your voice matters • COVID-19 Vaccination Policy: Spotter requires proof of being fully vaccinated for COVID-19 as a condition of commencing employment
Apply Now
