Big Data Engineer

19 hours ago

Apply Now

Receive Emails with Similar Jobs

ASCENDING Inc.

WebsiteLinkedInAll Job Openings

AWS Certified Advanced Consulting Partner, provides Cloud Consulting/Migration/Operation, Data Analytics, IT Staffing.

Software Engineer candidate • aws • devops • cloud engineer • java

11 - 50

Description

• Design, build, and optimize data pipelines to support business initiatives. • Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities. • Optimize algorithms and work on complex SQL queries for data solutions. • Work within an AWS environment, particularly EMR , to manage and process large data sets. • Use Python, Java, or Scala for development, alongside test-driven development practices. • Build and maintain unit tests to ensure code quality.

Requirements

• 3-6 years of hands-on experience in data engineering. • Strong expertise in Python (or Java/Scala ), with proven coding proficiency. • Advanced experience in SQL , specifically for structuring complex queries. • Experience building data pipelines (not ETL) and optimizing algorithms. • Knowledge of AWS EMR and working in a big data environment. • Familiarity with Spark and test-driven development.