Lead Data Engineer

Compensation

: $94,330.00 - $148,460.00 /year *

Employment Type

: Full-Time

Industry

: Information Technology



Loading some great jobs for you...





A multinational mass media and entertainment company seeks a Lead Data Engineer to lead the architecture, design and implementation of projects focused on collecting, aggregating, storing, reconciling and making data accessible from disparate sources to enable analysis and decision making. As an independent contributor, this individual will collaborate within a team of technologists to produce enterprise scale solutions to meet our clients needs.

REQUIREMENTS

6+ years of experience designing and implementing large-scale, complex, data-driven applications on the cloud, preferably on AWS.

6+ years of hands-on programming experience with Python, frameworks (Spark and Airflow) and streaming technologies (Kafka/Kinesis)

6+ years of hands-on experience using SQL to perform complex data manipulation

3+ years of experience modeling data warehouses (Kimball dimensional modeling)

An understanding of technologies and design patterns in fields such as: microservices, streaming/queuing systems, key-value stores and high-performance solutions (vectorization, task and data parallelism)

Ability to deal with ambiguity and work with rapidly-changing business data

Appreciation of the need and ability to design for flexible systems that adapt to evolving user requirements

Must have strong communication skills (written and verbal)


NICE TO HAVE

1+ year of experience working on Snowflake Cloud Datawarehouse on AWS

1+ year of experience with graph database technologies (e.g., Neo4j, TigerGraph)

1+ year of experience building Master Data Management (MDM) solutions

1+ year of hands-on experience with R, Scala, Hive and/or Pig


PREFERRED QUALIFICATIONS

BS/MS/PhD in Computer Science or related field or equivalent experience.

by Jobble


Associated topics: data administrator, data architect, data engineer, data manager, data management, data warehousing, database administrator, etl, hbase, mongo database administrator * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...