DearbornRecruiter Since 2001
the smart solution for Dearborn jobs

Data Engineer General

Company: KVR Consultant
Location: Dearborn
Posted on: May 12, 2022

Job Description:

In this role, you will design, build and scale data pipelines that transform billions of records of data to measurable insights in a brand new data ecosystem on GCP. In this role, you will collaborate with multiple organizations (Business Customers, Product Owners, Data Tech, IT) to convert business goals into data pipeline solutions. This role will work in a dynamic team and embrace lean and agile practices, software best practices, automated testing, and CI/CD to build out a massive data lake. Degree: BA/BS in Computer Science or related field, or equivalent experience A day in the life: --- Design, implement and build end-to-end reusable data pipelines that ingest, transform and load data into data marts on-prem and on GCP --- Perform exhaustive testing to create best-in-class pipelines with maximum performance --- Collaborate with a dynamic team to deliver work in an Agile model --- Participate in daily standups and other agile ceremonies --- Deliver quality products on time with CI/CD capabilities following standard data engineering methodologies --- Partner with product teams, business and enterprise teams to build foundational data sets for analytics Required skills: --- 5+ years of IT experience with 3+ years of experience as a Data engineer working in creating batch and real-time data systems. --- Hands-on experience with big data technologies like Hive, Spark, Hadoop. --- Recent accomplishments working with the tech stack: Cloud Dataflow, Dataproc, Big Query, SQL, Hive, Kafka, Cloud storage, Data Fusion, Sqoop, NoSQL, S3 --- Self-starter, strong technical skills, quality oriented and passionate --- Familiar with performance tuning SQL and ETL pipelines --- Proven skills with either Python or Java programming language --- Excellent written and verbal communication and interpersonal skills Skills Required: Hadoop GCP Experience Required: 5+ years Education Required: Bachelors Degree in Computer Science or any equivalent

Keywords: KVR Consultant, Dearborn , Data Engineer General, Other , Dearborn, Michigan

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest Michigan jobs by following @recnetMI on Twitter!

Dearborn RSS job feeds