JOB OPPORTUNITES

Data Engineer-9196

Data Engineer-9196

Published: September 8, 2021
Location
Columbus, OH
Job Type
Job ID
9196
Yrs Exp(min)
5
Credentials
None
Salary (Mid)
$115,000
Bonus
Yes
Recruiter
Mark Nicklas
Recruiter Phone Number
800 543-2553

Description

Insurance Company in the Midwest has a need for a Data Engineer. within the Data and Analytics Team. This position is responsible for data engineering processes supporting analytics and reporting solutions for Agency, Sales and Operations. This position will be part of a team to design and build data pipelines into data platforms that meets business requirements. This position will also help execute a strategic roadmap to a cloud data platform.

Key Responsibilities:
● Apply all Phases of Software Development Life Cycle (Analysis, Design, Development, Testing and Maintenance) using Waterfall and Agile methodologies.
● Utilize AWS platform tools for creating tables, data distribution by implementing Partitioning and Bucketing.
● Develop DataFrame and RDD (Resilient Distributed Datasets) to achieve unified transformations on the data load.
● Develop scheduling and monitoring Rundeck or Oozie workflows
● Transfer data from different platforms into and from AWS platform.
● Manage the source code in Phabricator or Github.
● Track and deliver requirements in Jira.
● Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
● Create metrics and apply business logic using Spark, Scala, R, Python, and/or Java.
● Support Data Engineering team in designing and building effective and efficient data pipelines for ingestion for analytics and reporting.
● Drive the collection of new data and the refinement of existing data sources.
● Define, improve, and maintain data infrastructure and any related architecture.
● Locate, profile, cleanse, map, import and merge data from various sources
● Model, design, develop, code, test, debut, document and deploy application to production through standard processes.
● Harmonize, transform, and move data from a raw format to consumable and curated views.
● Apply strong Data Governance principles, standards, and frameworks

Qualifications
● Bachelor’s degree in Computer Science, Computer Engineering, Programming, Management Information Systems, or related field. Insurance industry experience is a plus.
● Minimum of five years of prior data engineer experience. (Client will consider a strong P&C Actuary who wants to transition into Data Engineering)
● Proficient in working on Apache Hadoop ecosystem components with AWS EC2 cloud computing.
● Expert in SQL and DataFrames using R and Python for Distributed Data Processing.
● Expertise in various scripting languages like Linux/Unix shell scripts, R,and Python.
● Experience in working with cloud environment AWS EMR, EC2, S3 and Athena and GCP BigQuery.

 

To apply please email: Mark Nicklas | 800 543-2553
Are you seeking an entry-level position?(Required)
Address
Please list other important information.
Max. file size: 256 MB.

Related Jobs

September 16, 2021
September 16, 2021
September 16, 2021
OPEB/Pension Actuary-9199   Remote, Any new
September 10, 2021
September 8, 2021
Are you sure you want to delete this file?
/