Data Engineer II

Job Location US-NC-Winston-Salem
Job Opening ID
2022-148686
Facility
Consolidated Building II
Department
DPS Enterprise Data Mgmt
Work Schedule
8:00am-5:00pm
Job Status
Full-Time

Overview

Digital Products and Services team members are responsible for securely managing information systems throughout their lifecycle, including knowing what information systems are within their scope of responsibility, understanding what sensitive data is stored, transmitted, or processed on those information systems, enforcing the security principles of least privilege and least functionality, knowing what events may constitute a cybersecurity incident, and understanding their role in security incident response activities.

 

The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

 

Come join a remarkable team where quality care meets quality service, in every dimension, every time.

 

#JoinTeamAubergine #NovantHealth Let Novant Health be the destination for your professional growth.

 

At Novant Health, one of our core values is diversity and inclusion. By engaging the strengths and talents of each team member, we ensure a strong organization capable of providing remarkable healthcare to our patients, families and communities. Therefore, we invite applicants from all group dynamics to apply to our exciting career opportunities.

Qualifications

Education:  Associate's degree in computer science or related field required.  Bachelor's degree in computer science or related field preferred.

Experience:  A minimum of five years in Information Technology preferred.  A minimum of two year with at least one contemporary data transformation tool required.

License: Microsoft, Databricks, AWS or GCP Certified Data Engineer Associate preferred.

Additional skills required:

  • Capable of building and optimizing highly scalable data sets, ‘big data’ pipelines and architectures to support structured and semi-structured data processing.
  • Capable of performing root cause analysis on processes and data to identify opportunities for improvement
  • Capable of building processes supporting data transformations, data structures, metadata, dependency, and workload management.
  • Capable of writing scalable automated unit test and data validation frameworks.
  • Capable of working with business partners to design and implement automated data validations to maintain data quality
  • Capable with data warehousing concepts and design.
  • Capable of writing and optimizing SQL
  • Capable of writing code in 2 or more object function/object-oriented scripting languages including Python, Scala, C++, or Java
  • Capable of working with ADLS, Delta Lake, SQL Server, Oracle, NoSQL database.
  • Capable of implementing lambda data-processing architecture (batch and streaming) such as Azure Event Hubs, Apache Spark (incl. structured streaming), Apache Kafka
  • Capable of working independently or within a team and take ownership of tasks.
  • Capable of explaining and mentoring junior team members in the above concepts and techniques.
  • Capable of building big data management processes to manage archival, retention, dataset time-travel at scale.
  • Capable of working in a fast-paced environment and able to handle multiple tasks with minimal supervision.
  • Capable of DataOps or DevOps and agile methodologies    

Additional skills preferred:

  • Understanding of Healthcare data is desired.
  • Knowledge or experience with HL7 or FHIR
  • Experience with leveraging microservices and API-based solutions such as Azure Functions
  • Capable of working with message queuing and stream processing.
  • Experience with Trino or other data virtualization tools
  • Experience with Informatica Powercenter.
  • Capable of orchestration of complex data pipelines to process batch and streaming data using Airflow, Azure Event Grid.
  • Capable of building capabilities to implement row level filtering and column data masking.

Responsibilities

It is the responsibility of every Novant Health team member to deliver the most remarkable patient experience in every dimension, every time.

  • Our team members are part of an environment that fosters team work, team member engagement and community involvement.
  • The successful team member has a commitment to leveraging diversity and inclusion in support of quality care.
  • All Novant Health team members are responsible for fostering a safe patient environment driven by the principles of "First Do No Harm".

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed

Need help finding the right job?

We can recommend jobs specifically for you! Click here to get started.