Data Engineer III

Digital Products and Services team members are responsible for securely managing information systems throughout their lifecycle, including knowing what information systems are within their scope of responsibility, understanding what sensitive data is stored, transmitted, or processed on those information systems, enforcing the security principles of least privilege and least functionality, knowing what events may constitute a cybersecurity incident, and understanding their role in security incident response activities.

The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

Come join a remarkable team where quality care meets quality service, in every dimension, every time.

#JoinTeamAubergine #NovantHealth Let Novant Health be the destination for your professional growth.

At Novant Health, one of our core values is diversity and inclusion. By engaging the strengths and talents of each team member, we ensure a strong organization capable of providing remarkable healthcare to our patients, families and communities. Therefore, we invite applicants from all group dynamics to apply to our exciting career opportunities.

• Education: 2 Year / Associate Degree, required. Computer Science or related field. 4 Year / Bachelors Degree, preferred. Computer Science or related field.
• Experience: 8 years of experience in Information Technology, preferred. 3 years of experience with at least one contemporary data transformation tool, required. 
• Licensure/Certification: Microsoft, Databricks, AWS or GCP Certified Data Engineer Associate, required. 
• Additional Skills (required):
  • Proficient in building and optimizing highly scalable data sets, ‘big data’ pipelines and architectures to support structured and semi-structured data processing.
  • Proficient at performing root cause analysis on processes and data to identify opportunities for improvement.
  • Proficient in building processes supporting data transformations, data structures, metadata, dependency, and workload management.
  • Proficient at writing scalable automated unit test and data validation frameworks.
  • Proficient at working with business partners to design and implement automated data validations to maintain data quality.
  • Proficient with data warehousing concepts and design.
  • Proficient in writing and optimizing SQL.
  • Proficient with 2 or more object function/object-oriented scripting languages including Python, Scala, C++, or Java.
  • Proficient with ADLS, Delta Lake, SQL Server, Oracle, NoSQL database.
  • Proficient with implementing lambda data-processing architecture (batch and streaming) such as Azure Event Hubs, Apache Spark (incl. structured streaming), Apache Kafka.
  • Proficient at working independently or within a team and take ownership of tasks.
  • Proficient at explaining and mentoring junior team members in the above concepts and techniques.
  • Proficient at building big data management processes to manage archival, retention, dataset time-travel at scale.
  • Proficient at working in a fast-paced environment and able to handle multiple tasks with minimal supervision.
  • Proficient in DataOps or DevOps and agile methodologies.
• Additional Skills (preferred):
  • Understanding of Healthcare data is desired.
  • Knowledge or experience with HL7 or FHIR.
  • Deep knowledge of and strong experience with leveraging microservices and API-based solutions such as Azure Functions.
  • Proficient with message queuing and stream processing.
  • Experience with Trino or other data virtualization tools.
  • Experience with Informatica Powercenter.
  • Proficient with orchestration of complex data pipelines to process batch and streaming data using Airflow, Azure Event Grid.
  • Proficient at building capabilities to implement row level filtering and column data masking.

It is the responsibility of every Novant Health team member to deliver the most remarkable patient experience in every dimension, every time.

• Our team members are part of an environment that fosters team work, team member engagement and community involvement.
• The successful team member has a commitment to leveraging diversity and inclusion in support of quality care.
• All Novant Health team members are responsible for fostering a safe patient environment driven by the principles of "First Do No Harm".