Data Engineer

SUMMARY OF JOB PURPOSE AND FUNCTION
The Database Engineer ensures data pipelines are scalable, repeatable, secure, and can serve
multiple users.  They help facilitate getting data from a variety of different sources, getting it in
the right formats, assuring that it adheres to data quality standards, and assuring that
downstream users can get that data quickly.  The Database Engineer is responsible for processing diverse sources of data seamlessly.  The Database Engineer has knowledge of the physical database design principles and the full SDLC (analysis, design, implementation, testing and deployment).

ESSENTIAL RESPONSIBILITIES AND TASKS:

• Participate with Business and Technology Stakeholders to refine, create actionable objectives and estimates for completion of quality Software Requirements
• Design and implement data storage (SQL, Postgres, AWS Glue, Aurora, Redshift, Pentaho, etc.)
• Manage application code in a distributed source control system (git, including branching, merging, and rebasing)
• Work with team members to design and implement data solutions in alignment with the project schedule.
• Code, test, and document new or modified data systems to create robust and scalable data platforms, clearly documenting design decisions and system process
• Perform peer reviews of team members application and test code and documentation, ensuring compliance with database design standards and principles and consistency across solutions
• Resolves conflicts between models, ensuring that data models are consistent with the ecosystem model (e.g., entity names, relationships and definitions)
• Help reproduce production system faults for troubleshooting and correction and provide recommendations for improvement of existing software systems
• Expands and grows data platform capabilities to solve new data problems and challenges.
• Creates data flow diagrams for all business systems.
• Interprets data results to business customers.
• Develops, tests, implements, and maintains database management applications.
• Constructs and implements operational data stores.
• Participates in creating, refining, managing and enforcing data management policies, procedures, conventions and standards, modeling best practices in data management.
• Contributes to the establishment of business continuity & disaster recovery requirements, methods and procedures for data systems and databases.
• Ensures compliance with all applicable data privacy and security requirements  (HIPAA, SOC2, etc.)

EXPERIENCE, EDUCATION AND/OR TRAINING:

• Between 2 and 7 years of data engineering, data science, or software engineering experience
• Familiarity with system operations tools and environments (Linux/Unix, OS X, Windows, etc)
• Competent ability to assist less experienced software engineers
• Familiarity with and ability to operate in an agile development process
• Bachelor in computer science, computer engineering, or equivalent work experience.
• Understanding of how algorithms work and experience building high performance algorithms
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases
• Experience with ETL, Data Warehousing, and Data Lake technologies

SPECIAL WORKING CONDITIONS:

• Availability outside of scheduled working hours to address system critical failures (On Call, Tier 3 Support)

REPORTING STRUCTURE:

• Data Engineers report to Engineering Leadership

COMPENSATION:

• Pay: $92,000 - $132,000 per year