Data Engineer
**Reports to:** Senior Manager Decision Support and Data Insights
Job Summary:
We are seeking a highly skilled and motivated Data Engineer to join our clients team. The ideal candidate will have a strong background in developing ETL processes, managing a cost model in a SQL database, conducting code reviews, overseeing development processes, and building and maintaining Power Apps. This role will collaborate closely with their data scientist to enhance development practices, set up unit testing procedures, and manage release management. Additionally, the candidate will be responsible for dashboard development to enable effective data visualization and reporting.
Key Responsibilities
1. **ETL Processes:** Develop robust ETL processes to extract, transform, and load data from various sources into the systems, ensuring data accuracy and integrity.
2. **SQL Database Management:** Maintain and optimize a SQL database containing a cost model, ensuring data availability, security, and performance.
3. **Code Reviews:** Conduct thorough code reviews to ensure coding standards, best practices, and quality are upheld across the development team.
4. **Development Process Improvement:** Collaborate with the data scientist and development team to establish and enhance development processes, including version control, unit testing, and continuous integration/delivery.
5. **Release Management:** Oversee the release management process, coordinating with cross-functional teams to ensure smooth and timely deployment of software solutions.
6. **Data Science Support:** Collaborate with the data scientist to implement development best practices, set up unit testing frameworks, and provide technical support for data science initiatives.
7. **Dashboard Development:** Create visually appealing and insightful dashboards to enable data-driven decision-making within the organization.
8. **Power Apps Development:** Design, develop, and maintain Power Apps solutions that streamline business processes and enhance user experiences.
9. **Technical Documentation:** Document technical designs, procedures, and guidelines to facilitate knowledge sharing and onboarding.
**Qualifications and Skills:**
- Bachelor's degree in Computer Science, Engineering, or related field.
- 3 - 5 years of experience in software development, with a focus on ETL processes, SQL database management, and Power Apps.
- Strong SQL skills and experience in database design, optimization, and maintenance.
- Solid understanding of ETL principles and practices.
- Experience with version control systems (e.g. Git) and CI/CD pipelines.
- Familiarity with software development methodologies and best practices.
- Proficiency in Microsoft Power Apps development.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Attention to detail and a commitment to producing high-quality work.
- Experience in dashboard development and data visualization tools is a plus.
- Previous exposure to supporting data science initiatives is an advantage.