Job Purpose or Summary
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong understanding of data warehousing, SQL Server, and Lakehouse platforms such as Databricks. This role will involve managing and organizing data, while also ensuring its quality and accessibility.
Main Responsibilities
- Data Warehouse Construction and Management:Collaborate closely with ERP, Software teams, and functional departments to define data flows and data semantics.
- Execute ETL processes, establish and manage connections with the data warehouse.
- Partner with the analytics team to design appropriate data sets for reporting.
- Adapt data set structures in response to evolving business needs and requirements.
- Document data structures and definitions, maintaining comprehensive and up-to-date records.
- Resolve issues related to the database promptly and effectively.
- Data Warehouse Performance Enhancement:
- Develop optimal data warehousing and data loading solutions in line with product requirements from the analytics and Machine Learning teams.
- Collaborate with the IT team to enhance the data warehouse environment, providing advice and proposing solutions to increase storage capacity, improve loading speed, and reduce costs.
- Monitor the cost and capacity of the data warehouse environment, tracking any issues and resolving them as quickly as possible to ensure the smooth operation of the reporting system and Machine Learning tools.
- Data Security and Integrity:
- Establish and manage outgoing connections from the data warehouse, ensuring stability and security.
- Monitor for any issues that could compromise data accuracy, alerting relevant parties and resolving issues promptly.
- Compliance:
- Adhere to the company’s processes, procedures, regulations, and standards, ensuring all activities are compliant.
- Performance Management:
- Align on individual KPIs with the direct line manager and strive to achieve these targets
Requirements
- Bachelor’s degree in computer science, Engineering, or related field, or equivalent work experience
- Proven experience as a Data Engineer, Software Developer, or similar
- Strong knowledge of Data Warehousing concepts
- Proficiency in SQL Server and other database technologies
- Proficiency in English
- At least 2 years of experience working with large and complex data warehouse systems with hand-on data architecture experience.
- MS SQL Server (DBA, SQL programming, ETL)
- Experience with data pipeline and workflow management tools.
- Strong organizational and project management skills.
- Strong problem-solving skills, analytical abilities, and attention to detail
