Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines using AWS cloud services.
- Build data integration solutions using tools such as AWS Glue, Lambda, Step Functions, and more.
- Work with structured and unstructured data, ensuring high data quality and governance.
- Collaborate with data scientists, architects, and business stakeholders to understand data needs and translate them into robust technical solutions.
- Optimise data pipelines for performance and cost efficiency.
- Implement best practices in data engineering, security, and DevOps (e.g., CI/CD, infrastructure as code).
- Contribute to the continuous improvement of our data engineering standards and methodologies