AWS Data Platform Engineer
We are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.
Key Responsibilities:
- Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
- Implement and maintain Infrastructure as Code (IaC) using Terraform.
- Manage orchestration workflows using Apache Airflow.
- Support CI/CD pipelines and version control using GitLab.
- Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
- Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
- Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
- Troubleshoot and resolve incidents related to AWS data infrastructure.
- Contribute to documentation and process improvement initiatives.
- Managing and monitoring access and RBAC controls.
Requirements
- Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
- Strong hands-on experienced with Terraform for IaC.
- Experience with Airflow for DAG orchestration and monitoring.
- Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
- Experience with Python, SQL and Bash for automation, querying and troubleshooting.
- Understanding of AWS Security best practices, IAM policies and RBAC.
- Understanding of AWS Networking and VPC
- Experience with containerisation using Docker
- Experience with Disaster Recovery, backups and snapshots.
Desirable Skills:
- Understanding of AWS Neptune, EKS
- Experience with Jira Service Desk
- Experience supporting Data Engineers
- Experience working as a consultant
- README and Confluence documentation
Soft Skills:
- Strong problem-solving and troubleshooting skills.
- Ability to work in an Agile environment.
- Comfortable with stakeholder management
- Excellent communication and collaboration skills.
Benefits
Why people choose to grow their careers at UBDS Group
Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.
UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.
Employee Benefits
- Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
- Private medical cover for you and your spouse/partner, offered via Vitality
- Discretionary bonus based on a blend of personal and company performance
- Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
- Electric Vehicle leasing with salary sacrifice
- Contributed Pension Scheme
- Death in service cover
About UBDS Group
At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.
Equal Opportunities
We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.