Data Engineer
Transform Data into Strategic Insight
We’re looking for a hands-on Data Engineer to own our data lifecycle end-to-end—from ingestion and ETL (including SSIS) to pipeline orchestration, monitoring/validation frameworks, and analytical modeling. You will build robust, scalable data solutions, maintain high data integrity, and collaborate with stakeholders to turn raw data into reliable, usable assets for reporting, analytics, and decision-making.
- Design, build, and maintain ETL/ELT processes using SSIS and/or modern frameworks (dbt, ADF, Airflow).
- Cleanse and standardize files & data (e.g., CSV, Excel, JSON, XML), including schema mapping, deduplication, anomaly handling, and encoding normalization.
- Load data into and out of databases and files, supporting both batch and micro-batch processes.
- Develop and manage data pipelines from various sources (databases, APIs, SFTP, cloud/object storage, message queues) to various destinations (data warehouse, data lake, marts, files).
- Create and schedule jobs on SQL Server (SQL Server Agent), including alerting, logging, retry strategies, and dependency management.
- Implement monitoring and validation frameworks to ensure high data integrity:
- Data quality rules, constraints & SLAs
- Unit/integration tests for pipelines
- Anomaly detection and schema drift monitoring
- Automated reconciliation and audit trails
- Optimize performance (indexes, partitions, compression, query tuning, incremental loads, parallelization).
- Version control & DevOps: Git workflows, CI/CD for data pipelines (Azure DevOps/GitHub Actions), environment promotion (Dev → Test → Prod).
Data Management & Governance
- Metadata management, lineage and documentation (e.g., using catalog tools).
- Secure data movement and storage, including data masking, least-privilege access, and secret management.
- Support reporting/BI by delivering curated, trusted datasets for SSRS, Power BI, and analytics consumers.
Requirements
- Relevant qualification and field experience
- 3+ years hands-on experience in data engineering (ETL/ELT, pipelines, SQL development) in production environments.
- Strong expertise in:
- SQL Server (T-SQL, performance tuning, SSIS, SQL Server Agent)
- Relational data modeling (star/snowflake, normalization, SCD)
- File-based data workflows (CSV/Excel/JSON/XML), schema inference, and robust error handling
- Experience moving data across heterogeneous sources/destinations: on-prem & cloud databases, APIs, SFTP, object storage (Azure Blob/S3), flat files.
- Data quality & monitoring: defining rules, building validations/tests, and setting up alerts/dashboards for pipeline health.
Benefits
- Comprehensive Health and Wellness: Free access to Kaelo Health Medical Insurance, Financial Wellness Support, Mental Health Counselling and on-site Pharmacy with an in-house Nurse
- Top-Tier Resources and Amenities: Work with world-class technology, enjoy three in-house restaurants and take advantage of discounted grocery staples
Click this link to apply via our Careers Portal: https://www.rewardscocareers.com/search-jobs/
By applying for this role you are accepting Rewardsco’s Terms and Conditions. Click here to view them:
https://www.rewardscocareers.com/wp-content/uploads/2025/01/Rewardsco-Group-Privacy-Policy.pdf