Senior Data Engineer
We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).
Responsibilities:
- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.
- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.
- Design and write clean, robust, server-side code using Spark & Scala.
- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company
- Work closely with team members & mentor them technically
- Partner with product managers to support product roadmap & business needs
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Qualifications
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Additional Information
We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.
All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.
In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products.