Responsible for designing and implementing technical solutions within the Big Data ecosystem. Collaborate with other peers in the team at the design, “hands-on” implementation and maintenance of a broad range of Big data solutions. Work under the direction of the Manager of Data Analytics to assure corporate architecture principles are successfully met and implemented. Propose, design, develop and test reusable/reliable data solutions. Effectively communicate with onsite/offsite counterparts as well as with the non-technical user community when required. The role includes intensive hands on data acquisition, transformation and modelling work using not only the full Hadoop stack but also other cutting edge Analytics solutions.
This is a Great Opportunity because -
• Participant on team responsible for corporate Big Data platform and Data Engineering solution
• Employ a variety of languages and tools to integrate and automate systems
• Create and secure reliable data layers using reusable components
• Interaction and partnership with teams both in the US and abroad.
• Continuous automation and deployment mindset
• Perform tuning and operational troubleshooting
• Focus on simplicity, continuous automation & deployment, reusability and agility
Outcomes/Success Criteria
• Establish development framework to speed up deployment and automation of Big Data solutions.
• Successful implementation of project delivery, documentation and facilitate transition to on-site and offsite support teams.
• Contribute to protecting data assets by assuring corporate data principles are successfully me
Minimum Requirements:
• 5-10 years of hands-on data solutions and software engineering experience, including no less than three years with Hadoop.
• 2-3 years of experience on cloud platforms: preferably Google Cloud Platform and AWS.
• Demonstrable technical competency on technical solutions that include: Hive, MongoDB and/or Cassandra, SQL databases, REST APIs/Micro services, Kafka, Python, Zeppelin, Scala, Spark, RedShift and/or BigQuery, ElasticSearch and/or Solr.
• 1-2 years of UNIX/Linux system administration/advanced user experience
Desired Qualifications:
• Development / Scripting experience with languages such as Go, Java and Bash.
• Experience in at least two of the following frameworks: Jenkins, Github, Ansible, JIRA
• Experience in the retail, distribution and/or manufacturing sector
• Data modelling certification, Tableau experience and/or Machine Learning experience is a plus
All your information will be kept confidential according to EEO guidelines.