Data engineer Scala / Freelance

Contenu de l'offre Data engineer Scala / Freelance chez Amontech

Description du poste
Objectifs de la mission et tâchesEssential Duties Include:- Work closely with business stake holders and data analysts to clarify their needs- Implement data pipelines to gather and process large scale data on a daily basis- Maintain and evolve current applications according to business requirements- Coordinate with other teams to meet project goals- Provide support to entities, troubleshoot and solve any problems that may hinder their use of our applicationsRequired:- BS or MS in Computer Science, Engineering, or related degree.- Must have 3+ years of programming skills in object-oriented or functional programming languages (e.g. Scala, Java)- Extended experience working with big data querying and analysis engines and frameworks (e.g. Apache Hive, Apache Spark, Databricks)- Good understanding of big data filesystems (e.g. Hadoop)- Experience working with Git- Ability to work with a fast moving team and to solve problems collaboratively and creatively- Interest in the best technical solutions that make our customers products betterDesired:- Experience with the Cloudera distribution is preferred- Familiarity with cloud environments (e.g. Microsoft Azure, AWS)- Good knowledge of Data Warehousing concepts- Good knowledge of a major scripting language (e.g. Python)- Familiarity with Agile team collaboration tools (e.g., JIRA, Confluence)