Project Information: To provide uniform access methods and processing patterns on its geospatial data in order to produce new data products for clients, we are constructing its next generation centralised data platform. Data engineers will create, support, and manage automated processes that transform and enrich our massive amounts of geospatial data using big data technologies available in the Azure Cloud, particularly Databricks, an implementation of Apache Spark. Experience: Data engineers will have the following skills: utilising intricate geospatial data and applying reasoning to issue solutions. understanding of data structures and database querying expertise one or more languages used in software engineering (such as Scala or Python) Experience in creating and delivering components that are ready for manufacturing. good understanding of testing methodologies and best practises offering technical mentoring and coaching promoting best practises for the software engineering industry translating complex specs into straightforward answers Knowledge of Apache Spark and Databricks (desirable) Working knowledge of Microsoft Azure (desirable) Technologies: Azure Microsoft DevOps Databricks Scala Maven We welcome applications from all appropriately qualified individuals regardless of colour, sex, handicap, religion or belief, sexual orientation, gender reassignment, marriage and civil partnerships, pregnancy or maternity, or age as we are an equal opportunity employer.
Project Information:
To provide uniform access methods and processing patterns on its geospatial data in order to produce new data products for clients, we are constructing its next generation centralised data platform.
Data engineers will create, support, and manage automated processes that transform and enrich our massive amounts of geospatial data using big data technologies available in the Azure Cloud, particularly Databricks, an implementation of Apache Spark.
Experience:
Data engineers will have the following skills:
utilising intricate geospatial data and applying reasoning to issue solutions.
understanding of data structures and database querying expertise one or more languages used in software engineering (such as Scala or Python) Experience in creating and delivering components that are ready for manufacturing.good understanding of testing methodologies and best practises offering technical mentoring and coaching promoting best practises for the software engineering industry translating complex specs into straightforward answers Knowledge of Apache Spark and Databricks (desirable) Working knowledge of Microsoft Azure (desirable) Technologies:
Azure Microsoft DevOps Databricks Scala Maven We welcome applications from all appropriately qualified individuals regardless of colour, sex, handicap, religion or belief, sexual orientation, gender reassignment, marriage and civil partnerships, pregnancy or maternity, or age as we are an equal opportunity employer.