Primary Skills
- Experience in DBT.
- Experience in building ETL/data warehouse transformation processes using cloud Services
- Direct experience building data pipelines using Databricks.
- Hands-on experience designing and delivering solutions using cloud services like Azure, AWS or GCP.
- Hand- on experience in Pyspark, Spark SQL, Python/Scala.
Roles and Responsibilities
- Data Engineering Leadership:Lead a team of data and visualization engineers in designing and implementing high-performance data ingestion pipelines from multiple sources using Spark Databricks. Develop scalable and reusable frameworks for the ingestion and enrichment of datasets.
- End-to-End Data Pipeline:Develop integrated end-to-end data pipelines to ensure the quality and consistency of data from source systems to target data repositories.
- Recruitment and Team Building:Identify skill sets required and gaps in the team. Work with support services to staff the team, accordingly, including recruitment for large specific demands.
- Delivery Execution Framework:Define or modify a delivery execution framework based on patterns observed in incidents within the team.
- Stakeholder Interaction and Project Management:Manage the overall delivery of projects, prepare project plans, identify risks, and propose mitigation approaches. Interact significantly with stakeholders from clients and provide estimations for project delivery (cost and timelines) based on RFPs.
Skills and Attributes
- Champion start up thinking and deliver innovative solutions
- Deliver highest quality results
- Drive a culture of continuous improvement and learning for yourself and others
- Create value and build sustainable relationships that last a lifetime
People with the ability to work in a collaborative manner to provide services across multiple client departments while following the commercial and legal requirements. You will need a practical approach to solving issues and complex problems with the ability to deliver insightful and practical solutions. We look for people who are agile, curious, mindful and able to sustain postivie energy, while being adaptable and creative in their approach.
If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.