Job Summary:
As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data solutions to meet the evolving needs of the business.
Your key responsibilities
- Design and implement scalable and reliable data models using DBT for data warehousing and business intelligence purposeswithin the Azure cloud environment or GCP Cloud environment.
- Collaborate with data analysts and business users to understand data requirements and translate business needs into technical specifications.
- Develop and maintain complex SQL queries and DBT models to support data transformation and aggregation.
- Optimize DBT performance by analysing query execution plans and implementing best practices for efficient data processing.
- Ensure data quality and integrity by implementing testing frameworks and data validation checks within DBT.
- Automate data pipeline workflows and integrate DBT with other data engineering tools and platforms.
- Monitor and troubleshoot DBT jobs, addressing any issues related to data discrepancies or performance bottlenecks.
- Document DBT models, data dictionaries, and other technical artifacts to ensure clarity and maintainability.
- Mentor junior DBT engineers and contribute to the development of best practices within the data engineering team.
- Stay up-to-date with the latest developments in DBT and related technologies, and advocate for their adoption where appropriate.
- Proactively research and recommend improvements to the data stack by staying current with Azure/GCP services, DBT releases, and industry trends.
To qualify for the role, you must have:
- Be a computer science graduate or equivalent with 3-9 years of industry experience.
- Extensive hands-on experience implementing DBT for data warehousing and business intelligence purposeswithin the Azure cloud environment or GCP Cloud environment.
- Well versed in DevOps and CI/CD deployments.
- Must have hands on experience in SQL and procedural SQL languages.
- Strong analytical skills and enjoys solving complex technical problems.
- Have working experience in an Agile base delivery methodology (Preferable)
- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
- Experience in Enterprise grade solution implementations & in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
- Excellent communicator (written and verbal formal and informal).
- Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support.
- Client management skills
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.