Data Engineer Senior Consultant – Job Specification
Belfast or Derry/Londonderry
Your Client Impact
Design, develop, and deploy end-to-end data pipelines for complex business problems, supporting analytics, modernising data infrastructure and AI/ML initiatives.
Design and implement data models, ETL/ELT workflows, and data integration solutions across structured and unstructured sources
Collaborate with AI engineers, data scientists, and business analysts to deliver integrated solutions that unlock business value.
Ensure data quality, integrity, and governance throughout the data lifecycle.
Optimize data storage, retrieval, and processing for performance and scalability on cloud platforms (Azure, AWS, GCP, Databricks, Snowflake).
Translate business requirements into technical data engineering solutions, including architecture decisions and technology selection.
Contribute to proposals, technical assessments, and internal knowledge sharing.
Data preparation, feature engineering, and MLOps activities to collaborate with AI engineers, data scientists, and business analysts to deliver integrated solutions
Essential Qualifications
Degree or equivalent certification in Computer Science, Data Engineering, Information Systems, Mathematics, or related quantitative field.
Essential Criteria
Experience building and maintaining data pipelines using platforms such as Databricks, Azure Data Factory, Snowflake, or similar
Good programming skills in Python and SQL, with familiarity with data engineering libraries (e.g., pandas, PySpark, dbt)
Solid understanding of data modelling, ETL/ELT processes, and Lakehouse concepts
Experience with data quality frameworks, data governance, and compliance requirements.
Familiarity with version control (Git), CI/CD pipelines, and workflow orchestration tools (Airflow, Prefect).
Soft Skills
Strong analytical and problem-solving mindset with attention to detail.
Good team player with effective communication and storytelling with data and insights.
Consulting skills, including development of presentation decks and client-facing documentation.
Preferred Criteria
Experience with real-time data processing (Kafka, Kinesis, Azure Event Hub).
Knowledge of big data storage solutions (Delta Lake, Parquet, Avro).
Experience with data visualization tools (Power BI, Tableau, Looker).
Understanding of AI/ML concepts and collaboration with AI teams.