דרושים Data Governance Specialist ב-Ibm ב-Singapore, Singapore

Build, test, and maintain the data pipelines required for effective data ingestion and integration into the AWS datalake.

Key Responsibilities:

• Develop and deploy data ingestion processes for structured and unstructured data.
• Implement best practices for data quality and error handling.
• Work with the Data Architect to optimize performance and scalability.
• Ensure compliance with governance and security protocols.

• 5-8 years of hands-on experience in data engineering.
• Proficiency in AWS data services (AWS Glue, AWS S3, and optionally AWS Lake Formation).
• Strong programming skills in languages such as Python or Java.
• Experience in ETL/ELT processes and data quality assurance.

Software Experience:

• AWS Glue, AWS S3
• Familiarity with AWS Lake Formation is a plus
• Knowledge of data engineering from an analytics, ML, data science use case and data need fulfillment is necessary.
• Experience is building reusable templates and assets on AWS is essential.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world.​ Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology

• Establish and implement best practices for DBT workflows , ensuring efficiency, reliability, and maintainability.
• Collaborate with data analysts, engineers, and business teams to align data transformations with business needs.
• Monitor and troubleshoot data pipelines to ensure accuracy and performance.
• Work with Azure-based cloud technologies to support data storage, transformation, and processing

• Strong MS SQL, Azure Databricks experience
• Implement and manage data models in DBT, data transformation and alignment with business requirements.
• Ingest raw, unstructured data into structured datasets to cloud object store.
• Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.
• Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance

• Establish best DBT processes to improve performance, scalability, and reliability.
• Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Databricks
• Proven interpersonal skills while contributing to team effort by accomplishing related results as required

Design the AWS datalake architecture and develop a robust integration framework that supports efficient data ingestion and processing.

Key Responsibilities:

• Architect scalable AWS datalake solutions to meet technical and business needs.
• Design data integration pipelines for diverse data sources.
• Collaborate with technical teams to ensure secure, compliant data flows.
• Document the overall data architecture supporting catalog, quality, and lineage initiatives.

• Extensive experience with AWS services, particularly AWS Lake Formation, AWS Glue, and AWS S3.
• 8-10+ years in data architecture or similar roles.
• Proficiency in designing and integrating cloud-based data solutions.
• Understanding of data security and compliance standards, especially for public sector projects.

Software Experience:

• Experience in implementing Data Governance Framework in large, complex organizations.

• Familiarity with data governance industry frameworks and variations for cloud data management and governance.
• Working experience in public sectors is a plus.
• Understanding of organizational change management and DataOps in relationship with data governance.
• Deep understanding of the design principles of one or many commercial data governance toolsets such as Collibra, Alation, Atlan, Talend including their intended usage and limitations.
• Familiarity with IBM CloudPak for Data and associated IBM Data Governance toolkit is a plus.

Overview: Implement data governance framework, ensuring policies, procedures, and practices meet both business and regulatory requirements. Guide engineers and technical team with the right inputs needed to achieve a functional data governance process. Ability to identify process limitations and proactively recommending solution measures and best practices to prevent such issues from occurring in a production situation.

Key Responsibilities:

• Define and implement the data governance strategy and roadmap.
• Collaborate with stakeholders to ensure adherence to governance standards.
• Oversee integration of data catalog, quality, and lineage tools.
• Ensure compliance with public sector regulations and security standards (including minimum category 2 clearance).

• 10+ years in data governance, with a proven track record in large-scale projects.

• Deep expertise in data governance tools (e.g., Collibra, Alation, Atlan, Talend).
• Experience working in regulated environments, preferably within the public sector.
• Prior exposure to IBM CloudPak for Data is advantageous.