דרושים Data Engineer/data Catalog Quality Analyst ב-Ibm ב-Singapore, Singapore

Build, test, and maintain the data pipelines required for effective data ingestion and integration into the AWS datalake.

Key Responsibilities:

• Develop and deploy data ingestion processes for structured and unstructured data.
• Implement best practices for data quality and error handling.
• Work with the Data Architect to optimize performance and scalability.
• Ensure compliance with governance and security protocols.

• 5-8 years of hands-on experience in data engineering.
• Proficiency in AWS data services (AWS Glue, AWS S3, and optionally AWS Lake Formation).
• Strong programming skills in languages such as Python or Java.
• Experience in ETL/ELT processes and data quality assurance.

Software Experience:

• AWS Glue, AWS S3
• Familiarity with AWS Lake Formation is a plus
• Knowledge of data engineering from an analytics, ML, data science use case and data need fulfillment is necessary.
• Experience is building reusable templates and assets on AWS is essential.

• Deploy, configure, and monitor EDR systems across all endpoints to ensure optimum performance and security.
• Monitor EDR systems for suspicious activity, analyze security issues, and respond appropriately to mitigate threats.
• Regularly update and optimize EDR setups and policies to improve detection capabilities and eliminate false positives.
• Collaborate with IT and security teams to integrate EDR solutions with other security tools and systems, such as SIEM (Security Information and Event Management) platforms, to improve overall security operations.
• Maintain documentation on EDR configurations and processes.
• Ensure that endpoint security rules are enforced and kept up to date and are compliant according organizational and security standards.

• Experience administering and operating EDR platforms (such as CrowdStrike, Carbon Black, Symantec, Microsoft Defender ATP).
• Strong understanding of cybersecurity fundamentals, such as threat detection, malware analysis, and incident response.
• Experience with scripting languages (such as PowerShell and Python) for automation.
• Familiarity with network security, endpoint protection solutions, and IT infrastructure.
• Understanding of operating systems (Windows, Linux, and macOS) and their associated security protocols.

3-5 years in cybersecurity, IT operations, or a related function with an emphasis on endpoint security.

Design the AWS datalake architecture and develop a robust integration framework that supports efficient data ingestion and processing.

Key Responsibilities:

• Architect scalable AWS datalake solutions to meet technical and business needs.
• Design data integration pipelines for diverse data sources.
• Collaborate with technical teams to ensure secure, compliant data flows.
• Document the overall data architecture supporting catalog, quality, and lineage initiatives.

• Extensive experience with AWS services, particularly AWS Lake Formation, AWS Glue, and AWS S3.
• 8-10+ years in data architecture or similar roles.
• Proficiency in designing and integrating cloud-based data solutions.
• Understanding of data security and compliance standards, especially for public sector projects.

Software Experience:

• Experience in implementing Data Governance Framework in large, complex organizations.

• Familiarity with data governance industry frameworks and variations for cloud data management and governance.
• Working experience in public sectors is a plus.
• Understanding of organizational change management and DataOps in relationship with data governance.
• Deep understanding of the design principles of one or many commercial data governance toolsets such as Collibra, Alation, Atlan, Talend including their intended usage and limitations.
• Familiarity with IBM CloudPak for Data and associated IBM Data Governance toolkit is a plus.

Overview: Implement data governance framework, ensuring policies, procedures, and practices meet both business and regulatory requirements. Guide engineers and technical team with the right inputs needed to achieve a functional data governance process. Ability to identify process limitations and proactively recommending solution measures and best practices to prevent such issues from occurring in a production situation.

Key Responsibilities:

• Define and implement the data governance strategy and roadmap.
• Collaborate with stakeholders to ensure adherence to governance standards.
• Oversee integration of data catalog, quality, and lineage tools.
• Ensure compliance with public sector regulations and security standards (including minimum category 2 clearance).

• 10+ years in data governance, with a proven track record in large-scale projects.

• Deep expertise in data governance tools (e.g., Collibra, Alation, Atlan, Talend).
• Experience working in regulated environments, preferably within the public sector.
• Prior exposure to IBM CloudPak for Data is advantageous.