We’re looking for a candidate with 10+ years with strong architect expertise into Cloud Data Engineering Platforms and delivery lead
Roles & Responsibilities
- Snowflake Security & Integration
- Experience in configuring Snowflake Security integration services like OAuth, SAML.
- Expertise in configuring Snowflake API, Storage, and Notification integration services.
- Strong knowledge of Snowflake RBAC management, user management, and role management.
- Data Masking & Access Control
- Experience in configuring Dynamic Masking Policies and Tag-Based Masking Policies.
- Database & Warehouse Management
- Experience in creating and managing databases, schemas, and Snowflake warehouses.
- Data Migration & ETL
- Expertise in migrating SQL queries/DDLs from Oracle, MySQL, MS SQL, Cassandra to Snowflake SQL.
- Experience in automating file loading from AWS S3/Azure Blob using Snowpipe and Snowflake ingestion best practices.
- Strong background in transforming semi-structured data using Snowflake Stored Procedures.
- Experience in loading structured and semi-structured data into Snowflake from AWS S3/Azure Blob.
- Data Pipelines & Frameworks
- Experience in developing pipelines using a metadata-driven framework.
- Hands-on experience in database design & data modeling using Erwin tool.
- Data Governance & Validation
- Implemented data validation, error handling, auditing, and reconciliation mechanisms.
- Performance Optimization & Reporting
- Experience in optimizing Snowflake performance for efficient querying and storage.
- Ability to generate reports (CSV, JSON, XML) using Snowflake tasks and streams and ETL tools.
- Data Integration & Scheduling
- Experience in integrating and scheduling end-to-end data ingestion, profiling, and transformation flows in Snowflake.
- Hands-on experience with Snowflake Data Sharing (inbound and outbound).
- Advanced Snowflake Features
- Experience in creating and managing External Tables, Iceberg Tables, Dynamic Tables, UDFs, UDTFs, and Procedures.
- Implemented functionality for ServiceNow request generation in failure cases.
- Cloud & Orchestration Tools
- Hands-on experience with AWS (S3, SQS, SNS, EC2, RDS, IAM) and Azure (Blob Storage, IAM).
- Experience in workflow orchestration using Apache Airflow.
Skills and attributes for success
- Use an issue-based approach to deliver growth, market, and portfolio strategy engagements for corporates
- Strong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations.
- Experience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint.
To qualify for the role, you must have
- BE/BTech/MCA with 10+ years of IT development experience
- Expertise on design, architecting, developing, and implementing data engineering solutions on any of the public cloud platform – Snowflake
- Hands on experience with Data Governance/Catalogue Tools such as EDC, IBM IGC, ASG, Alation, TMM etc
- Working knowledge on Data Governance Framework and compliance regulations such as BCBS, GDPR, HIPPA, ACCORD etc
- Experience in producing Data Lineage Reports, Data Dictionaries, Business Glossary and Identifying the KBEs and CDE through Data Analysis
- 5+ years of experience on data lineage, data governance, data modelling, data integration solutions
- Strong exposure to real time data processing
- Should be able to handle customers on any situations
- Knowledge of Data Architecture, Data Modelling and adopting best practices and policies in the Data Management space
- Experience in databases, data warehousing and high-performance computing environments.
- Experience on Presales, RFP’s, customer presentations, etc.,
- Nice to have Insurance and Finance domain experience
Ideally, you’ll also have
What we look for
- People with technical experience and enthusiasm to learn new things in this fast-moving environment
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees, and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you