Dell Senior Advisor Data Engineering 

United States, Texas, Round Rock 

903720688

What you’ll achieve

You will work with Developers, Enterprise Architects, platform Services and Infrastructure team to build self service capabilities on Elastic Cloud Storage (ECS) to run the customer workloads at scale. This job requires the team member to help with proof of concepts (POCs) and build functionality to move workloads from Massively Parallel Processing (MPP) system to ECS. You will also be responsible for Hardening the solution to make it production ready. Also help define Test cases, automation, documenting best practices.

You Will

• Experience with spark/iceberg & desire to learn new tech/table format; work with Data Architect to define principles and Integrate Iceberg format with data processing frameworks

• Identify and troubleshoot poorly performing queries on Iceberg table format and optimize workloads

• Make recommendations to improve platform throughput and reliability

• Implement security measures and access controls for Iceberg tables

• Collaborate with others to define, review, and revise evolving Data Architecture and enable self service capabilities in the ECS Lake house

Essential Requirements

• Basic knowledge of Spark, Hive and familiar with Extraction, Transformation and Loading of data & Data Lake house

• Experience with data platform analysis, table statistics and table maintenance

• Hands on experience on Python programming language

• Open Table format (Iceberg or Delta) Query & Maintenance experience

• Open Table format configuration parameters to optimize table format performance and well versed with Medallion architecture

Desirable Requirements

• Bachelor’s in Engineering with 8-10 years related experience