JPMorgan Data Lake Engineer 

United Kingdom, England, London 

286819955

As a Software Engineer IIIData Lake Engineer

Our Data Lake will provide a common lakehouse, that will ingest, transform and store our data sets, that will be used not only to train our AI systems, but also for inference across multiple use cases. The processing and persistence of data will be managed within the public cloud, and will utilise Big Data frameworks such as Databricks and Spark.

Job responsibilities

• Creates complex and scalable coding frameworks using appropriate software design frameworks
• Develops secure and high quality production code, and reviews and debugs code written by the team
• Regularly provides technical guidance and direction to support the business and its technical teams, contractors, and vendors
• Develops secure and high-quality production code, and reviews and debugs code written by others
• Drives decisions that influence the product design, application functionality, and technical operations and processes
• Actively contributes to the engineering community as an advocate of firmwide frameworks, tools, and practices of the Software Development Life Cycle
• Adds to the team culture of diversity, equity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and advanced applied experience
• Extensive development experience using Python/SQL
• Solid understanding of software applications and technical processes within a related technical discipline (e.g. data ingestion, data storage, data serving, APIs, etc.).
• Hands-on experience in data lake or data warehouse and related technologies (e.g. Spark, ETL, Databricks).
• Hands-on practical experience delivering system design, application development, testing, and operational stability
• Ability to tackle design and functionality problems independently with little to no oversight
• Experience in Computer Science, Computer Engineering, Mathematics, or a related technical field
• Currently working in an agile development environment and supporting tooling.

Preferred qualifications, capabilities, and skills

• Exposure to cloud technologies (AWS or GCP) via hands on experience or certification
• Advanced in other programming languages, such as Java