Job Responsibilities:
- Execute creative data solutions, design, development, and technical troubleshooting with the ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
- Develop secure high-quality production data pipelines, and review and debug data processes implemented by others.
- Identify opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of data applications and systems.
- Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture.
- Lead communities of practice across Data Engineering to drive awareness and use of new and leading-edge technologies.
- Contribute to a team culture of diversity, equity, inclusion, and respect.
Required Qualifications, Capabilities, and Skills:
- 8+ years of experience in data engineering, specifically with Databricks and AWS Glue.
- Hands-on practical experience delivering system design, application development, testing, and operational stability.
- Advanced proficiency in data processing frameworks and tools, including knowledge in Parquet and Iceberg.
- Proficiency in automation and continuous delivery methods.
- Proficient in all aspects of the Software Development Life Cycle.
- Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security.
- Demonstrated proficiency in data applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.).
- In-depth knowledge of the financial services industry and their IT systems.
- Practical cloud-native experience.
Preferred Qualifications, Capabilities, and Skills:
- AWS Certification
- Databricks Certification