Job responsibilities
- Provide overall direction, oversight, and coaching for a team of entry-level to mid-level software engineers that work on basic to moderately complex tasks
- Be accountable for decisions that influence teams’ resources, budget, tactical operations, and the execution and implementation of processes and procedures
- Ensures successful collaboration across teams and stakeholders
- Identifies and mitigates issues to execute a book of work while escalating issues as necessary
- Provides input to leadership regarding budget, approach, and technical considerations to improve operational efficiencies and functionality for the team
- Creates a culture of diversity, equity, inclusion, and respect for team members and prioritizes diverse representation
Required qualifications, capabilities, and skills
- Formal training or certification in Data Engineering concepts with 5+ years of applied experience. In addition, 2+ years of experience leading technologists to manage and solve complex technical items within your domain of expertise
- Proven experience leading teams of technologists
- Ability to guide and coach teams on approach to achieve goals aligned against a set of strategic initiatives
- Experience with hiring, developing, and recognizing talent
- Proven experience in designing and developing large scale data pipelines for batch & stream processing
- Strong understanding of Data Warehousing, Data Lake, ETL processes and Big Data technologies (e.g Hadoop, Snowflake, Databricks, Apache Spark, PySpark, Airflow, Apache Kafka, Java, Open File & Table Formats, GIT, CI/CD pipelines etc. )
- Expertise with public cloud platforms (e.g., AWS, Azure, GCP) and modern data processing & engineering tools
- Experience working at code level and ability to be hands-on performing PoCs, code reviews
- Experience in Data Modeling (ability to design Conceptual, Logical and Physical Models, ERDs and proficiency in data modeling software like ERwin)
- Excellent communication, presentation, and interpersonal skills
Preferred qualifications, capabilities, and skills
- Experience with Data Governance, Data Privacy & Subject Rights, Data Quality & Data Security practices
- Strong understanding of Data Validation / Data Quality
- Experience with supporting large scale AI/ML Data requirements
- Experience in Data visualization & BI tools is a huge plus