Job Responsibilities
- Write efficient Python and SQL code to extract, transform, and load (ETL) data from various sources into Databricks.
- Perform data analysis and computation to derive actionable insights from the data.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all data processes.
- Develop Optimized solutions for performance and scalability.
- Monitor and troubleshoot data workflows to ensure reliability and efficiency.
- Document data engineering processes, methodologies, and workflows.
- Communicating analytical findings to senior leaders through data visualization and storytelling
Required qualifications, capabilities and skills
- Minimum 3+ years of hands-on experience in Developing, implementing and maintaining python automation solutions including the use of LLM.
- Develop, implement, and maintain new and existing solutions
- Write efficient Python and SQL code to extract, transform, and load (ETL) data from various sources .
- Ability to use LLM to build AI solutions.
- Perform data analysis and computation to derive actionable insights from the data.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all data processes.
- Monitor and troubleshoot data workflows to ensure reliability and efficiency.
- Document data engineering processes, methodologies, and workflows.
Preferred qualifications, capabilities and skills
- Hand-on experience in Python desktop solution development
- Knowledge of machine learning and data science concepts will be plus
- Experience with data visualization tool Tableau will be plus