Job responsibilities
- Executes standard software solutions, design, development, and technical troubleshooting
- Building pipelines in spark, tuning spark queries
- Writes secure and high-quality code using the syntax of at least one programming language with limited guidance
- Designs, develops, codes, and troubleshoots with consideration of upstream and downstream systems and technical implications
- Applies knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation
- Applies technical troubleshooting to break down solutions and solve technical problems of basic complexity
- Gathers, analyzes, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development
- Learns and applies system processes, methodologies, and skills for the development of secure, stable code and systems
- Stay up-to-date with the latest advancements in GenAI and LLM technologies and incorporate them into our data engineering practices.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 2+ years applied experience
- Hands-on practical experience in system design, application development, testing, and operational stability
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
- Background with Machine Learning Frameworks and Big Data technologies such as Hadoop.
- Strong experience in programming languages such as Java or Python
- Python Machine Learning library and ecosystem experience ( Pandas and Numpy etc)
- Experience with Cloud technologies such as AWS or Azure.
- Experience working with databases such as Cassandra, MongoDB or Teradata
- Experience across the whole Software Development Life Cycle
- Exposure to agile methodologies such as CI/CD, Application Resiliency, and Security
- Experience with Generative AI and Large Language Models, and experience integrating these technologies into data workflows
Preferred qualifications, capabilities, and skills
- Familiarity with modern front-end technologies
- Exposure to cloud technologies