EY Data Engineer - Industrials & Energy Sector 

United States, Georgia, Atlanta 

839297262

Your key responsibilities

• Design, develop, optimize, and maintain data architecture and pipelines that adheres to ETL principles and business goals
• Develop and maintain scalable data pipelines, build out new integrations using AWS native technologies to support continuing increases in data source, volume, and complexity
• Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools in the Big Data Environment
• Support standardization, customization and ad hoc data analysis and develop the mechanisms to ingest, analyze, validate, normalize, and clean data
• Write unit/integration/performance test scripts and perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues
• Implement processes and systems to drive data reconciliation and monitor data quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes
• Lead the evaluation, implementation and deployment of emerging tools and processes for analytic data engineering to improve productivity
• Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes
• Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
• Solve complex data problems to deliver insights that help achieve business objectives
• Implement statistical data quality procedures on new data sources by applying rigorous iterative data analytics

Skills and attributes for success

• Partner with Business Analytics and Solution Architects to develop technical architectures for strategic enterprise projects and initiatives
• Coordinate with Data Scientists to understand data requirements, and design solutions that enable advanced analytics, machine learning, and predictive modelling
• Support Data Scientists in data sourcing and preparation to visualize data and synthesize insights of commercial value
• Collaborate with AI/ML engineers to create data products for analytics and data scientist team members to improve productivity
• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions

To qualify for the role you must have

• Bachelor’s degree in Engineering, Computer Science, Data Science, or related field
• 1+ years of experience in software development, data science, data engineering, ETL, and analytics reporting development
• Exposure to designing, building, implementing, and maintaining data and system integrations using dimensional data modelling and development and optimization of ETL pipelines
• Proven track record of designing and implementing complex data solutions
• Demonstrated understanding and experience using:

• Data Engineering Programming Languages (i.e., Python)
• Distributed Data Technologies (e.g., Pyspark)
• Cloud platform deployment and tools (e.g., Kubernetes)
• Relational SQL databases
• DevOps and continuous integration
• AWS cloud services and technologies (i.e., Lambda, S3, DMS, Step Functions, Event Bridge, Cloud Watch, RDS)
• Databricks/ETL
• IICS/DMS
• GitHub
• Event Bridge, Tidal

• Strong organizational skills with the ability to manage multiple projects simultaneously and operate as a leading member across globally distributed teams to deliver high-quality services and solutions
• Understanding of database architecture and administration
• Processes high proficiency in code programming languages (e.g., SQL, Python, Pyspark, AWS services) to design, maintain, and optimize data architecture/pipelines that fit business goals
• Extracts, transforms, and loads data from multiple external/internal sources using Databricks Lakehouse/Data Lake concepts into a single, consistent source to serve business users and data visualization needs
• Utilizes the principles of continuous integration and delivery to automate the deployment of code changes to elevate environments, fostering enhanced code quality, test coverage, and automation of resilient test cases
• Excellent written and verbal communication skills, including storytelling and interacting effectively with multifunctional teams and other strategic partners
• Strong problem solving and troubleshooting skills
• Ability to work in a fast-paced environment and adapt to changing business priorities

Ideally, you’ll also have

• A passion for innovation and the strategic application of emerging technologies to solve real-world challenges
• The ability to foster an inclusive environment that values diverse perspectives and empowers team members

• Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
• Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.