Finding the best job has never been easier
ATT Lead Big Data Engineering United States, Texas, Dallas 799433415
Share
Job Description:
The Lead Big Data Engineer is responsible for designing, implementing, and optimizing data pipelines, ensuring the availability, performance, and security of large-scale data processing systems. This role requires a deep understanding of big data technologies, data architecture, and data engineering best practices. The Lead Big Data Engineer collaborates closely with data scientists, analysts, and other stakeholders to support data-driven decision-making processes.
Key Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines using technologies such as Python, PySpark, and Databricks.
Integrate data from various sources, ensuring data quality, consistency, and reliability.
Develop and implement data architecture strategies, including data modeling, schema design, and data storage solutions.
Optimize data processing workflows for performance, scalability, and cost-efficiency.
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions.
Identify and resolve data-related issues and provide support for data infrastructure.
Maintain comprehensive documentation of data pipelines, architecture, and processes.
Drive the design and implementation of specific data models to enhance business decision-making through insights from a combination of external and internal data assets.
Define data requirements, gather and mine large-scale structured and unstructured data, and validate data using various tools in a cloud environment.
Support the standardization, customization, and ad-hoc data analysis.
Develop mechanisms to ingest, analyze, validate, normalize, and clean data.
Develop and maintain data engineering best practices.
Contribute to insights on data analytics and visualization concepts, methods, and techniques.
Required Qualifications:
- 5+ years of experience in data engineering, with a focus on big data and cloud technologies.
Technical Skills:
Strong programming skills in languages such as Python, PySpark, and Scala.
Working experience with data warehousing solutions like Snowflake.
Proficiency in SQL.
Experience with Databricks computing environment.
Development experience on Azure cloud environments.
Soft Skills:
Excellent problem-solving abilities.
Strong communication and collaboration skills.
Ability to work independently and in a team environment.
Attention to detail and a commitment to data quality.
Education:
MS degree in Computer Science, Information Technology, or a related field preferred.
As a Lead Big Data Engineer, you can earn between $143,800 - $215,800 per year. Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.
Joining our team comes with amazing perks and benefits:
Medical/Dental/Vision coverage
401(k) plan
Tuition reimbursement program
Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
Paid Parental Leave
Paid Caregiver Leave
Additional sick leave beyond what state and local law require may be available but is unprotected
Adoption Reimbursement
Disability Benefits (short term and long term)
Life and Accidental Death Insurance
Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
Employee Assistance Programs (EAP)
Extensive employee wellness programs
Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone
Salary Range:
These jobs might be a good fit
