Expoint - all jobs in one place

המקום בו המומחים והחברות הטובות ביותר נפגשים

Limitless High-tech career opportunities - Expoint

Mcafee Data Integration Engineer 
India, Karnataka, Bengaluru 
924656622

19.11.2024
The Data Integration Engineer is responsible for integrating data from various sources, managing ETL/ELT pipelines on Databricks, and ensuring data pipeline scalability and compliance. Key skills include Databricks, Spark, Python, SQL, AWS, cloud computing, and big data technologies. The role involves collaboration with multiple departments and requires expertise in data integration, pipeline management, and automated monitoring strategies.


About the role:

  • Integrate data from a variety of source systems and knowledge to tailor integration approaches on a per-system basis.
  • Liaise with Technical Data Steward and understanding business requirements for ingestion and integration.
  • Document ingestion and integration flows and pipelines.
  • Use Airflow to schedule and automate ingestion jobs.
  • Manage metadata and master data in technical data catalog.
  • Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform.
  • Ensure ELT/ETL design meets required security and compliance guidelines, and ensure PII management, flagging, and risk assessment during ingestion and integration.
  • Conduct pipeline monitoring.
  • Ensure adherence to SDLC best practices.

About you:

  • Bring 5+ years of experience in data engineering, ingestion pipelining, and ETL/ELT.
  • Hands-on experience with and understanding of Spark/Scala, SQL, Python/PySpark, Databricks, ETL/ELT development using tools like Apache Airflow, omibo, data quality guidelines, CI/CD pipelines, Agile, and Git/version control.
  • Good to have AWS cloud experience.

We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.

  • Bonus Program
  • Pension and Retirement Plans
  • Medical, Dental and Vision Coverage
  • Paid Time Off
  • Paid Parental Leave
  • Support for Community Involvement