Ml Data Engineer Feature Pipeline & Etl jobs at Mcafee in Canada, Waterloo
Mcafee Software Developer Engineer Test SDET – Core Protection Tech... Canada, Ontario, Waterloo
Share
About the role
- Work closely with developers to develop, automate, and execute test plans
- Work closely with other SDETs to make test automation framework changes, perform code reviews, and implement test automation best practices
- Use and automate a variety of debugging tools to assist in triage and collecting system information
- Use creativity, product, and operating system knowledge to develop and execute a variety of exploratory test scenarios
- Help build CI/CD pipelines using Jenkins to automate the software development lifecycle
- Identify and implement opportunities to improve and automate the CI/CD process
- Provide build verification and sign-off
About you
- You have 2+ years of quality testing and automation experience
- You have experience working with python and C++
- You understand and can apply software testing best practices
- Knowledge of Windows Operating System and architecture
- Knowledge of Windows SysInterals tools a bonus
- Knowledge of Windows WHQL and HLK processes a bonus
- Knowledge of anti-malware applications, network applications, cloud programming a bonus
- Knowledge of executable file-formats (MZ, PE, COFF, ELF, MACH-O) is a bonus
- You like working in a team and have excellent communication skills
- You like finding creative solutions to solve hard problems
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
These jobs might be a good fit
Mcafee Senior Data Architect Canada, Ontario, Waterloo
Share
- Data lakehouse modeling and design
- ETL/ELT design
- Dimensional and relational data modeling
- Data warehouse design
- Security and PII management
andorganize data platforms, including databases and data structures, data storage, access, loading, and pipeline design.
Collaborate with data stewards and data engineers on solution design.
Develop andmaintainphysical data models for the Databricks platform.
Managemetadata in data catalog tools, such as Collibra.
Ensure adherence to data curation standards and guidelinesfor medallion certification framework and required architecture.
Ensure the platform and platform design meets required security and compliance guidelines including PII management.
Provide oversight todatacuration teams,ingestion engineersand data engineers, including code review and data model design review to ensure adherence to standards and best practices.
6+ years of experience in data engineering, data modeling, and ETL/ELT.
Have experienceas a senior engineer, including conducting code reviews.
Have hands-on experience withsix or more of the following:
Design and implementation of logical and physical data models.
Data modeling tools, such as Erwin or ER/Studio.
Databricks /Spark.
Lakehouse architectureand medallion data organization.
ETL/ELT development, monitoring,pipeliningand orchestration.
Python/PySpark, Scala or similar programming language.
Data quality guidelinesand testing frameworks.
Creating technical design documents and data flow diagrams.
CI/CD pipelines.
Agile sprints.
Git and version control.
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
Mcafee Software Engineer Cloud team Go C# Canada, Ontario, Waterloo
Share
About the role:
You will work within the consumer capability team, report to an engineering manager
You will help us to create capabilities promoting next-generation product features / experiences
You will work with architects and other team members to design the end-to-end solution across cloud and client applications. Design solution architecture that meets operational requirements and is scalable, easily maintained, secure and available.
You will oversee a cloud solution, including public cloud PaaS / Serverless technologies, using required SQL/NoSQL data stores with deep understanding of the technologies, the data model, and the access patterns. Ensure high scalability, availability, performance, and cost optimization.
You will develop cloud solutions that promote standards, security, and efficiency across the ecosystem.
You will create detailed design specifications, test, and performance guidelines.
You will research and innovation to find solutions to challenging technical problems.
You will be an Important player on an agile development team
About you:
Your background includes 6+ years of industry experience and 3+ years developing cloud based software
Hands-on experience of full stack development of scalable cloud applications using various cloud development stacks.
Experienced in developing and debugging of microservices in Linux-based environments.
You have expertise in microservices, with proficiency in multiple object-oriented programming languages and design patterns, C#/Golang/Node.js, and containerization (Docker) with orchestration solutions including EKS
You have expertise in SQL, no-SQL and big data frameworks: Aroura DB, MS-SQL, Postgres DB, Dynamo DB, middleware like Kafka, SNS and Redis
Ability to create a continuous delivery environment using test-driven development.
Proven expertise in Linux scripting, debugging, and troubleshooting.
You are experienced with network protocols and have excellent knowledge of cloud design principals, cloud architecture, and cloud security.
You are a quick and proficient learner who is passionate and able to learn new technologies.
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
Mcafee ML Data Engineer Feature Pipeline & ETL Canada, Ontario, Waterloo
Share
About the role:
- Feature Engineering & Data Integration: Develop and maintain end-to-end ML feature engineering pipelines using Databricks, ensuring data is consistently structured to support ML models effectively.
- Pipeline Development & Management: Integrate diverse data sources (clickstreams, user behaviour, demographic data, etc.) and tailor data integration processes to optimize data quality and performance.
- Medallion Architecture Expertise: Build ETL/ELT pipelines that follow the bronze, silver, and gold layers of the medallion architecture, ensuring efficient data structuring for ML workflows.
- Model Training & Experiment Tracking: Support ML model training and calibration through optimized data pipelines, using MLflow for experiment tracking, model versioning, and performance monitoring.
- Query Optimization & Low Latency Pipelines: Design and implement optimized queries and low-latency data pipelines to support real-time and batch model inference in production.
- CI/CD & Deployment: Apply CI/CD best practices to ensure smooth and efficient pipeline deployments, with automated testing for consistent performance.
- Data Governance & Compliance: Ensure pipelines meet security and compliance standards, particularly for PII, and manage metadata and master data across the data catalogue.
- Collaboration: Work closely with data scientists, data stewards, and other teams to align data ingestion and transformation efforts with business requirements.
- Experience: Minimum 4 years in data engineering, focusing on ML feature engineering, ETL pipeline development, and data preparation for machine learning.
- Databricks & Medallion Architecture: Proven expertise in managing ETL/ELT pipelines on Databricks, with a solid understanding of the medallion architecture.
- ML Lifecycle & MLflow: Familiarity with the ML lifecycle and experience using MLflow for model training, calibration, and experiment tracking is highly desirable.
- Spark & Big Data Technologies: Advanced skills in Apache Spark for big data processing and analytics.
- Programming & Querying: Strong skills in Python for data manipulation, SQL for query optimization, and performance tuning.
- Low Latency Data Pipelines: Experience in building and optimizing pipelines for low-latency model inference and serving in production environments.
- CI/CD & System Integration: Familiarity with continuous integration and deployment practices for ETL/ELT pipeline development.
- Data Pipeline Management: Expertise in managing data pipelines, ensuring adherence to security, compliance, and best practices.
- Metadata & Master Data Management: Competency in managing metadata and master data within a technical data catalogue
- You are a detail-oriented ML Data Engineer passionate about building scalable, efficient data pipelines tailored for machine learning.
- You thrive in a collaborative environment, working effectively with cross-functional teams to drive data-driven insights and personalized solutions.
- You are proactive in troubleshooting, monitoring, and optimizing data pipelines to support high-performance ML models in production.
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
Share
About the role
- Work closely with developers to develop, automate, and execute test plans
- Work closely with other SDETs to make test automation framework changes, perform code reviews, and implement test automation best practices
- Use and automate a variety of debugging tools to assist in triage and collecting system information
- Use creativity, product, and operating system knowledge to develop and execute a variety of exploratory test scenarios
- Help build CI/CD pipelines using Jenkins to automate the software development lifecycle
- Identify and implement opportunities to improve and automate the CI/CD process
- Provide build verification and sign-off
About you
- You have 2+ years of quality testing and automation experience
- You have experience working with python and C++
- You understand and can apply software testing best practices
- Knowledge of Windows Operating System and architecture
- Knowledge of Windows SysInterals tools a bonus
- Knowledge of Windows WHQL and HLK processes a bonus
- Knowledge of anti-malware applications, network applications, cloud programming a bonus
- Knowledge of executable file-formats (MZ, PE, COFF, ELF, MACH-O) is a bonus
- You like working in a team and have excellent communication skills
- You like finding creative solutions to solve hard problems
We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.
- Bonus Program
- Pension and Retirement Plans
- Medical, Dental and Vision Coverage
- Paid Time Off
- Paid Parental Leave
- Support for Community Involvement
These jobs might be a good fit
