Applied Materials Principal Big Data Architect 

India, Karnataka 

557510213

About Applied

As a Data Architect - Engineer, you will play a pivotal role in designing, implementing, and optimizing data solutions within our organization. You’ll collaborate with cross-functional teams to define data architecture, ensure data quality, and drive efficient data pipelines. Additionally, you’ll specialize in building and optimizing Apache Spark applications for big data processing, streaming, and analytics.

Key Responsibilities

• Negotiate with customers to architect and design business BI and data management application and platform solutions to address complex cross functional and technical needs, and converts design to functional and technical specifications. Identifies and recommend industry BKM's for integrated solution design and standards.
• Manage BI,, Big Data and AI/Ml software application and platform configuration and/or coding, including query and report building, dashboard creation, and master data and integration object development. Introduce and manage BKMs for delivery of self service models. Responsible for the Data Science lifecycle including data curation, and model,build, test and deployment. Lead overall testing (unit, integration, performance, acceptance) and data conversions using standard tools and following established processes and guidelines. Oversees contingent workers performing configuration, coding and object development work. Perform Quality assurance.
• Manage the execution of BI application and platform evaluations and POC's. Assess vendor strategies, roadmaps and next generation technologies, and recommend changes to architectural strategy and technology roadmap.
• Manage personnel providing business Intelligence, big data or AI/ML application and platform support services to meet performance, availability, customer service level agreement, and customer satisfaction targets. Monitors specific IT systems or set of systems for availability, performance and capabilities and reports anomalies through predefined process. Manages completion of root cause analysis and resolution of complex outages or incident trends working with infrastructure and technical teams, support providers and application vendors. Recommends and executes required corrective actions. Participate in evaluation and recommendation of patches, point releases, major upgrades and new systems.
• Deliver and manage personnel ressponsible for the delivery of BI, Big Data and AI/ML project and support services within area of responsibility within allocated budget. Develops project budgets. Develops understanding cost model and cost drivers for service(s) and recommend service area budgets and cost optimization activities. May be responsible for timely renewal of maintenance and subscription contracts.
• Adheres to and manages junior staff to adhere to GIS project management, software application development, testing, service management, change management, RCA and other relevant processes, standards, governance and controls. May manage execution of sox contols and testing, and support internal and external audits.
• Plan and manage medium to large scale Business intelligence, Big Data or AI/ML application or platform projects to ensure effective and efficient execution in line with guardrails of scope, timeline, budget and quality. May serve as a Business Intelligence, Big Data, or AI/ML team lead on a large, complex, cross functional project. May manage junior project managers.
• Oversees/manages contingent workers performing Business Intelligence, Big Data and AI/ML project and/or support services. Responsible for the selection, onboarding and offboarding of contingent workers in a timely manner. Manges contingent worker project/task assignments and ensure work product quality. Approves contingent worker timesheets/cost.
• Architect and design solutions utilizing associated Bigdatatechnologies(databricks),with a focus on delivering solutions using Azure/AWS
• Design and develop data models, schemas, and databases.
• Define data governance policies and standards.
• Collaborate with business stakeholders to understand data requirements.
• Optimize data storage, retrieval, and processing.
• Ensure data security and compliance.
• Evaluate and recommend data technologies and tools.
• Develop Spark applications for data processing and analysis
• Optimize Spark jobs for performance and scalability.
• Troubleshoot and debug Spark-related issues.
• Collaborate with data scientists and data engineers.
• Monitor Spark clusters and manage resources.
• Build production ready highly scalable, available, fault-tolerant data processing systems using Azure technologies, Spark, Elasticsearch and other big data technologies
• Willingness to drive people on all sides of an issue to a common understanding and then drive them toward resolution
• Should be able to clearly communicate ideas in technical or business terms with their peers across IT
• Define Big Data technology strategies and roadmaps

Functional Knowledge

• Demonstrates in-depth understanding of concepts, theories and principles in own job family and basic knowledge of other related job families

Business Expertise

• Applies understanding of the industry and how own area contributes to the achievement of objectives

Leadership

• Manages a generally homogeneous team; adapts plans and priorities to meet service and/or operational challenges

• Impacts the level of service and the team’s ability to meet quality, volume, and timeliness objectives
  Guided by policies and resource requirements within business unit, department or sub-function

Interpersonal Skills

• Guides, influences and persuades others internally in related areas or externally

Qualifications , Experience & Mandatory Skills

• Experience with ETL processes and data integration.
• Expertise on cloud platforms ( Azure, AWS)- Any one
• Strong Proficiency in Python.
• Expertise with data streaming frameworks (e.g., Kafka).
• Proficiency in working with Databricks
• Bachelor’s degree in Computer Science or relevant field.
• 12+ years’ experience with data/Architect related positions and responsibilities

Bachelor's Degree

7 - 10 Years

Full time

Assignee / Regular