Intel AI Software Solutions Engineer Frameworks Workloads 

India, Karnataka, Bengaluru 

419717262

We are looking for a dynamic software engineer to design, develop and optimize AI frameworks for training and inference on Intel Habana (https://habana.ai/) deep learning accelerators. In this role, you will work with a cross-geo team on enabling and optimizing state of the art deep learning models with a specific focus on the PyTorch framework. The roles and responsibilities that you would need to carry out may include the following:
Design and develop SW techniques for AI frameworks - both HW-agnostic and HW-aware Contribute to enhancing and extending the Training and Inference capabilities in the Software stack. Profile deep learning inference and training workloads and identify optimization opportunities in the software stack.
BTech, MS or PhD in CS or related fields with an overall experience of 10 to 15 yearsProgramming skills in Advanced C++, Python and parallel programming skillsPrevious exposure to Machine Learning (ML) frameworks such as PyTorch and Tensorflow.Detailed understanding of machine learning systems optimization and deployment techniques such as quantizationunderstanding of optimization strategies for deployment of Large Language Models (LLMs)knowledge of transformers, KV cache , prefill buffer etc optimzation technique for inference.Working knowledge of operators in Pytorch or Tensorflow and Understanding of low level kernels.Ability to debug complex issues in multi layered SW systems. Understanding of SW integration across open source framework and internal bridge layers.Understanding of computer architecture and HW-SW optimization techniquesPractical knowledge of DL topologies for different use casesKnowledge of compiler algorithms for heterogeneous systemsExperience working on frameworks/platforms that have gone to productionEffective communication skills and experience with working in a cross-geo setupPreferred knowledge of open source compiler infrastructure like LLVM or gcc
We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock, bonuses, as well as, benefit programs which include health, retirement, and vacation. Find more information about all of our Amazing Benefits