Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Principal Machine Learning Engineer
Job
Micron Technology
Boise, ID (In Person)
Full-Time
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
100
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Req ID:
JR98097 Principal Machine Learning Engineer Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. The Smart Manufacturing and AI team at Micron Technology is looking for an ambitious Machine Learning Engineer. Our mission is to provide leading machine learning, custom GenAI, and Agentic AI solutions that support Micron's leadership in the competitive memory solutions market. Qualified applicants will have experience with various data and cloud technologies and strong skills in modeling data, querying, and deploying scalable data pipelines to complete machine learning models and AI agents. You will work closely with Data Scientists, Data Engineers, and expert users to build and launch scalable AI/ML solutions that generate value and insight from Micron's manufacturing processes and systems.Responsibilities:
- Architect and complete large-scale custom model training and fine-tuning jobs (SFT, RLHF) on multi-node, multi-GPU clusters.
- Optimize training throughput and memory efficiency using distributed training strategies (FSDP, DeepSpeed, Megatron-LM) and mixed-precision techniques (FP16/BF16).
- Build and develop autonomous AI Agents capable of multi-step reasoning, planning, and tool execution to automate complex manufacturing workflows.
- Implement Agentic frameworks (e.g., LangChain, LangGraph, CrewAI) to orchestrate LLM interactions with internal APIs, databases, and software tools.
- Profile and debug GPU performance bottlenecks using tools like Nsight Systems or PyTorch Profiler to improve hardware utilization.
- Develop and sustain data/solution pipelines that support machine learning models and GenAI applications.
- Build and optimize data structures in data management systems (Snowflake, and Google Cloud platforms) to enable AI/ML and Agentic solutions.
- Build and maintain CI/CD pipelines of machine learning and AI Agent solutions in the cloud.
Minimum Qualifications:
- 10+ years of experience with deep expertise in GPU architecture (memory hierarchy, tensor cores, NVLink) and GPU resource management across cloud and on‑prem environments.
- 5+ years in performance optimization, parallel computing, and low-level systems. Strong C++ skills and experience with GPGPU frameworks. CUDA is preferred, but HIP, OpenCL, or Metal are acceptable.
- Hands-on experience building end-to-end ML systems, including distributed training techniques (DDP, FSDP, model parallelism) and automated pipelines for training, testing, and deployment.
- Strong proficiency in LLMs, including timely engineering, fine-tuning (LoRA/QLoRA), inference optimization (vLLM, TensorRT-LLM), and development of GenAI applications/agents using LangChain, LlamaIndex, AutoGen, and PyTorch.
- Proficient programming skills in Python (preferred) or Java are required, along with experience in CI/CD and cloud-native tools such as Git, Jenkins, Docker, and Kubernetes.
Preferred Qualifications:
- A Ph.D. in Computer Science or Statistics, or equivalent experience.
- Experience with HPC job schedulers (e.g., Slurm) and managing large scale GPU workloads on Kubernetes using tools like Ray and Kubeflow.
- Knowledge of CUDA programming, Triton kernels, and building custom C++ extensions for PyTorch to accelerate workloads.
- Experience crafting and orchestrating teamwork between niche agents in multi agent architectures.
- Deep knowledge of mathematics, probability, statistics, and algorithms.
Machine Learning Engineering MTS Relocation Level:
TBD Before Getting Started Please review Micron's Internal Job Application Policy on your regional PeopleNow Career Opportunities page before searching and applying for jobs.Note in particular that:
- Hiring managers may view your performance appraisals, original resume, transcripts or other performance-related documentation in your personal file. This information will be held in confidence.
- If you are selected to interview for a position, you must notify your direct supervisor before participating in the interview process.