d-Matrix - Principal Software Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• MS in Computer Engineering, Math, Physics, or a related degree with 8 years of industry experience or a PhD in Computer Engineering, Math, Physics, or a related degree with 4 years of industry experience. • Proficient in C/C++ and Python development in a Linux environment and using standard development tools. • Proven track record of driving software engineering best practices, including CI/CD integration, continuous testing, and leading comprehensive code reviews. • Deep grasp of computer architecture, data structures, system software, and machine learning fundamentals. • Demonstrated experience designing high-quality, scalable APIs and SDKs, with a comprehensive systems engineering mindset to solve end-to-end problems. • Self-motivated team player with a profound sense of ownership and leadership. • Proven experience writing and optimizing high-performance kernels targeting GPUs, TPUs, or custom ML accelerators. • Background working in High-Performance Computing (HPC) environments, managing large-scale distributed workloads and resource optimization. • Experience developing ML compilers and working with intermediate representations or algorithms (e.g., MLIR, LLVM, TVM, Glow, etc.). • Familiarity with leveraging AI-assisted coding tools to accelerate software development and elevate code quality. • Prior startup, small team, or incubation experience. • Work experience at a cloud provider or AI compute/subsystem company. • Equal Opportunity Employment Policy • d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day. • d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.
Responsibilities
• Architect the MLIR-based compiler for cloud inference workloads, focusing on efficient mapping of large-scale AI models (e.g., LLMs, Transformers, Torch-MLIR) onto distributed compute and memory hierarchies. • Lead the development of compiler passes for model partitioning, operator fusion, tensor layout optimization, memory tiling, and latency-aware scheduling. • Design support for hybrid offline/online compilation and deployment flows with runtime-aware mapping, allowing for adaptive resource utilization and load balancing in cloud scenarios. • Define compiler abstractions that interoperate efficiently with runtime systems, orchestration layers, and cloud deployment frameworks. • Drive scalability, reproducibility, and performance through well-designed IR transformations and distributed execution strategies. • Mentor and guide a team of compiler engineers to deliver high-performance inference-optimized software stacks. • BS 15+ Yrs / MS 12+ Yrs / PhD 10+ Yrs Computer Science or Electrical Engineering, with 12+ years of experience in Front End Compiler and systems software development, with a focus on ML inference. • Deep experience in designing or leading compiler efforts using MLIR, LLVM, Torch-MLIR, or similar frameworks. • Strong understanding of model optimization for inference: quantization, fusion, tensor layout transformation, memory hierarchy utilization, and scheduling. • Expertise in deploying ML models to heterogeneous compute environments, with specific attention to latency, throughput, and resource scaling in cloud systems. • Proven track record working with AI frameworks (e.g., PyTorch, TensorFlow), ONNX, and hardware backends. • Experience with cloud infrastructure, including resource provisioning, distributed execution, and profiling tools.
Benefits
• $190K – $300K • Offers Equity • Offers Bonus • The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training. We also offer incentive opportunities that reward employees based on individual and company performance. This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours. • Upload your resume here to autofill key application fields. • Drop your resume here! • Parsing your resume. Autofilling key fields... • or drag and drop here • Provide us with links to see some of your work (Git/ Dribble/ Behance/ Pinterest/ Blog/ Medium) • Decline to self-identify • Hispanic or Latino - A person of Cuban, Mexican, Puerto Rican, South or Central American, or other Spanish culture or origin regardless of race. • Hispanic or Latino • White (Not Hispanic or Latino) - A person having origins in any of the original peoples of Europe, the Middle East, or North Africa. • White • Black or African American (Not Hispanic or Latino) - A person having origins in any of the black racial groups of Africa. • Black or African American • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) - A person having origins in any of the peoples of Hawaii, Guam, Samoa, or other Pacific Islands. • Native Hawaiian or Other Pacific Islander • Asian (Not Hispanic or Latino) - A person having origins in any of the original peoples of the Far East, Southeast Asia, or the Indian Subcontinent, including, for example, Cambodia, China, India, Japan, Korea, Malaysia, Pakistan, the Philippine Islands, Thailand, and Vietnam. • Asian • American Indian or Alaska Native (Not Hispanic or Latino) - A person having origins in any of the original peoples of North and South America (including Central America), and who maintain tribal affiliation or community attachment. • American Indian or Alaska Native • Two or More Races (Not Hispanic or Latino) - All persons who identify with more than one of the above five races. • Two or More Races • Hispanic or Latino • White (Not Hispanic or Latino) • Black or African American (Not Hispanic or Latino) • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) • Asian (Not Hispanic or Latino) • American Indian or Alaska Native (Not Hispanic or Latino) • Two or More Races (Not Hispanic or Latino) • I identify as one or more of the classifications of protected veteran listed above • I am not a protected veteran
Similar Jobs
No credit card. Takes 10 seconds.