[Remote] Software Engineer Intern (Applied Machine Learning - ML System) - 2026 Summer (BS/MS)

Note: The job is a remote job and is open to candidates in USA. ByteDance is a technology company founded in 2012 that aims to inspire creativity and enrich life. They are seeking a Software Engineer Intern to participate in the design and optimization of machine learning systems, providing students with hands-on experience and industry exposure.

Responsibilities

• Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems
• Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability
• Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable continuous delivery
• Collaborating closely with the MLE for optimization of algorithms and systems
• Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills

Skills

• Currently pursuing an Undergraduate/Master in Computer Science or a related technical discipline
• Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc
• Rich experience in online architecture, with the ability to troubleshoot independently
• Strong sense of responsibility, good learning ability, communication skills, and self-motivation
• Must be able to commit to a 12-week full-time work period during Summer or Fall 2026
• Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis
• Knowledge of LLM models, experience in accelerating LLM model optimization is preferred

Benefits

• Day one access to health insurance
• Life insurance
• Wellbeing benefits
• 10 paid holidays per year
• Paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year)
• Housing allowance

Company Overview

Company H1B Sponsorship