英特尔中国研究院招聘实习生

BrianLiu

LLM Finetune Research

Qualifications(要求):

- Solid experience with PyTorch.
- Familiar with LM (BERT/T5/GPT/LLAMA, etc.) and model quantization.
- Knowledge of LoRa/QLoRa/P-tuning should be preferred.
- Experience with Triton should be preferred.
- Self-motivation, independent quick learning and logical thinking.
- Internship of at least 6 months.

Job description(工作内容):

- finetune LLM for specific conversation scenario and modify model structure based on scenario requirements
- parameter tuning during training
- enable Parameter-Efficient Fine-Tuning for Chinese LLM
- optimize LLM training performance

Model Parallelism Performance Analyze and Optimize

Qualifications(要求):
- Strong implementation skills in at least one of C++, C, Python.
- Solid experience with PyTorch DDP.
- Familiar with cuda/dpcpp development and relative profiling tools (Nsight Systems/Vtune).
- Experience with Megatron-LM/DeepSpeed/FSDP should be preferred.
- Good at team working.
- Internship of at least 6 months.

Job description(工作内容):
- analyze performance based on different model parallelism implementations.
- advise for model/data parallelism configuration at target environment (GPU and CPU).
- develop projection model to estimate training performance under target environment.
- implement/optimize kernel based on cuda/Triton/oneDNN.

每周五天，实习期六个月以上

地址：融科资讯中心（北四环 近中科院）

简历投递邮箱：qian.gong@intel.com；请以“姓名+学校+应聘岗位”为邮件主题