👨🏻‍💻 Tech

Large Scale Pretraining

Large language model pretraining ...

Kubenetes is everywhere. ...

How to use antlr framework to generate code parser ...

Parallelism in LLM training ...

PyTorch.. ...

Distributed training infrastructure ...

AWS ...

Tech and talents ...

How to serve your model locally for a demo ...

How to always keep ssh connection alive ...

scan命令详解 ...

Add math equation in my blog

Docker ...

Elegant EM algorithm

Transformer details ...