Ask HN: 16 yo Nephew, in E. Africa, wants to train an LLM with on disk Wikipedia

Hello HN!

My 16 year old nephew lives in an East African nation where there is practically no internet access.

Last week he asked me for advise as to how to go about training an open source LLM using an on disk Wikipedia (~80 GB).

Any suggestions? Thanks!