7 Commits

Author	SHA1	Message	Date
gongjy	a8ae342775	Update data preprocessing methods	2024-09-27 16:19:30 +08:00
gongjy	b4359b3335	fix data_process bug	2024-09-23 20:11:19 +08:00
Yu Chengzhang	6fb569abd8	修复了process_seq_monkey写入错误的bug	2024-09-23 18:34:58 +08:00
gongjy	bf64ffb056	update data_process	2024-09-22 21:17:05 +08:00
gongjy	7115a98453	update data_process Chunk_size Read	2024-09-21 22:57:22 +08:00
gongjy	56c6139896	update data_process & full_sft	2024-09-13 13:32:24 +08:00
gongjy	8be42693f6	MiniMind first open source	2024-08-28 16:41:44 +08:00