Mistral

[peregilk]

Are the any plans for adding support for Mistral-training? What would be required for this?

[simonucl]

I have forked the repository and added support for Mistral implementation in my forked branch. Most of the code in Llama implementation are reused since they have nearly the same architecture. The training code for Mistral will be made available soon. I hope this helps, and any discussion is welcome.

[peregilk]

Hi @simonucl. Thanks for letting me know. Looked through your code, and it seems great.

Could you contact me regarding the status of the training script? Maybe we can to something together here.

[simonucl]

Sent an email to you!

[R4ZZ3]

Any news on this?

[versae]

@simonucl, @peregilk any luck with the training script?