feat: Standardize Inference #349

Job	Run time
determine-models	3s
build-models (llama-2-13b, llama2, llama-2, 0.0.2)	42m 56s
build-models (falcon-7b, text-generation, 898df1396f35e447d5fe44e0a3ccaaaa69f30d36, tfs, 0.0.2)	43m 2s
build-models (llama-2-70b-chat, llama2chat, llama-2, 0.0.2)	1h 8m 3s
build-models (llama-2-7b-chat, llama2chat, llama-2, 0.0.2)	1h 25m 51s
build-models (mistral-7b-v0.1, text-generation, 26bca36bde8333b5d7f72e9ed20ccda6a618af24, tfs, 0....	2h 12m 33s
build-models (llama-2-70b, llama2, llama-2, 0.0.2)	3h 9m 54s
build-models (falcon-40b-instruct, text-generation, ecb78d97ac356d098e79f0db222c9ce7c5d9ee5f, tfs...	3h 37m 25s
build-models (mistral-7b-instruct-v0.1, text-generation, 9ab9e76e2b09f9f29ea2d56aa5bd139e4445c59e...	1h 23m 23s
build-models (llama-2-13b-chat, llama2chat, llama-2, 0.0.2)	39m 13s
build-models (llama-2-7b, llama2, llama-2, 0.0.2)	24m 47s
build-models (falcon-7b-instruct, text-generation, cf4b3c42ce2fdfe24f753f0f0d179202fea59c99, tfs,...	1h 27m 25s
build-models (falcon-40b, text-generation, 4a70170c215b36a3cce4b4253f6d0612bb7d4146, tfs, 0.0.2)	2h 19m 19s
	19h 13m 54s

Provide feedback