[Feature] Support 8/4bit, fp8 optimizers

[kozistr]

Problem (Why?)

Close #208

Solution (What/How?)

• import torchao library to use 8/4bit, fp8 optimizers

Other changes (bug fixes, small refactors)

N/A

Notes

N/A

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 100.00%. Comparing base (1687e37) to head (f3dcf8e).
Report is 6 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##              main      #281   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files           94        94           
  Lines         7237      7241    +4     
=========================================
+ Hits          7237      7241    +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.