Add FSDP CI and end-to-end FSDP tests + save/load fsdp#47357

3outeille wants to merge 13 commits into

split/a-pr-4-1-distributed-runtimehuggingface/transformers:split/a-pr-4-1-distributed-runtimefrom

split/a-pr-4-2-fsdp-tests-cihuggingface/transformers:split/a-pr-4-2-fsdp-tests-ciCopy head branch name to clipboard