Deep Fake - Is a deepfake illegal?

Since many deepfakes use already published, copyrighted material, making them without authorization might be seen as copyright infringement.