Please go to CloudFront console, clicking “Create Distribution”, choosing “Web”, then set it up like this. Please notice the Origin Domain Name in Origin Settings must be FQDN and have trusted certificate if you want your origin use HTTPs protocol.
Cache Settings, You can add Host to Header whitelist, and add
wp* to Cookie whitelist. You can set a long Default TTL because the cache could invalidate automatically by this plugin.
Then Front-end Settings, fill your domain name in CNAMEs.