I have the same pipeline for both with only difference being the IPA model and checkpoint for SD, and as much as the results for SD15 aren't super crisp, but the prompt is followed, the SDXL just outputs the image, like it's IPAdapter+ workflow embedded in the screenshot