I'm thinking it'd probably turn out more like Daleks playing Quiddich. "It is the Potter!! EXTERMINATE! EXTERMINATE! " (someone I know on twitter)
So they come with fluff in more ways than one.
"Lost and forgotten, they languished outside of normal space and time; locked in an ages old battle with the nefarious agents of Entropy, the Dust Bunnies."