I can try jotting down my two cents on what I think is an interesting distinction (my perspective is biased by being very interested in mathematical logic).
tl;dr Haskell and Prolog have two different ideas of what computation means, in the sense of what’s the underlying mechanism of computation.
There is this beautiful result in type theory called Curry–Howard correspondence (The Curry here is Haskell Curry, from which the name Haskell comes from). It shows you that in a type theory (you can think in haskell, even if the correspondence is not perfect) types have a direct relations with logical statements, and a program with a given type corresponds to a proof of the corresponding logical statements.
Since you know some haskell, here’s an example:
f :: a -> Either a b
f a = Left a
Now, the type a -> Either a b corresponds to the logical propositional formula A → A ∨ B, and actually the fact that you can write a program with that type at all is because that proposition is a tautology. The implementation of the function is a proof of that proposition.
In fact the program above is also the shortest program that you could write. Another program could be:
f a = snd (42, Left a)
Crucially, evaluating an expression in haskell means starting with a complicated proof (your code), and simplifying it until it becomes the simplest proof possible (your result). So, in this framework (type theory and haskell) computation means normalization (in the sense of simplification of a program - a proof - to its maximum degree, the so called normal form).
In the world of prolog instead, computation is essentially the search of a suitable deduction tree. So, not the normalization of a proof. Instead it is the search of a proof, in principle by any mean possible. Logic + control, they say, but I can imagine the control part being a very wild thing.
I think this is fundamentally a more stimulating conceptual framework for thinking about computational phenomena. But apart from the philosophical enjoyment, what is there to gain by adopting this perspective?
I think it nudges us toward thinking of programs that are not easily expressed in the other paradigm. As an example, a program that sees it’s own deduction process, notices useful patterns, and finds ways of restructuring the computation to exploit that pattern. A sort of CDCL for SAT solvers, but on steroids.
Hope it was useful @emiruz 
ps. I’m not the first to present this as the more interesting distinction. I must have read this somewhere (it could be in one of Triska’s video on youtube but I can’t trace it down).
pps. I’m also not sure I prefer prolog to haskell. Both are beautiful, and flawed; which one to use depends on a lot of considerations. I also like lisps (clojure in particular). It is true however that for now my ideal language would be based on ideas taken from the prolog way of seeing computations.