I rode a bike with the cast mag wheels (made by Marvic instead of Brembo, but are the same design as stock, same as Oro) almost back to back with mine. The bike had some better suspension components and it was a race bike so that skews the results a little, but it definitely was noticeable how much better it turned and the suspension was a lot better. A lot of that was due to suspension work, but unsprung weight might have been part of it.
If cutting weight is your goal, I would start with the unsprung parts.
Really hard to say if the rest is worth it. If someone has done the replacement and has advice, I'd like to hear it too.