This should be fine but why do it? Why not just get a good paint and apply that over the trim?

If you want to use a clear finish instead of a paint use a varnish not the polyurethane. I know varnish will stick just fine, not so sure with the polyurethane.