It matters the context. Usually when a person rocks your boat it is like saying they move you, the rock your world (you like them a great deal). So "Don't rock my world" may be saying that I don’t want to like you.
