Do you think it is ok to take our baby on our honeymoon?

Take her with you if you want to - she is your baby and part of both of you. If you are happy with it then who cares what anyone else thinks!