Haha! Yeah the kids can be hard on anything, but you just luv em anyway. With a new kid you might be needing to adjust your timetable a bit. You don't get much sleep for the first four months. Six in some cases.
No need to rush it. Take two years if you need to. Or five. You have a lot of new experiences heading your way with a baby and you sure don't want to miss a single one. Congrats!