New York state child custody case please help me...?

I am going threw a custody battle with my boyfriend in Niagara County, and Saturday i am leaving on a train to go back home on a train, I have a son from him that's three years old and he is saying that I will not be able to take him to NYC with me; I want to take him with me but he thinks that because when my now 6 yr old son fell and got hurt when he was barely two that its going to happen again; granted i know that i am leaving my job and home and all my possessions except important papers and most of the children's clothing with a handful of mine. what rights does he and i have he's currently not working and says that in florida he has two jobs lined up for him but that's in july 7 to the 21 buy then ill have a new job, and saving for an apartment while staying at my grandmothers house what can i do???????