During Captain Phillips's hostage-taking aboard the lifeboat there is one incident (or one of many in fact) when the situation with the Navy and aboard the lifeboat is escalating a bit (I think after they wanted to bring them water and supplies) and Muse is holding Captain Phillips at gunpoint. At this point Captain Phillips says to Muse something like
You're not fishermen, you're not just simple fishermen!
But I'm not sure what he really wanted to say or achieve with these words, given that he was rather cool-headed and thinking all the time (apart from the finale, though). Did he just want to make them a bad conscience or to intimidate them (though, if he wanted them to fear the Navy, he would have rather said "you are just fishermen"). Or was he maybe trying to show them that he respects their authority? What did he mean with this statement?