On the one hand he’s a phenomenally successful businessman who started with nothing and still works as hard as any crew member on any of his boats. On the other hand, it’s hard to find a fisherman in town who has anything good to say about him. Fishing’s a marginal business, though, and people don’t succeed in it by being well liked, they succeed by being tough. Some—such as Gloucester fisherman “Hard” Bob Millard—are tough on themselves, and some are tough on their employees. Brown is tough on both.