The Browns aren't named after a color, they're named after a person. Paul BROWN. The colors were just that. He even made a second team with pretty much the same colors in Cincinnati.
Colors came as a tribute for BG letting them practice near the bell tower.