Well, it depends. It depends on which fashion rulers you decide to follow. Someone believe that socks should match your pants. Full stop. Others believe that your socks should match your shoes. Full stop. And others believe that your socks could match your shoes or your pants.
If you want my two cents on that: match your socks with your pants. This is a better bet that will work most of the time. And it is the most elegant one as well. If you can, do this match.