What Color of Shoes Should I Wear With Brown Pants? is a common question many men have when getting dressed. Brown pants are versatile bottoms that can be dressed up or down, paired with everything from dress shirts to sweaters. Brown pants can be tricky to style if you don’t know what shoes to wear with them. The right-colored shoes can throw off the entire outfit.